Jul 08 02:37:51.594623 ip-10-0-132-232 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 02:37:51.594632 ip-10-0-132-232 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 02:37:51.594639 ip-10-0-132-232 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 02:37:51.594851 ip-10-0-132-232 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 02:38:01.717100 ip-10-0-132-232 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 02:38:01.717115 ip-10-0-132-232 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6e063c71449c42698561c4024485417a --
Jul 08 02:39:58.169128 ip-10-0-132-232 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 02:39:58.499397 ip-10-0-132-232 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 02:39:58.499397 ip-10-0-132-232 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 02:39:58.499397 ip-10-0-132-232 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 02:39:58.499397 ip-10-0-132-232 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 02:39:58.499397 ip-10-0-132-232 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 02:39:58.500098 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.499983    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 02:39:58.506476 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506460    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 02:39:58.506476 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506475    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 02:39:58.506476 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506478    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506481    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506488    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506492    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506495    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506497    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506500    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506503    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506506    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506514    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506516    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506519    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506522    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506524    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506527    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506529    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506532    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506534    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506537    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 02:39:58.506574 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506540    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506542    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506544    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506547    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506549    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506552    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506554    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506557    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506559    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506562    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506564    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506567    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506569    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506572    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506574    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506577    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506580    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506583    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506586    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506588    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 02:39:58.507073 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506591    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506593    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506596    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506598    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506601    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506603    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506605    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506608    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506610    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506612    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506615    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506617    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506619    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506622    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506624    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506627    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506629    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506633    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506635    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506638    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 02:39:58.507550 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506640    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506642    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506645    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506648    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506650    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506653    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506655    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506658    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506661    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506663    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506672    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506674    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506677    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506681    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506684    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506687    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506689    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506692    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506696    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506698    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 02:39:58.508060 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506701    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506704    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506706    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506708    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506711    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506713    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506715    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506718    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506720    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506723    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506730    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506733    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506737    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506740    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506742    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506745    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506748    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.506751    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507531    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 02:39:58.508533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507537    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507540    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507543    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507545    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507554    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507557    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507559    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507562    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507566    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507571    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507574    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507577    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507580    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507583    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507586    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507589    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507591    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507594    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 02:39:58.509014 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507596    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507599    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507601    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507605    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507608    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507611    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507614    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507617    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507620    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507623    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507628    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507630    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507633    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507636    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507639    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507642    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507644    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507647    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507649    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507653    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 02:39:58.509499 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507656    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507658    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507660    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507663    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507665    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507668    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507670    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507672    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507675    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507677    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507680    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507682    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507684    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507686    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507689    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507691    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507694    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507696    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507698    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507701    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 02:39:58.509995 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507703    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507706    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507710    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507712    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507714    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507717    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507721    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507723    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507726    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507728    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507731    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507734    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507737    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507739    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507742    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507744    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507746    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507749    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507751    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507754    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507756    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 02:39:58.510572 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507758    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507761    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507764    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507766    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507768    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507771    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507773    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507775    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507778    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507781    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507783    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507786    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507788    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507792    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507808    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507811    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507813    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507820    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.507823    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508228    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 02:39:58.511091 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508233    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508236    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508238    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508242    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508244    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508246    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508249    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508251    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508254    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508256    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508260    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508263    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508266    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508269    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508271    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508274    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508276    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508279    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508281    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508283    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 02:39:58.511577 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508286    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508288    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508291    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508294    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508296    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508300    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508303    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508305    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508307    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508312    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508315    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508317    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508320    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508322    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508325    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508328    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508333    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508335    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508338    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 02:39:58.512085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508341    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508343    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508346    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508348    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508350    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508353    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508355    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508358    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508360    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508362    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508365    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508367    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508369    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508371    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508374    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508377    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508380    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508382    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508386    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508389    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 02:39:58.512532 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508391    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508394    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508397    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508400    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508402    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508404    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508407    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508409    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508412    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508414    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508418    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508420    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508423    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508425    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508428    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508430    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508433    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508435    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508437    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508440    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 02:39:58.513024 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508442    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508445    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508447    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508449    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508452    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508454    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508456    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508459    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508462    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508465    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508468    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508471    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508473    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508476    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508479    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508483    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508486    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508489    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.508492    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508559    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 02:39:58.513508 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508565    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508572    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508576    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508580    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508585    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508591    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508597    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508602    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508606    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508612    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508616    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508619    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508622    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508625    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508627    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508630    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508633    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508636    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508639    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508642    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508645    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508648    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508653    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 02:39:58.514008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508656    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508659    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508662    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508665    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508668    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508671    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508674    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508676    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508680    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508683    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508686    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508689    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508692    2580 flags.go:64] FLAG: --enable-server="true"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508695    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508700    2580 flags.go:64] FLAG: --event-burst="100"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508703    2580 flags.go:64] FLAG: --event-qps="50"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508706    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508709    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508711    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508715    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508718    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508720    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508723    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508726    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508728    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 02:39:58.514539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508731    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508734    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508736    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508739    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508741    2580 flags.go:64] FLAG: --feature-gates=""
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508744    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508748    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508751    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508753    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508756    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508759    2580 flags.go:64] FLAG: --help="false"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508763    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508766    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508768    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508771    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508775    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508778    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508780    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508783    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508786    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508788    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508791    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508809    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508812    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 08 02:39:58.515196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508815    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508818    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508820    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508823    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508826    2580 flags.go:64] FLAG: --lock-file=""
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508828    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508831    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508834    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508839    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508842    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508845    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508847    2580 flags.go:64] FLAG: --logging-format="text"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508850    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508853    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508856    2580 flags.go:64] FLAG: --manifest-url=""
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508858    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508862    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508865    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508869    2580 flags.go:64] FLAG: --max-pods="110"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508872    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508875    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508878    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508881    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508883    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508886    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 02:39:58.515787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508889    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508896    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508899    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508902    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508904    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508908    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508912    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508915    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508918    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508920    2580 flags.go:64] FLAG: --port="10250"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508923    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508926    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0290f915461582d96"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508929    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508932    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508935    2580 flags.go:64] FLAG: --register-node="true"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508937    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508941    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508943    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508946    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508948    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508952    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508955    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508958    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508960    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508963    2580 flags.go:64] FLAG: --runonce="false"
Jul 08 02:39:58.516411 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508966    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508968    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508971    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508974    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508976    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508979    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508982    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508984    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508987    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508990    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508992    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508995    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.508998    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509001    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509004    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509009    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509012    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509014    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509018    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509021    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509024    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509026    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509029    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509034    2580 flags.go:64] FLAG: --v="2"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509038    2580 flags.go:64] FLAG: --version="false"
Jul 08 02:39:58.517038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509042    2580 flags.go:64] FLAG: --vmodule=""
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509045    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.509048    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509168    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509171    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509174    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509178    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509181    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509184    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509186    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509190    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509193    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509195    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509198    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509200    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509202    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509205    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509208    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509210    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 02:39:58.517647 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509213    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509215    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509218    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509221    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509223    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509226    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509228    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509230    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509233    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509235    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509238    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509242    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509244    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509247    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509250    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509252    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509254    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509257    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509259    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509263    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 02:39:58.518161 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509266    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509268    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509271    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509273    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509276    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509278    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509280    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509283    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509286    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509288    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509292    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509304    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509307    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509310    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509313    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509316    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509319    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509321    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509324    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 02:39:58.518646 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509326    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509329    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509331    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509334    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509338    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509341    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509343    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509345    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509348    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509350    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509352    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509355    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509358    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509361    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509363    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509366    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509369    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509371    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509373    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509375    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509378    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 02:39:58.519115 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509380    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509383    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509386    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509388    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509391    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509393    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509396    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509398    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509401    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509403    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509406    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509408    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509411    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509413    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509416    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509421    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509424    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509427    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509431    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 02:39:58.519618 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509434    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509436    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509439    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.509441    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.510044    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.516787    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.516820    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.516837    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.516843    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516902    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516908    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516911    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516914    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516917    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516920    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 02:39:58.520094 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516923    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516925    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516928    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516931    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516933    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516935    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516938    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516941    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516944    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516946    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516949    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516951    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516953    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516956    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516958    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516961    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516965    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516969    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516972    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516974    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 02:39:58.520468 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516977    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516980    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516982    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516991    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516994    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516997    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.516999    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517002    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517004    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517006    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517010    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517014    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517016    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517019    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517022    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517024    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517026    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517029    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517031    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 02:39:58.520984 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517034    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517036    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517038    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517041    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517043    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517046    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517049    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517052    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517054    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517057    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517059    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517062    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517064    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517066    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517069    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517072    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517075    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517083    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517087    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 02:39:58.521466 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517091    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517094    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517097    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517099    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517101    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517103    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517106    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517108    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517111    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517113    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517116    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517118    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517120    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517123    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517125    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517128    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517130    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517133    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517135    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517138    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 02:39:58.521986 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517140    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517143    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517145    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517148    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517150    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517152    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517155    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517157    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517160    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517163    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517166    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517174    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517177    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517179    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517182    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 02:39:58.522463 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.517186    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517362    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517368    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517371    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517373    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517376    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517379    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517381    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517384    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517386    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517389    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517391    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517394    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517396    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517399    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517401    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517404    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517406    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517408    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517411    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 02:39:58.522849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517415    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517418    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517421    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517423    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517426    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517428    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517431    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517434    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517437    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517445    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517448    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517452    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517455    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517457    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517459    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517462    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517464    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517466    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517469    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 02:39:58.523342 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517471    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517473    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517476    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517478    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517481    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517483    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517486    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517488    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517490    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517493    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517495    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517498    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517500    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517503    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517505    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517508    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517510    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517512    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517515    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517517    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 02:39:58.523826 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517520    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517522    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517525    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517534    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517537    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517539    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517542    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517544    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517546    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517549    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517551    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517554    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517556    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517558    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517561    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517564    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517566    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517568    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517570    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517573    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 02:39:58.524320 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517575    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517577    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517580    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517582    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517585    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517587    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517590    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517592    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517594    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517597    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517599    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517601    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517604    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517613    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517615    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517617    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517625    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517629    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517632    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 02:39:58.525056 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517635    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 02:39:58.525705 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:58.517637    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 02:39:58.525705 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.517642    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 02:39:58.525705 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.517767    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 02:39:58.525705 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.519884    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 02:39:58.525705 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.521118    2580 server.go:1019] "Starting client certificate rotation"
Jul 08 02:39:58.525705 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.521215    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 02:39:58.525705 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.521249    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 02:39:58.525705 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.523602    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 02:39:58.527146 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.527129    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 02:39:58.539568 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.539541    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 08 02:39:58.541649 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.541633    2580 log.go:25] "Validated CRI v1 image API"
Jul 08 02:39:58.542402 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.542388    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 02:39:58.544461 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.544443    2580 fs.go:135] Filesystem UUIDs: map[27b799c9-5c39-4794-9765-567fb57a7aa2:/dev/nvme0n1p3 28503f8e-4a10-478a-add6-7005fcf4b36d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 08 02:39:58.544514 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.544462    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 02:39:58.549218 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.549103    2580 manager.go:216] Machine: {Timestamp:2026-07-08 02:39:58.548113245 +0000 UTC m=+0.277372094 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108580 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec222fa0ee103b99e3cc63d0f9e718d1 SystemUUID:ec222fa0-ee10-3b99-e3cc-63d0f9e718d1 BootID:6e063c71-449c-4269-8561-c4024485417a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f7:52:8e:60:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f7:52:8e:60:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:61:fe:d4:ea:02 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 02:39:58.549218 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.549207    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 02:39:58.549353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.549288    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 02:39:58.550354 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.550327    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 02:39:58.550495 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.550356    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-232.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 02:39:58.551028 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.551018    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 02:39:58.551058 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.551031    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 02:39:58.551058 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.551038    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 02:39:58.551575 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.551565    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 02:39:58.552373 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.552356    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 02:39:58.552828 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.552819    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 02:39:58.556613 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.556600    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 02:39:58.556736 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.556727    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 02:39:58.556789 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.556780    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 02:39:58.556838 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.556807    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 02:39:58.556838 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.556821    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 02:39:58.556838 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.556830    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 08 02:39:58.556838 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.556838    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 02:39:58.557364 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.557350    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 02:39:58.557418 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.557375    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 02:39:58.559513 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.559474    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 02:39:58.561408 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.561394    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 02:39:58.561458 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.561425    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 02:39:58.562462 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.562450    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 02:39:58.562496 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.562467    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 02:39:58.562496 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.562473    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 02:39:58.562496 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.562480    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 02:39:58.562496 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.562488    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 02:39:58.562496 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.562495    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 02:39:58.562624 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.562503    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 02:39:58.562624 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.562508    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 02:39:58.562624 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.562515    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 02:39:58.562624 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.562521    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 02:39:58.562624 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.562529    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 02:39:58.562624 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.562534    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 02:39:58.563096 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.563087    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 02:39:58.563136 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.563097    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 02:39:58.567086 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.567064    2580 server.go:1268] "Started kubelet"
Jul 08 02:39:58.567955 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.567923    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 02:39:58.568028 ip-10-0-132-232 systemd[1]: Started Kubernetes Kubelet.
Jul 08 02:39:58.568430 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.568390    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 02:39:58.568612 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.568463    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 02:39:58.569924 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.569448    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 02:39:58.569924 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.569611    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-232.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 02:39:58.569924 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.569700    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 02:39:58.570216 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.570165    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 02:39:58.570432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.570375    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 02:39:58.573286 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.573268    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 02:39:58.575892 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.575019    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-232.ec2.internal.18c030277b29cf40  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-232.ec2.internal,UID:ip-10-0-132-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-232.ec2.internal,},FirstTimestamp:2026-07-08 02:39:58.566911808 +0000 UTC m=+0.296170660,LastTimestamp:2026-07-08 02:39:58.566911808 +0000 UTC m=+0.296170660,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-232.ec2.internal,}"
Jul 08 02:39:58.576954 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.576936    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 02:39:58.576954 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.576951    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 02:39:58.577096 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.577011    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:58.577589 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.577553    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 02:39:58.577589 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.577569    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 02:39:58.577776 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.577659    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 02:39:58.577776 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.577730    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 02:39:58.577776 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.577739    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 02:39:58.577917 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.577868    2580 factory.go:55] Registering systemd factory
Jul 08 02:39:58.577917 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.577883    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 08 02:39:58.578107 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.578094    2580 factory.go:153] Registering CRI-O factory
Jul 08 02:39:58.578107 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.578109    2580 factory.go:223] Registration of the crio container factory successfully
Jul 08 02:39:58.578206 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.578150    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 02:39:58.578206 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.578171    2580 factory.go:103] Registering Raw factory
Jul 08 02:39:58.578206 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.578194    2580 manager.go:1196] Started watching for new ooms in manager
Jul 08 02:39:58.578661 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.578647    2580 manager.go:349] Starting recovery of all containers
Jul 08 02:39:58.588400 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.588378    2580 manager.go:354] Recovery completed
Jul 08 02:39:58.589232 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.589193    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 02:39:58.589346 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.589260    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 02:39:58.590045 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.590028    2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 08 02:39:58.593118 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.593103    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:39:58.595258 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.595234    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:39:58.595342 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.595276    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:39:58.595342 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.595288    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:39:58.595896 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.595880    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 02:39:58.595896 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.595894    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 02:39:58.595989 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.595897    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:39:58.595989 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.595911    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 02:39:58.596687 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.596674    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:39:58.596743 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.596698    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:39:58.596743 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.596707    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:39:58.597997 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.597882    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-232.ec2.internal.18c030277cda6a84  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-232.ec2.internal,UID:ip-10-0-132-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-232.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-232.ec2.internal,},FirstTimestamp:2026-07-08 02:39:58.595263108 +0000 UTC m=+0.324521957,LastTimestamp:2026-07-08 02:39:58.595263108 +0000 UTC m=+0.324521957,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-232.ec2.internal,}"
Jul 08 02:39:58.598060 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.598027    2580 policy_none.go:49] "None policy: Start"
Jul 08 02:39:58.598060 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.598038    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 02:39:58.598060 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.598050    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 02:39:58.599984 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.599971    2580 policy_none.go:47] "Start"
Jul 08 02:39:58.610591 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.610437    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-232.ec2.internal.18c030277cdab294  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-232.ec2.internal,UID:ip-10-0-132-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-232.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-232.ec2.internal,},FirstTimestamp:2026-07-08 02:39:58.595281556 +0000 UTC m=+0.324540404,LastTimestamp:2026-07-08 02:39:58.595281556 +0000 UTC m=+0.324540404,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-232.ec2.internal,}"
Jul 08 02:39:58.613453 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.613395    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-232.ec2.internal.18c030277cdadb3d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-232.ec2.internal,UID:ip-10-0-132-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-232.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-232.ec2.internal,},FirstTimestamp:2026-07-08 02:39:58.595291965 +0000 UTC m=+0.324550814,LastTimestamp:2026-07-08 02:39:58.595291965 +0000 UTC m=+0.324550814,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-232.ec2.internal,}"
Jul 08 02:39:58.621320 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.621237    2580 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-232.ec2.internal.18c030277cda6a84\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-232.ec2.internal.18c030277cda6a84  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-232.ec2.internal,UID:ip-10-0-132-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-232.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-232.ec2.internal,},FirstTimestamp:2026-07-08 02:39:58.595263108 +0000 UTC m=+0.324521957,LastTimestamp:2026-07-08 02:39:58.596686258 +0000 UTC m=+0.325945106,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-232.ec2.internal,}"
Jul 08 02:39:58.625148 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.625117    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rjwnl"
Jul 08 02:39:58.631228 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.631166    2580 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-232.ec2.internal.18c030277cdab294\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-232.ec2.internal.18c030277cdab294  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-232.ec2.internal,UID:ip-10-0-132-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-232.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-232.ec2.internal,},FirstTimestamp:2026-07-08 02:39:58.595281556 +0000 UTC m=+0.324540404,LastTimestamp:2026-07-08 02:39:58.596702769 +0000 UTC m=+0.325961619,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-232.ec2.internal,}"
Jul 08 02:39:58.635645 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.635626    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rjwnl"
Jul 08 02:39:58.636991 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.636978    2580 manager.go:337] "Starting Device Plugin manager"
Jul 08 02:39:58.637061 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.637013    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 02:39:58.637061 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.637029    2580 server.go:87] "Starting device plugin registration server"
Jul 08 02:39:58.637287 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.637274    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 02:39:58.637373 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.637292    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 02:39:58.637424 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.637376    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 02:39:58.637473 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.637453    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 02:39:58.637473 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.637462    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 02:39:58.638092 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.638074    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 02:39:58.638178 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.638127    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:58.717677 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.717646    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 02:39:58.719845 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.718897    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 02:39:58.719845 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.718931    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 02:39:58.719845 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.718957    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 02:39:58.719845 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.718993    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 02:39:58.721455 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.721435    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 02:39:58.738422 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.738399    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:39:58.739278 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.739262    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:39:58.739365 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.739296    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:39:58.739365 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.739311    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:39:58.739365 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.739341    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.746345 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.746329    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.746441 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.746352    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-232.ec2.internal\": node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:58.779002 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.778977    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:58.819115 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.819084    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-232.ec2.internal"]
Jul 08 02:39:58.819267 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.819170    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:39:58.820770 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.820755    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:39:58.820847 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.820784    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:39:58.820847 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.820811    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:39:58.823123 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.823110    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:39:58.823228 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.823213    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.823273 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.823244    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:39:58.823888 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.823867    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:39:58.823936 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.823898    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:39:58.823936 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.823910    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:39:58.824482 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.824466    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:39:58.824549 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.824497    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:39:58.824549 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.824511    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:39:58.826740 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.826722    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.826858 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.826753    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:39:58.827486 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.827465    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:39:58.827567 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.827498    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:39:58.827567 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.827511    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:39:58.856763 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.856734    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-232.ec2.internal\" not found" node="ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.861102 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.861085    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-232.ec2.internal\" not found" node="ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.878269 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.878246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5c9a8e36adabd8d8f84c8e5660c5351-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal\" (UID: \"d5c9a8e36adabd8d8f84c8e5660c5351\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.878376 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.878278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5c9a8e36adabd8d8f84c8e5660c5351-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal\" (UID: \"d5c9a8e36adabd8d8f84c8e5660c5351\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.878376 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.878295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1aa1d1c221de548ce4b6c3f565e081e3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-232.ec2.internal\" (UID: \"1aa1d1c221de548ce4b6c3f565e081e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.879215 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.879188    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:58.979299 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:58.979262    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:58.979299 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.979276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5c9a8e36adabd8d8f84c8e5660c5351-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal\" (UID: \"d5c9a8e36adabd8d8f84c8e5660c5351\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.979490 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.979322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5c9a8e36adabd8d8f84c8e5660c5351-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal\" (UID: \"d5c9a8e36adabd8d8f84c8e5660c5351\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.979490 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.979325    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5c9a8e36adabd8d8f84c8e5660c5351-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal\" (UID: \"d5c9a8e36adabd8d8f84c8e5660c5351\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.979490 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.979351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1aa1d1c221de548ce4b6c3f565e081e3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-232.ec2.internal\" (UID: \"1aa1d1c221de548ce4b6c3f565e081e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.979490 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.979388    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1aa1d1c221de548ce4b6c3f565e081e3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-232.ec2.internal\" (UID: \"1aa1d1c221de548ce4b6c3f565e081e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:58.979490 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:58.979394    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5c9a8e36adabd8d8f84c8e5660c5351-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal\" (UID: \"d5c9a8e36adabd8d8f84c8e5660c5351\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:59.080010 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:59.079932    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:59.160163 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.160122    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:59.165078 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.164868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:59.181032 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:59.180916    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:59.281445 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:59.281403    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:59.381953 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:59.381872    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:59.482610 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:59.482579    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:59.520785 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.520756    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 02:39:59.521353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.520942    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 02:39:59.583244 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:59.583218    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:59.638902 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.638835    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 02:34:58 +0000 UTC" deadline="2028-01-14 13:46:12.882680446 +0000 UTC"
Jul 08 02:39:59.638902 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.638866    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13331h6m13.243818362s"
Jul 08 02:39:59.670980 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.670960    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:39:59.672060 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.672037    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:39:59.672159 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.672076    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:39:59.672159 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.672087    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:39:59.683769 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:59.683750    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:59.744697 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.744669    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 02:39:59.778180 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.778156    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 02:39:59.783984 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:39:59.783961    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-232.ec2.internal\" not found"
Jul 08 02:39:59.872484 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.872462    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 02:39:59.877397 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.877381    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:59.893419 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.893371    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 02:39:59.894498 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.894391    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-232.ec2.internal"
Jul 08 02:39:59.904098 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.904080    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 02:39:59.950259 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:59.950229    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa1d1c221de548ce4b6c3f565e081e3.slice/crio-f24a0f0f3935a9da746a0ac5d55f39b782454f0e362070797b6ef691e82a3b5d WatchSource:0}: Error finding container f24a0f0f3935a9da746a0ac5d55f39b782454f0e362070797b6ef691e82a3b5d: Status 404 returned error can't find the container with id f24a0f0f3935a9da746a0ac5d55f39b782454f0e362070797b6ef691e82a3b5d
Jul 08 02:39:59.950726 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:39:59.950699    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c9a8e36adabd8d8f84c8e5660c5351.slice/crio-63d83460c4533902788a1428c00f16ce94c5ef894ba7bb91521a75bfdbd7da04 WatchSource:0}: Error finding container 63d83460c4533902788a1428c00f16ce94c5ef894ba7bb91521a75bfdbd7da04: Status 404 returned error can't find the container with id 63d83460c4533902788a1428c00f16ce94c5ef894ba7bb91521a75bfdbd7da04
Jul 08 02:39:59.954971 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:39:59.954954    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 02:40:00.335722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.335690    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 02:40:00.558063 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.558031    2580 apiserver.go:52] "Watching apiserver"
Jul 08 02:40:00.564372 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.564349    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 02:40:00.565781 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.565757    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8mhpl","kube-system/konnectivity-agent-sfjw8","kube-system/kube-apiserver-proxy-ip-10-0-132-232.ec2.internal","openshift-dns/node-resolver-zv4zt","openshift-image-registry/node-ca-n9r7r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal","openshift-multus/multus-85dsh","openshift-network-operator/iptables-alerter-gk46k","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt","openshift-cluster-node-tuning-operator/tuned-hp74l","openshift-multus/multus-additional-cni-plugins-92h9q","openshift-multus/network-metrics-daemon-bhrdk","openshift-network-diagnostics/network-check-target-6s6xl","openshift-ovn-kubernetes/ovnkube-node-5wkfl"]
Jul 08 02:40:00.568149 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.568128    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.570386 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.570167    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:00.570386 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:00.570234    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:00.571047 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.571031    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 02:40:00.572030 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.572010    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 02:40:00.572030 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.572027    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sgdzn\""
Jul 08 02:40:00.572176 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.572028    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 02:40:00.572323 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.572308    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 02:40:00.572477 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.572460    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.574349 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.574330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zv4zt"
Jul 08 02:40:00.575826 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.575781    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 02:40:00.575926 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.575812    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 02:40:00.576230 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.576200    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 02:40:00.576310 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.576247    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zf94f\""
Jul 08 02:40:00.576310 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.576253    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 02:40:00.576425 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.576201    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 02:40:00.576594 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.576478    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n9r7r"
Jul 08 02:40:00.576594 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.576491    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8658c\""
Jul 08 02:40:00.576731 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.576634    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 02:40:00.576790 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.576478    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 02:40:00.576945 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.576926    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 02:40:00.578098 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.578081    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 02:40:00.578671 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.578651    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gk46k"
Jul 08 02:40:00.580346 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.579521    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 02:40:00.580346 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.579694    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 02:40:00.580346 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.580172    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tvnb4\""
Jul 08 02:40:00.583134 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.580507    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 02:40:00.583134 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.581286    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 02:40:00.583134 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.582336    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.583134 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.582820    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x9l6g\""
Jul 08 02:40:00.583357 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.583294    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 02:40:00.583407 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.583395    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 02:40:00.585292 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.585202    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 02:40:00.585677 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.585656    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:00.585780 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:00.585710    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:00.586141 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.586124    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7pwjq\""
Jul 08 02:40:00.586219 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.586127    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 02:40:00.586268 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.586254    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 02:40:00.586987 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.586967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-cni-bin\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587085 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.586998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0459a02d-aa66-4d52-a7f4-f7291092440b-ovnkube-script-lib\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587085 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-cnibin\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.587085 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587044    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-var-lib-cni-multus\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.587228 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-systemd-units\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587228 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0459a02d-aa66-4d52-a7f4-f7291092440b-ovn-node-metrics-cert\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587228 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be03e543-ac56-494a-8afd-f709208be957-cni-binary-copy\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.587363 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-etc-kubernetes\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.587363 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnzt9\" (UniqueName: \"kubernetes.io/projected/be03e543-ac56-494a-8afd-f709208be957-kube-api-access-bnzt9\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.587363 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-etc-openvswitch\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587363 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-node-log\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587363 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587322    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnvhb\" (UniqueName: \"kubernetes.io/projected/0459a02d-aa66-4d52-a7f4-f7291092440b-kube-api-access-jnvhb\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587363 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-multus-cni-dir\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.587363 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-run-netns\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-run-netns\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-run-systemd\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587443    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-var-lib-openvswitch\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587463    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-log-socket\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k95d6\" (UniqueName: \"kubernetes.io/projected/9d5fe15c-c8aa-408f-8b62-b5e06bbb578b-kube-api-access-k95d6\") pod \"node-ca-n9r7r\" (UID: \"9d5fe15c-c8aa-408f-8b62-b5e06bbb578b\") " pod="openshift-image-registry/node-ca-n9r7r"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl997\" (UniqueName: \"kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997\") pod \"network-check-target-6s6xl\" (UID: \"32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e\") " pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-run-ovn-kubernetes\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0459a02d-aa66-4d52-a7f4-f7291092440b-ovnkube-config\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/791de5a2-81c8-43ad-b2cb-18496f373e69-iptables-alerter-script\") pod \"iptables-alerter-gk46k\" (UID: \"791de5a2-81c8-43ad-b2cb-18496f373e69\") " pod="openshift-network-operator/iptables-alerter-gk46k"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smzc6\" (UniqueName: \"kubernetes.io/projected/791de5a2-81c8-43ad-b2cb-18496f373e69-kube-api-access-smzc6\") pod \"iptables-alerter-gk46k\" (UID: \"791de5a2-81c8-43ad-b2cb-18496f373e69\") " pod="openshift-network-operator/iptables-alerter-gk46k"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-os-release\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-run-k8s-cni-cncf-io\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.587659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-var-lib-cni-bin\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-run-multus-certs\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-cni-netd\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1-hosts-file\") pod \"node-resolver-zv4zt\" (UID: \"1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1\") " pod="openshift-dns/node-resolver-zv4zt"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587739    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d5fe15c-c8aa-408f-8b62-b5e06bbb578b-serviceca\") pod \"node-ca-n9r7r\" (UID: \"9d5fe15c-c8aa-408f-8b62-b5e06bbb578b\") " pod="openshift-image-registry/node-ca-n9r7r"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-system-cni-dir\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587779    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sfjw8"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587785    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-multus-socket-dir-parent\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d5fe15c-c8aa-408f-8b62-b5e06bbb578b-host\") pod \"node-ca-n9r7r\" (UID: \"9d5fe15c-c8aa-408f-8b62-b5e06bbb578b\") " pod="openshift-image-registry/node-ca-n9r7r"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/791de5a2-81c8-43ad-b2cb-18496f373e69-host-slash\") pod \"iptables-alerter-gk46k\" (UID: \"791de5a2-81c8-43ad-b2cb-18496f373e69\") " pod="openshift-network-operator/iptables-alerter-gk46k"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-var-lib-kubelet\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-multus-conf-dir\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-run-openvswitch\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-run-ovn\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.587982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0459a02d-aa66-4d52-a7f4-f7291092440b-env-overrides\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.588002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1-tmp-dir\") pod \"node-resolver-zv4zt\" (UID: \"1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1\") " pod="openshift-dns/node-resolver-zv4zt"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.588037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r42bn\" (UniqueName: \"kubernetes.io/projected/1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1-kube-api-access-r42bn\") pod \"node-resolver-zv4zt\" (UID: \"1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1\") " pod="openshift-dns/node-resolver-zv4zt"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.588058    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-hostroot\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.588301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.588082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be03e543-ac56-494a-8afd-f709208be957-multus-daemon-config\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.588847 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.588105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-kubelet\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.588847 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.588125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-slash\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.590377 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.590004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.590377 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.590235    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 02:40:00.590377 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.590360    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 02:40:00.590540 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.590390    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4qtjm\""
Jul 08 02:40:00.592370 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.592352    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.593066 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.593046    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 02:40:00.593136 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.593097    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vvbkw\""
Jul 08 02:40:00.593214 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.593198    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 02:40:00.594756 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.594001    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 02:40:00.594920 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.594904    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:00.594998 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:00.594972    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:00.595518 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.595502    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 02:40:00.595600 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.595545    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 02:40:00.595732 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.595718    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pmc7j\""
Jul 08 02:40:00.631425 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.631400    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qbg6m"
Jul 08 02:40:00.641201 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.641175    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qbg6m"
Jul 08 02:40:00.678344 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.678317    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 02:40:00.688844 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.688806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0459a02d-aa66-4d52-a7f4-f7291092440b-ovnkube-config\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.689036 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.688849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smzc6\" (UniqueName: \"kubernetes.io/projected/791de5a2-81c8-43ad-b2cb-18496f373e69-kube-api-access-smzc6\") pod \"iptables-alerter-gk46k\" (UID: \"791de5a2-81c8-43ad-b2cb-18496f373e69\") " pod="openshift-network-operator/iptables-alerter-gk46k"
Jul 08 02:40:00.689036 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.688885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/076688ab-9c18-4da7-bf65-a8c8448b3be7-cnibin\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.689036 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.688908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-var-lib-cni-bin\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.689036 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.688933    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-run-multus-certs\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.689036 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689002    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-var-lib-cni-bin\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689056    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-cni-netd\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-var-lib-kubelet\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689097    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-run-multus-certs\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-tuned\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb6cm\" (UniqueName: \"kubernetes.io/projected/ee559e16-d7e0-4342-a5dd-6fc48f779361-kube-api-access-rb6cm\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689154    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-cni-netd\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689168    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-system-cni-dir\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-multus-socket-dir-parent\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d5fe15c-c8aa-408f-8b62-b5e06bbb578b-host\") pod \"node-ca-n9r7r\" (UID: \"9d5fe15c-c8aa-408f-8b62-b5e06bbb578b\") " pod="openshift-image-registry/node-ca-n9r7r"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689241    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-device-dir\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689225    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-system-cni-dir\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689262    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-multus-socket-dir-parent\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-sys-fs\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.689301 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689293    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d5fe15c-c8aa-408f-8b62-b5e06bbb578b-host\") pod \"node-ca-n9r7r\" (UID: \"9d5fe15c-c8aa-408f-8b62-b5e06bbb578b\") " pod="openshift-image-registry/node-ca-n9r7r"
Jul 08 02:40:00.689859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689309    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-sysctl-d\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.689859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-sysctl-conf\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.689859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689320    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0459a02d-aa66-4d52-a7f4-f7291092440b-ovnkube-config\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.689859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-run-openvswitch\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.689859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1-tmp-dir\") pod \"node-resolver-zv4zt\" (UID: \"1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1\") " pod="openshift-dns/node-resolver-zv4zt"
Jul 08 02:40:00.689859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689387    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-hostroot\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.689859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689393    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-run-openvswitch\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.689859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be03e543-ac56-494a-8afd-f709208be957-multus-daemon-config\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.689859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-cni-bin\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.689859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0459a02d-aa66-4d52-a7f4-f7291092440b-ovnkube-script-lib\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.689859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a120d9d-d928-47cc-8200-7aad9d204593-dbus\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:00.689859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689602    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1-tmp-dir\") pod \"node-resolver-zv4zt\" (UID: \"1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1\") " pod="openshift-dns/node-resolver-zv4zt"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689894    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0459a02d-aa66-4d52-a7f4-f7291092440b-ovnkube-script-lib\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689939    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-hostroot\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.689974    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-cni-bin\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690000    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be03e543-ac56-494a-8afd-f709208be957-multus-daemon-config\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c-agent-certs\") pod \"konnectivity-agent-sfjw8\" (UID: \"9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c\") " pod="kube-system/konnectivity-agent-sfjw8"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-systemd\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-lib-modules\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-var-lib-cni-multus\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690125    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-var-lib-cni-multus\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-systemd-units\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c-konnectivity-ca\") pod \"konnectivity-agent-sfjw8\" (UID: \"9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c\") " pod="kube-system/konnectivity-agent-sfjw8"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be03e543-ac56-494a-8afd-f709208be957-cni-binary-copy\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690193    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-systemd-units\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.690227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-etc-openvswitch\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.690747 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-node-log\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.690747 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690257    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-etc-openvswitch\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.690747 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnvhb\" (UniqueName: \"kubernetes.io/projected/0459a02d-aa66-4d52-a7f4-f7291092440b-kube-api-access-jnvhb\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.690747 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-socket-dir\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.690947 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690748    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-node-log\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.690996 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690950    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be03e543-ac56-494a-8afd-f709208be957-cni-binary-copy\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.693389 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.690697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-registration-dir\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.693508 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2js4x\" (UniqueName: \"kubernetes.io/projected/076688ab-9c18-4da7-bf65-a8c8448b3be7-kube-api-access-2js4x\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.693508 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-run-netns\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.693508 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-var-lib-openvswitch\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.693508 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.693698 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693573    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.693698 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693607    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-var-lib-openvswitch\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.693698 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95d6\" (UniqueName: \"kubernetes.io/projected/9d5fe15c-c8aa-408f-8b62-b5e06bbb578b-kube-api-access-k95d6\") pod \"node-ca-n9r7r\" (UID: \"9d5fe15c-c8aa-408f-8b62-b5e06bbb578b\") " pod="openshift-image-registry/node-ca-n9r7r"
Jul 08 02:40:00.693698 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/076688ab-9c18-4da7-bf65-a8c8448b3be7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.693943 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693698    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-run-netns\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.693943 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/791de5a2-81c8-43ad-b2cb-18496f373e69-iptables-alerter-script\") pod \"iptables-alerter-gk46k\" (UID: \"791de5a2-81c8-43ad-b2cb-18496f373e69\") " pod="openshift-network-operator/iptables-alerter-gk46k"
Jul 08 02:40:00.693943 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:00.693943 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-modprobe-d\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.693943 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693837    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-sys\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.693943 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/076688ab-9c18-4da7-bf65-a8c8448b3be7-cni-binary-copy\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.693943 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.693894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/076688ab-9c18-4da7-bf65-a8c8448b3be7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.694353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694016    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-os-release\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.694353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-os-release\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.694353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-run-k8s-cni-cncf-io\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.694353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1-hosts-file\") pod \"node-resolver-zv4zt\" (UID: \"1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1\") " pod="openshift-dns/node-resolver-zv4zt"
Jul 08 02:40:00.694353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694134    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1-hosts-file\") pod \"node-resolver-zv4zt\" (UID: \"1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1\") " pod="openshift-dns/node-resolver-zv4zt"
Jul 08 02:40:00.694353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694157    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-run-k8s-cni-cncf-io\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.694353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d5fe15c-c8aa-408f-8b62-b5e06bbb578b-serviceca\") pod \"node-ca-n9r7r\" (UID: \"9d5fe15c-c8aa-408f-8b62-b5e06bbb578b\") " pod="openshift-image-registry/node-ca-n9r7r"
Jul 08 02:40:00.694353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/791de5a2-81c8-43ad-b2cb-18496f373e69-host-slash\") pod \"iptables-alerter-gk46k\" (UID: \"791de5a2-81c8-43ad-b2cb-18496f373e69\") " pod="openshift-network-operator/iptables-alerter-gk46k"
Jul 08 02:40:00.694353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a120d9d-d928-47cc-8200-7aad9d204593-kubelet-config\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:00.694353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694329    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/791de5a2-81c8-43ad-b2cb-18496f373e69-iptables-alerter-script\") pod \"iptables-alerter-gk46k\" (UID: \"791de5a2-81c8-43ad-b2cb-18496f373e69\") " pod="openshift-network-operator/iptables-alerter-gk46k"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694373    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-kubernetes\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694393    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-etc-selinux\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-var-lib-kubelet\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694497    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/791de5a2-81c8-43ad-b2cb-18496f373e69-host-slash\") pod \"iptables-alerter-gk46k\" (UID: \"791de5a2-81c8-43ad-b2cb-18496f373e69\") " pod="openshift-network-operator/iptables-alerter-gk46k"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-multus-conf-dir\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-run-ovn\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694525    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-host-var-lib-kubelet\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694566    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0459a02d-aa66-4d52-a7f4-f7291092440b-env-overrides\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694581    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-run-ovn\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r42bn\" (UniqueName: \"kubernetes.io/projected/1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1-kube-api-access-r42bn\") pod \"node-resolver-zv4zt\" (UID: \"1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1\") " pod="openshift-dns/node-resolver-zv4zt"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694589    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d5fe15c-c8aa-408f-8b62-b5e06bbb578b-serviceca\") pod \"node-ca-n9r7r\" (UID: \"9d5fe15c-c8aa-408f-8b62-b5e06bbb578b\") " pod="openshift-image-registry/node-ca-n9r7r"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prvfd\" (UniqueName: \"kubernetes.io/projected/a0a908f8-eb73-441c-884f-db2a92f70154-kube-api-access-prvfd\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-sysconfig\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/076688ab-9c18-4da7-bf65-a8c8448b3be7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.694722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694717    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-multus-conf-dir\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-kubelet\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694820    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-kubelet\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-slash\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694837    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-slash\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/076688ab-9c18-4da7-bf65-a8c8448b3be7-system-cni-dir\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.694895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2f7v\" (UniqueName: \"kubernetes.io/projected/3d2357ec-2dcb-4bc2-98bc-2854aa031092-kube-api-access-g2f7v\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-cnibin\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0459a02d-aa66-4d52-a7f4-f7291092440b-ovn-node-metrics-cert\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695429    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-run\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/076688ab-9c18-4da7-bf65-a8c8448b3be7-os-release\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-etc-kubernetes\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnzt9\" (UniqueName: \"kubernetes.io/projected/be03e543-ac56-494a-8afd-f709208be957-kube-api-access-bnzt9\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695492    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-host\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-multus-cni-dir\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-run-netns\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-run-systemd\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.695572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-log-socket\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.696416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695567    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee559e16-d7e0-4342-a5dd-6fc48f779361-tmp\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.696416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl997\" (UniqueName: \"kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997\") pod \"network-check-target-6s6xl\" (UID: \"32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e\") " pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:00.696416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-run-ovn-kubernetes\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.696416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695650    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-run-ovn-kubernetes\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.696416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695683    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-cnibin\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.696416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.695960    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 02:40:00.696416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.696044    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0459a02d-aa66-4d52-a7f4-f7291092440b-env-overrides\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.696416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.696308    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-log-socket\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.696416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.696323    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-etc-kubernetes\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.696416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.696366    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be03e543-ac56-494a-8afd-f709208be957-multus-cni-dir\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.696416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.696404    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-host-run-netns\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.696925 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.696441    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0459a02d-aa66-4d52-a7f4-f7291092440b-run-systemd\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.700282 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.700022    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0459a02d-aa66-4d52-a7f4-f7291092440b-ovn-node-metrics-cert\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.700282 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.700177    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smzc6\" (UniqueName: \"kubernetes.io/projected/791de5a2-81c8-43ad-b2cb-18496f373e69-kube-api-access-smzc6\") pod \"iptables-alerter-gk46k\" (UID: \"791de5a2-81c8-43ad-b2cb-18496f373e69\") " pod="openshift-network-operator/iptables-alerter-gk46k"
Jul 08 02:40:00.700282 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.700177    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnvhb\" (UniqueName: \"kubernetes.io/projected/0459a02d-aa66-4d52-a7f4-f7291092440b-kube-api-access-jnvhb\") pod \"ovnkube-node-5wkfl\" (UID: \"0459a02d-aa66-4d52-a7f4-f7291092440b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.702211 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.702189    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k95d6\" (UniqueName: \"kubernetes.io/projected/9d5fe15c-c8aa-408f-8b62-b5e06bbb578b-kube-api-access-k95d6\") pod \"node-ca-n9r7r\" (UID: \"9d5fe15c-c8aa-408f-8b62-b5e06bbb578b\") " pod="openshift-image-registry/node-ca-n9r7r"
Jul 08 02:40:00.703539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.703522    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r42bn\" (UniqueName: \"kubernetes.io/projected/1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1-kube-api-access-r42bn\") pod \"node-resolver-zv4zt\" (UID: \"1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1\") " pod="openshift-dns/node-resolver-zv4zt"
Jul 08 02:40:00.703630 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:00.703607    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:40:00.703630 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:00.703626    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:40:00.703735 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:00.703638    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fl997 for pod openshift-network-diagnostics/network-check-target-6s6xl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:00.703735 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:00.703692    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997 podName:32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e nodeName:}" failed. No retries permitted until 2026-07-08 02:40:01.20367408 +0000 UTC m=+2.932932930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fl997" (UniqueName: "kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997") pod "network-check-target-6s6xl" (UID: "32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:00.706140 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.706122    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnzt9\" (UniqueName: \"kubernetes.io/projected/be03e543-ac56-494a-8afd-f709208be957-kube-api-access-bnzt9\") pod \"multus-85dsh\" (UID: \"be03e543-ac56-494a-8afd-f709208be957\") " pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.723644 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.723601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-232.ec2.internal" event={"ID":"1aa1d1c221de548ce4b6c3f565e081e3","Type":"ContainerStarted","Data":"f24a0f0f3935a9da746a0ac5d55f39b782454f0e362070797b6ef691e82a3b5d"}
Jul 08 02:40:00.725195 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.725161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal" event={"ID":"d5c9a8e36adabd8d8f84c8e5660c5351","Type":"ContainerStarted","Data":"63d83460c4533902788a1428c00f16ce94c5ef894ba7bb91521a75bfdbd7da04"}
Jul 08 02:40:00.796588 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-device-dir\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.796588 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-sys-fs\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.796844 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-sysctl-d\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.796844 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-sysctl-conf\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.796844 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a120d9d-d928-47cc-8200-7aad9d204593-dbus\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:00.796844 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796690    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-sys-fs\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.796844 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796691    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-device-dir\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.796844 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c-agent-certs\") pod \"konnectivity-agent-sfjw8\" (UID: \"9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c\") " pod="kube-system/konnectivity-agent-sfjw8"
Jul 08 02:40:00.796844 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-systemd\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.796844 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-lib-modules\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.796844 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c-konnectivity-ca\") pod \"konnectivity-agent-sfjw8\" (UID: \"9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c\") " pod="kube-system/konnectivity-agent-sfjw8"
Jul 08 02:40:00.796844 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796840    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-sysctl-d\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.797264 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796843    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a120d9d-d928-47cc-8200-7aad9d204593-dbus\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:00.797264 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-socket-dir\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.797264 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796949    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-socket-dir\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.797264 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.796948    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-sysctl-conf\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.797857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-registration-dir\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.797895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2js4x\" (UniqueName: \"kubernetes.io/projected/076688ab-9c18-4da7-bf65-a8c8448b3be7-kube-api-access-2js4x\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.797936    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-systemd\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.797967    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-lib-modules\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798012    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-registration-dir\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/076688ab-9c18-4da7-bf65-a8c8448b3be7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-modprobe-d\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-sys\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/076688ab-9c18-4da7-bf65-a8c8448b3be7-cni-binary-copy\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/076688ab-9c18-4da7-bf65-a8c8448b3be7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a120d9d-d928-47cc-8200-7aad9d204593-kubelet-config\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-kubernetes\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-etc-selinux\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.798459 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798328    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvfd\" (UniqueName: \"kubernetes.io/projected/a0a908f8-eb73-441c-884f-db2a92f70154-kube-api-access-prvfd\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-sysconfig\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798371    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c-konnectivity-ca\") pod \"konnectivity-agent-sfjw8\" (UID: \"9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c\") " pod="kube-system/konnectivity-agent-sfjw8"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/076688ab-9c18-4da7-bf65-a8c8448b3be7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798468    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-etc-selinux\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/076688ab-9c18-4da7-bf65-a8c8448b3be7-system-cni-dir\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798539    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/076688ab-9c18-4da7-bf65-a8c8448b3be7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2f7v\" (UniqueName: \"kubernetes.io/projected/3d2357ec-2dcb-4bc2-98bc-2854aa031092-kube-api-access-g2f7v\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-run\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/076688ab-9c18-4da7-bf65-a8c8448b3be7-os-release\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:00.798616    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798653    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-host\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:00.798669    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret podName:0a120d9d-d928-47cc-8200-7aad9d204593 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:01.298653469 +0000 UTC m=+3.027912306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret") pod "global-pull-secret-syncer-8mhpl" (UID: "0a120d9d-d928-47cc-8200-7aad9d204593") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798751    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/076688ab-9c18-4da7-bf65-a8c8448b3be7-cni-binary-copy\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798871    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-modprobe-d\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798907    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/076688ab-9c18-4da7-bf65-a8c8448b3be7-system-cni-dir\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.799249 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798934    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-sys\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798933    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-sysconfig\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-host\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798992    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a120d9d-d928-47cc-8200-7aad9d204593-kubelet-config\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.798998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee559e16-d7e0-4342-a5dd-6fc48f779361-tmp\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.799022    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-kubernetes\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.799044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/076688ab-9c18-4da7-bf65-a8c8448b3be7-cnibin\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.799069    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a0a908f8-eb73-441c-884f-db2a92f70154-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.799072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-var-lib-kubelet\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.799102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-tuned\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.799106    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/076688ab-9c18-4da7-bf65-a8c8448b3be7-cnibin\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.799124    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb6cm\" (UniqueName: \"kubernetes.io/projected/ee559e16-d7e0-4342-a5dd-6fc48f779361-kube-api-access-rb6cm\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.799143    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-var-lib-kubelet\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.799198    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee559e16-d7e0-4342-a5dd-6fc48f779361-run\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.799249    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/076688ab-9c18-4da7-bf65-a8c8448b3be7-os-release\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:00.799597    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:00.799964 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:00.799682    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs podName:3d2357ec-2dcb-4bc2-98bc-2854aa031092 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:01.299666355 +0000 UTC m=+3.028925203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs") pod "network-metrics-daemon-bhrdk" (UID: "3d2357ec-2dcb-4bc2-98bc-2854aa031092") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:00.800635 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.800059    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c-agent-certs\") pod \"konnectivity-agent-sfjw8\" (UID: \"9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c\") " pod="kube-system/konnectivity-agent-sfjw8"
Jul 08 02:40:00.800999 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.800979    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/076688ab-9c18-4da7-bf65-a8c8448b3be7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.801120 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.801100    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/076688ab-9c18-4da7-bf65-a8c8448b3be7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.803000 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.802977    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee559e16-d7e0-4342-a5dd-6fc48f779361-etc-tuned\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.804841 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.804785    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee559e16-d7e0-4342-a5dd-6fc48f779361-tmp\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.813233 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.813179    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2js4x\" (UniqueName: \"kubernetes.io/projected/076688ab-9c18-4da7-bf65-a8c8448b3be7-kube-api-access-2js4x\") pod \"multus-additional-cni-plugins-92h9q\" (UID: \"076688ab-9c18-4da7-bf65-a8c8448b3be7\") " pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.815775 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.815745    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prvfd\" (UniqueName: \"kubernetes.io/projected/a0a908f8-eb73-441c-884f-db2a92f70154-kube-api-access-prvfd\") pod \"aws-ebs-csi-driver-node-68ljt\" (UID: \"a0a908f8-eb73-441c-884f-db2a92f70154\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.815941 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.815897    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb6cm\" (UniqueName: \"kubernetes.io/projected/ee559e16-d7e0-4342-a5dd-6fc48f779361-kube-api-access-rb6cm\") pod \"tuned-hp74l\" (UID: \"ee559e16-d7e0-4342-a5dd-6fc48f779361\") " pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.817986 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.817967    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2f7v\" (UniqueName: \"kubernetes.io/projected/3d2357ec-2dcb-4bc2-98bc-2854aa031092-kube-api-access-g2f7v\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:00.879619 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.879542    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-85dsh"
Jul 08 02:40:00.888563 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.888545    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:00.890408 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:40:00.890379    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe03e543_ac56_494a_8afd_f709208be957.slice/crio-ecf7f450c137306595c2be47f7f9da47c3ec6527481721475b7775027a973333 WatchSource:0}: Error finding container ecf7f450c137306595c2be47f7f9da47c3ec6527481721475b7775027a973333: Status 404 returned error can't find the container with id ecf7f450c137306595c2be47f7f9da47c3ec6527481721475b7775027a973333
Jul 08 02:40:00.895858 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.895836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zv4zt"
Jul 08 02:40:00.897162 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:40:00.897138    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0459a02d_aa66_4d52_a7f4_f7291092440b.slice/crio-460d9b33dbb4a144788813e2147f1dcbceac72b0144028b96269fd29b078f6f8 WatchSource:0}: Error finding container 460d9b33dbb4a144788813e2147f1dcbceac72b0144028b96269fd29b078f6f8: Status 404 returned error can't find the container with id 460d9b33dbb4a144788813e2147f1dcbceac72b0144028b96269fd29b078f6f8
Jul 08 02:40:00.901033 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.901011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n9r7r"
Jul 08 02:40:00.904476 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:40:00.904456    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c78c2e9_4d2c_4c57_8517_7e0da7dde3d1.slice/crio-84c40b0c9947398323d0e94fe3fb7957449d08bed0a5106b2688b7e09e0982f7 WatchSource:0}: Error finding container 84c40b0c9947398323d0e94fe3fb7957449d08bed0a5106b2688b7e09e0982f7: Status 404 returned error can't find the container with id 84c40b0c9947398323d0e94fe3fb7957449d08bed0a5106b2688b7e09e0982f7
Jul 08 02:40:00.907515 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.907502    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gk46k"
Jul 08 02:40:00.909129 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:40:00.909110    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5fe15c_c8aa_408f_8b62_b5e06bbb578b.slice/crio-01282a41f7bbea83cb3f92d46d3a96a0a42aafdd85b3baf4faa99c9eeb737eb6 WatchSource:0}: Error finding container 01282a41f7bbea83cb3f92d46d3a96a0a42aafdd85b3baf4faa99c9eeb737eb6: Status 404 returned error can't find the container with id 01282a41f7bbea83cb3f92d46d3a96a0a42aafdd85b3baf4faa99c9eeb737eb6
Jul 08 02:40:00.914448 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.914430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt"
Jul 08 02:40:00.916063 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:40:00.916024    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791de5a2_81c8_43ad_b2cb_18496f373e69.slice/crio-a49b310eba61ce329e7835007aca44714ea10ad42fe7198c081bf4753d034e5b WatchSource:0}: Error finding container a49b310eba61ce329e7835007aca44714ea10ad42fe7198c081bf4753d034e5b: Status 404 returned error can't find the container with id a49b310eba61ce329e7835007aca44714ea10ad42fe7198c081bf4753d034e5b
Jul 08 02:40:00.920894 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.920875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sfjw8"
Jul 08 02:40:00.922591 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:40:00.922569    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a908f8_eb73_441c_884f_db2a92f70154.slice/crio-19dad08dd15919265bac56002dfb892c48d10713f7d813942d346de50ecdc7b3 WatchSource:0}: Error finding container 19dad08dd15919265bac56002dfb892c48d10713f7d813942d346de50ecdc7b3: Status 404 returned error can't find the container with id 19dad08dd15919265bac56002dfb892c48d10713f7d813942d346de50ecdc7b3
Jul 08 02:40:00.925921 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.925900    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hp74l"
Jul 08 02:40:00.929824 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:40:00.929779    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d241be7_d0de_4d31_aa8d_a68c3c0b3b7c.slice/crio-3a3fc7313dfaee2e7ae159bcec2e0de96c17a6fa5b126a87b1f26a3b8074c1b5 WatchSource:0}: Error finding container 3a3fc7313dfaee2e7ae159bcec2e0de96c17a6fa5b126a87b1f26a3b8074c1b5: Status 404 returned error can't find the container with id 3a3fc7313dfaee2e7ae159bcec2e0de96c17a6fa5b126a87b1f26a3b8074c1b5
Jul 08 02:40:00.932481 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:00.932341    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-92h9q"
Jul 08 02:40:00.939746 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:40:00.939722    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee559e16_d7e0_4342_a5dd_6fc48f779361.slice/crio-a842540cfd21363cb098b6d96119d3a75129a154a160eb0f63f00168f3eb4256 WatchSource:0}: Error finding container a842540cfd21363cb098b6d96119d3a75129a154a160eb0f63f00168f3eb4256: Status 404 returned error can't find the container with id a842540cfd21363cb098b6d96119d3a75129a154a160eb0f63f00168f3eb4256
Jul 08 02:40:01.303633 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.303597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl997\" (UniqueName: \"kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997\") pod \"network-check-target-6s6xl\" (UID: \"32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e\") " pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:01.303822 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.303652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:01.303822 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.303683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:01.303822 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:01.303773    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:01.303822 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:01.303774    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:40:01.303822 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:01.303818    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:40:01.304052 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:01.303831    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fl997 for pod openshift-network-diagnostics/network-check-target-6s6xl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:01.304052 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:01.303851    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs podName:3d2357ec-2dcb-4bc2-98bc-2854aa031092 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:02.303833703 +0000 UTC m=+4.033092556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs") pod "network-metrics-daemon-bhrdk" (UID: "3d2357ec-2dcb-4bc2-98bc-2854aa031092") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:01.304052 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:01.303852    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:01.304052 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:01.303895    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997 podName:32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e nodeName:}" failed. No retries permitted until 2026-07-08 02:40:02.303885436 +0000 UTC m=+4.033144271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fl997" (UniqueName: "kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997") pod "network-check-target-6s6xl" (UID: "32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:01.304052 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:01.303919    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret podName:0a120d9d-d928-47cc-8200-7aad9d204593 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:02.303902688 +0000 UTC m=+4.033161528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret") pod "global-pull-secret-syncer-8mhpl" (UID: "0a120d9d-d928-47cc-8200-7aad9d204593") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:01.644164 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.644070    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 02:35:00 +0000 UTC" deadline="2028-01-04 10:00:46.459031514 +0000 UTC"
Jul 08 02:40:01.644164 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.644122    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13087h20m44.814915335s"
Jul 08 02:40:01.720072 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.720047    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:01.720230 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:01.720159    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:01.729179 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.729141    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sfjw8" event={"ID":"9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c","Type":"ContainerStarted","Data":"3a3fc7313dfaee2e7ae159bcec2e0de96c17a6fa5b126a87b1f26a3b8074c1b5"}
Jul 08 02:40:01.730778 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.730745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt" event={"ID":"a0a908f8-eb73-441c-884f-db2a92f70154","Type":"ContainerStarted","Data":"19dad08dd15919265bac56002dfb892c48d10713f7d813942d346de50ecdc7b3"}
Jul 08 02:40:01.733166 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.733139    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gk46k" event={"ID":"791de5a2-81c8-43ad-b2cb-18496f373e69","Type":"ContainerStarted","Data":"a49b310eba61ce329e7835007aca44714ea10ad42fe7198c081bf4753d034e5b"}
Jul 08 02:40:01.735495 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.735447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n9r7r" event={"ID":"9d5fe15c-c8aa-408f-8b62-b5e06bbb578b","Type":"ContainerStarted","Data":"01282a41f7bbea83cb3f92d46d3a96a0a42aafdd85b3baf4faa99c9eeb737eb6"}
Jul 08 02:40:01.737140 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.737117    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl" event={"ID":"0459a02d-aa66-4d52-a7f4-f7291092440b","Type":"ContainerStarted","Data":"460d9b33dbb4a144788813e2147f1dcbceac72b0144028b96269fd29b078f6f8"}
Jul 08 02:40:01.738760 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.738736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-85dsh" event={"ID":"be03e543-ac56-494a-8afd-f709208be957","Type":"ContainerStarted","Data":"ecf7f450c137306595c2be47f7f9da47c3ec6527481721475b7775027a973333"}
Jul 08 02:40:01.743704 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.743676    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92h9q" event={"ID":"076688ab-9c18-4da7-bf65-a8c8448b3be7","Type":"ContainerStarted","Data":"e32b04b0d69ef68493067c9cfb2990ea622adb6fa0aab12a67c6c98a1c681d01"}
Jul 08 02:40:01.745341 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.745310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hp74l" event={"ID":"ee559e16-d7e0-4342-a5dd-6fc48f779361","Type":"ContainerStarted","Data":"a842540cfd21363cb098b6d96119d3a75129a154a160eb0f63f00168f3eb4256"}
Jul 08 02:40:01.746442 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:01.746418    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zv4zt" event={"ID":"1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1","Type":"ContainerStarted","Data":"84c40b0c9947398323d0e94fe3fb7957449d08bed0a5106b2688b7e09e0982f7"}
Jul 08 02:40:02.313650 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:02.311005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl997\" (UniqueName: \"kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997\") pod \"network-check-target-6s6xl\" (UID: \"32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e\") " pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:02.313650 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:02.311074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:02.313650 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:02.311104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:02.313650 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:02.311215    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:02.313650 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:02.311271    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs podName:3d2357ec-2dcb-4bc2-98bc-2854aa031092 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:04.311254788 +0000 UTC m=+6.040513642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs") pod "network-metrics-daemon-bhrdk" (UID: "3d2357ec-2dcb-4bc2-98bc-2854aa031092") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:02.313650 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:02.313471    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:40:02.313650 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:02.313492    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:40:02.313650 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:02.313503    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fl997 for pod openshift-network-diagnostics/network-check-target-6s6xl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:02.313650 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:02.313546    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997 podName:32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e nodeName:}" failed. No retries permitted until 2026-07-08 02:40:04.31353247 +0000 UTC m=+6.042791322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fl997" (UniqueName: "kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997") pod "network-check-target-6s6xl" (UID: "32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:02.313650 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:02.313592    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:02.313650 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:02.313618    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret podName:0a120d9d-d928-47cc-8200-7aad9d204593 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:04.313609926 +0000 UTC m=+6.042868762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret") pod "global-pull-secret-syncer-8mhpl" (UID: "0a120d9d-d928-47cc-8200-7aad9d204593") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:02.644843 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:02.644583    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 02:35:00 +0000 UTC" deadline="2028-01-11 12:17:34.692008163 +0000 UTC"
Jul 08 02:40:02.644843 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:02.644821    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13257h37m32.047194326s"
Jul 08 02:40:02.724597 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:02.724132    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:02.724597 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:02.724259    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:02.724597 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:02.724274    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:02.724597 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:02.724355    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:02.757318 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:02.757263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-232.ec2.internal" event={"ID":"1aa1d1c221de548ce4b6c3f565e081e3","Type":"ContainerStarted","Data":"bdc441943cfc228339d801054ceb6c275e91b6cea8c1e097f8bce9956fbfb486"}
Jul 08 02:40:03.719452 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:03.719420    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:03.719911 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:03.719554    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:03.763537 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:03.763501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal" event={"ID":"d5c9a8e36adabd8d8f84c8e5660c5351","Type":"ContainerStarted","Data":"61ba89517b366181a7ab877f26005dfbafae1bf8a3417a67cf377e6bd7efe6d3"}
Jul 08 02:40:03.784365 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:03.784308    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-232.ec2.internal" podStartSLOduration=4.78428688 podStartE2EDuration="4.78428688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:40:02.773400516 +0000 UTC m=+4.502659371" watchObservedRunningTime="2026-07-08 02:40:03.78428688 +0000 UTC m=+5.513545738"
Jul 08 02:40:04.327545 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:04.327514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl997\" (UniqueName: \"kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997\") pod \"network-check-target-6s6xl\" (UID: \"32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e\") " pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:04.327728 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:04.327588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:04.327728 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:04.327623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:04.327916 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:04.327734    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:04.327916 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:04.327823    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs podName:3d2357ec-2dcb-4bc2-98bc-2854aa031092 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:08.32778609 +0000 UTC m=+10.057044925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs") pod "network-metrics-daemon-bhrdk" (UID: "3d2357ec-2dcb-4bc2-98bc-2854aa031092") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:04.328191 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:04.328177    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:40:04.328255 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:04.328196    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:40:04.328255 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:04.328209    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fl997 for pod openshift-network-diagnostics/network-check-target-6s6xl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:04.328255 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:04.328248    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997 podName:32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e nodeName:}" failed. No retries permitted until 2026-07-08 02:40:08.32823837 +0000 UTC m=+10.057497205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fl997" (UniqueName: "kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997") pod "network-check-target-6s6xl" (UID: "32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:04.328395 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:04.328300    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:04.328395 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:04.328325    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret podName:0a120d9d-d928-47cc-8200-7aad9d204593 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:08.328317824 +0000 UTC m=+10.057576657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret") pod "global-pull-secret-syncer-8mhpl" (UID: "0a120d9d-d928-47cc-8200-7aad9d204593") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:04.719545 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:04.719463    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:04.720012 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:04.719599    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:04.720012 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:04.719463    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:04.720122 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:04.720009    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:05.719900 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:05.719379    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:05.719900 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:05.719513    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:06.719714 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:06.719682    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:06.719915 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:06.719837    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:06.720251 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:06.720232    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:06.720612 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:06.720335    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:07.719593 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:07.719559    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:07.719779 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:07.719699    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:08.363333 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:08.362381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl997\" (UniqueName: \"kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997\") pod \"network-check-target-6s6xl\" (UID: \"32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e\") " pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:08.363333 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:08.362461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:08.363333 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:08.362496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:08.363333 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:08.362618    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:08.363333 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:08.362681    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs podName:3d2357ec-2dcb-4bc2-98bc-2854aa031092 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:16.362661821 +0000 UTC m=+18.091920662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs") pod "network-metrics-daemon-bhrdk" (UID: "3d2357ec-2dcb-4bc2-98bc-2854aa031092") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:08.363333 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:08.362770    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:40:08.363333 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:08.362784    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:40:08.363333 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:08.362815    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fl997 for pod openshift-network-diagnostics/network-check-target-6s6xl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:08.363333 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:08.362855    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997 podName:32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e nodeName:}" failed. No retries permitted until 2026-07-08 02:40:16.362840476 +0000 UTC m=+18.092099313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fl997" (UniqueName: "kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997") pod "network-check-target-6s6xl" (UID: "32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:08.363333 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:08.362911    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:08.363333 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:08.362941    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret podName:0a120d9d-d928-47cc-8200-7aad9d204593 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:16.36293164 +0000 UTC m=+18.092190482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret") pod "global-pull-secret-syncer-8mhpl" (UID: "0a120d9d-d928-47cc-8200-7aad9d204593") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:08.721014 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:08.720983    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:08.721176 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:08.721101    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:08.721176 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:08.721155    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:08.721272 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:08.721249    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:08.775369 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:08.774674    2580 generic.go:356] "Generic (PLEG): container finished" podID="d5c9a8e36adabd8d8f84c8e5660c5351" containerID="61ba89517b366181a7ab877f26005dfbafae1bf8a3417a67cf377e6bd7efe6d3" exitCode=0
Jul 08 02:40:08.775369 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:08.774730    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal" event={"ID":"d5c9a8e36adabd8d8f84c8e5660c5351","Type":"ContainerDied","Data":"61ba89517b366181a7ab877f26005dfbafae1bf8a3417a67cf377e6bd7efe6d3"}
Jul 08 02:40:09.719214 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:09.719177    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:09.719588 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:09.719297    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:10.719489 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:10.719456    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:10.719976 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:10.719580    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:10.720044 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:10.720014    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:10.720142 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:10.720121    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:11.719505 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.719419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:11.719988 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:11.719559    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:11.784906 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.784868    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sfjw8" event={"ID":"9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c","Type":"ContainerStarted","Data":"0ef96870e647f9720638a67d9e66f6c15066b4658c3fac6e8861e3f440bad177"}
Jul 08 02:40:11.786555 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.786525    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt" event={"ID":"a0a908f8-eb73-441c-884f-db2a92f70154","Type":"ContainerStarted","Data":"014696dd51a010140e0c4959d2215376a81b14bada72a46f55cdfe922a44f3a0"}
Jul 08 02:40:11.788232 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.788164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n9r7r" event={"ID":"9d5fe15c-c8aa-408f-8b62-b5e06bbb578b","Type":"ContainerStarted","Data":"5004e4497522254349a5eb0481dffd3192fa0548fc95cc74c91b59a15203d93f"}
Jul 08 02:40:11.790709 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.790686    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal" event={"ID":"d5c9a8e36adabd8d8f84c8e5660c5351","Type":"ContainerStarted","Data":"e80164caf8459a05f44f59ef7b7df666233ccd75a033760e67edf97bca5a94fc"}
Jul 08 02:40:11.793029 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.793005    2580 generic.go:356] "Generic (PLEG): container finished" podID="076688ab-9c18-4da7-bf65-a8c8448b3be7" containerID="ab3b9f9fa8cdbbefabbc8735487ddc46ee40bf84329ef818b336d0cb72f64a7f" exitCode=0
Jul 08 02:40:11.793132 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.793090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92h9q" event={"ID":"076688ab-9c18-4da7-bf65-a8c8448b3be7","Type":"ContainerDied","Data":"ab3b9f9fa8cdbbefabbc8735487ddc46ee40bf84329ef818b336d0cb72f64a7f"}
Jul 08 02:40:11.794984 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.794958    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hp74l" event={"ID":"ee559e16-d7e0-4342-a5dd-6fc48f779361","Type":"ContainerStarted","Data":"0a9a1a015285e94f2be94770dd98e018f99ec144cfce7bcb4b4d491ad18d3600"}
Jul 08 02:40:11.796820 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.796762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zv4zt" event={"ID":"1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1","Type":"ContainerStarted","Data":"c4977b1d7d9e6880d7adbd2d2d0e4e7b4fe8db966e17d2f5051f6a1723799b6f"}
Jul 08 02:40:11.801434 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.801397    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sfjw8" podStartSLOduration=3.491861776 podStartE2EDuration="13.801385526s" totalImagesPullingTime="10.30952375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:40:11.80086152 +0000 UTC m=+13.530120377" watchObservedRunningTime="2026-07-08 02:40:11.801385526 +0000 UTC m=+13.530644401"
Jul 08 02:40:11.845694 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.845644    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zv4zt" podStartSLOduration=3.545568554 podStartE2EDuration="13.845626751s" totalImagesPullingTime="10.300058197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:40:11.821818251 +0000 UTC m=+13.551077106" watchObservedRunningTime="2026-07-08 02:40:11.845626751 +0000 UTC m=+13.574885618"
Jul 08 02:40:11.845897 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.845740    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n9r7r" podStartSLOduration=3.510976703 podStartE2EDuration="13.84573438s" totalImagesPullingTime="10.334757677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:40:11.845547441 +0000 UTC m=+13.574806300" watchObservedRunningTime="2026-07-08 02:40:11.84573438 +0000 UTC m=+13.574993239"
Jul 08 02:40:11.865246 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:11.865191    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hp74l" podStartSLOduration=3.534209099 podStartE2EDuration="13.865170329s" totalImagesPullingTime="10.33096123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:40:11.864884554 +0000 UTC m=+13.594143432" watchObservedRunningTime="2026-07-08 02:40:11.865170329 +0000 UTC m=+13.594429190"
Jul 08 02:40:12.000424 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:12.000346    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sfjw8"
Jul 08 02:40:12.722684 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:12.722618    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:12.723324 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:12.722703    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:12.723324 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:12.722904    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:12.723324 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:12.723018    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:13.720190 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:13.720151    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:13.720371 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:13.720280    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:13.802702 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:13.802653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gk46k" event={"ID":"791de5a2-81c8-43ad-b2cb-18496f373e69","Type":"ContainerStarted","Data":"ff5de63416f883e40c4f4bb282999e159c97c4f5a628a149704110208b6299ab"}
Jul 08 02:40:13.820472 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:13.820426    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-232.ec2.internal" podStartSLOduration=14.820411562 podStartE2EDuration="14.820411562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:40:11.929752182 +0000 UTC m=+13.659011043" watchObservedRunningTime="2026-07-08 02:40:13.820411562 +0000 UTC m=+15.549670419"
Jul 08 02:40:13.820678 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:13.820592    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gk46k" podStartSLOduration=5.493504435 podStartE2EDuration="15.820581943s" totalImagesPullingTime="10.327077508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:40:13.820295263 +0000 UTC m=+15.549554122" watchObservedRunningTime="2026-07-08 02:40:13.820581943 +0000 UTC m=+15.549840803"
Jul 08 02:40:14.720000 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:14.719962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:14.720000 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:14.720009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:14.720241 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:14.720100    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:14.720295 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:14.720262    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:15.720088 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:15.720056    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:15.720647 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:15.720160    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:15.790581 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:15.790543    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sfjw8"
Jul 08 02:40:15.791243 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:15.791227    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sfjw8"
Jul 08 02:40:15.807009 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:15.806988    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sfjw8"
Jul 08 02:40:16.428234 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:16.428198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:16.428427 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:16.428253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:16.428427 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:16.428296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl997\" (UniqueName: \"kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997\") pod \"network-check-target-6s6xl\" (UID: \"32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e\") " pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:16.428427 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:16.428354    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:16.428427 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:16.428419    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:40:16.428427 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:16.428427    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret podName:0a120d9d-d928-47cc-8200-7aad9d204593 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:32.42840747 +0000 UTC m=+34.157666324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret") pod "global-pull-secret-syncer-8mhpl" (UID: "0a120d9d-d928-47cc-8200-7aad9d204593") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:16.428641 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:16.428419    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:16.428641 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:16.428437    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:40:16.428641 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:16.428452    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fl997 for pod openshift-network-diagnostics/network-check-target-6s6xl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:16.428641 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:16.428463    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs podName:3d2357ec-2dcb-4bc2-98bc-2854aa031092 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:32.428453507 +0000 UTC m=+34.157712342 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs") pod "network-metrics-daemon-bhrdk" (UID: "3d2357ec-2dcb-4bc2-98bc-2854aa031092") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:16.428641 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:16.428498    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997 podName:32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e nodeName:}" failed. No retries permitted until 2026-07-08 02:40:32.428483336 +0000 UTC m=+34.157742195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fl997" (UniqueName: "kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997") pod "network-check-target-6s6xl" (UID: "32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:16.720873 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:16.719762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:16.720873 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:16.719834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:16.720873 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:16.719941    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:16.720873 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:16.720037    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:17.719915 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:17.719877    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:17.720107 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:17.720008    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:18.720711 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:18.720512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:18.721134 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:18.720817    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:18.721182 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:18.721167    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:18.721276 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:18.721253    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:19.719968 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:19.719934    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:19.720151 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:19.720059    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:20.719972 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:20.719945    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:20.719972 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:20.719961    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:20.720466 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:20.720068    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:20.720466 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:20.720207    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:21.719485 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:21.719454    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:21.719759 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:21.719571    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:22.719939 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:22.719900    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:22.720392 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:22.719900    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:22.720392 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:22.720014    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:22.720392 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:22.720068    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:22.952632 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:22.952580    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 02:40:23.652386 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.652157    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T02:40:22.952605737Z","UUID":"2384cf42-4a43-4904-9087-0ed02d3c9fe6","Handler":null,"Name":"","Endpoint":""}
Jul 08 02:40:23.655842 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.655821    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 02:40:23.655973 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.655863    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 02:40:23.719724 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.719699    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:23.719883 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:23.719818    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:23.824975 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.824944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt" event={"ID":"a0a908f8-eb73-441c-884f-db2a92f70154","Type":"ContainerStarted","Data":"8d95217bfb7b04771be23d77c71b1686d6d905d05e4f10ca698543e0f8f2d365"}
Jul 08 02:40:23.827864 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.827842    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 02:40:23.828251 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.828231    2580 generic.go:356] "Generic (PLEG): container finished" podID="0459a02d-aa66-4d52-a7f4-f7291092440b" containerID="178f0d26c5769635e548d5b9b84e23ff21a90328f25eebb31ae1b95ac3fac411" exitCode=1
Jul 08 02:40:23.828350 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.828313    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl" event={"ID":"0459a02d-aa66-4d52-a7f4-f7291092440b","Type":"ContainerStarted","Data":"a8c679f937daeda391827e735df8b65e8f6ec8ee494c098f65deec314d660660"}
Jul 08 02:40:23.828412 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.828396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl" event={"ID":"0459a02d-aa66-4d52-a7f4-f7291092440b","Type":"ContainerStarted","Data":"c8223e774712ca6850232dd8ee5fd8caedf0a2d193018c14763d781bb6606ebd"}
Jul 08 02:40:23.828467 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.828447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl" event={"ID":"0459a02d-aa66-4d52-a7f4-f7291092440b","Type":"ContainerStarted","Data":"bf6d28091e3aecc3ae85da0363390c2aebe38bf5fbe73dba77b3baab46b2bdd7"}
Jul 08 02:40:23.828520 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.828494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl" event={"ID":"0459a02d-aa66-4d52-a7f4-f7291092440b","Type":"ContainerStarted","Data":"365d4a590079ae5cfe5801915d1f2b5f5ae2dc5d2ea03923cb4019cf95bcacb4"}
Jul 08 02:40:23.828577 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.828542    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl" event={"ID":"0459a02d-aa66-4d52-a7f4-f7291092440b","Type":"ContainerDied","Data":"178f0d26c5769635e548d5b9b84e23ff21a90328f25eebb31ae1b95ac3fac411"}
Jul 08 02:40:23.828629 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.828594    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl" event={"ID":"0459a02d-aa66-4d52-a7f4-f7291092440b","Type":"ContainerStarted","Data":"3e5c45c12fae372e3774d8ba6d63c5444430b49de78d65377ee509e9a4920ebe"}
Jul 08 02:40:23.829924 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.829874    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-85dsh" event={"ID":"be03e543-ac56-494a-8afd-f709208be957","Type":"ContainerStarted","Data":"cc5d18555b8a0302acb7c9762d96b657927a733aa6462bc7697a7a5934a4159f"}
Jul 08 02:40:23.831814 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.831776    2580 generic.go:356] "Generic (PLEG): container finished" podID="076688ab-9c18-4da7-bf65-a8c8448b3be7" containerID="f714a81cea7b08e1146212f7473b36fc9a16054e705a17fc297d357b33b4fe2a" exitCode=0
Jul 08 02:40:23.831924 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.831837    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92h9q" event={"ID":"076688ab-9c18-4da7-bf65-a8c8448b3be7","Type":"ContainerDied","Data":"f714a81cea7b08e1146212f7473b36fc9a16054e705a17fc297d357b33b4fe2a"}
Jul 08 02:40:23.851157 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:23.851118    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-85dsh" podStartSLOduration=4.007896515 podStartE2EDuration="25.851106643s" totalImagesPullingTime="21.843210128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:40:23.85046106 +0000 UTC m=+25.579719938" watchObservedRunningTime="2026-07-08 02:40:23.851106643 +0000 UTC m=+25.580365501"
Jul 08 02:40:24.719500 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:24.719426    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:24.719670 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:24.719522    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:24.719670 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:24.719626    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:24.719757 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:24.719739    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:24.837008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:24.836972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt" event={"ID":"a0a908f8-eb73-441c-884f-db2a92f70154","Type":"ContainerStarted","Data":"8a7ec8275282a82351a3ca07b23c3ea5a097794976ee42cd3d5ebdbb918abbe8"}
Jul 08 02:40:25.720005 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:25.719972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:25.720162 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:25.720072    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:25.843188 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:25.843120    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 02:40:25.843595 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:25.843498    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl" event={"ID":"0459a02d-aa66-4d52-a7f4-f7291092440b","Type":"ContainerStarted","Data":"40b859b10e8b2fae0c959ea57d1497c5caf6c7dab46710abcce9281962e9cc43"}
Jul 08 02:40:25.845580 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:25.845560    2580 generic.go:356] "Generic (PLEG): container finished" podID="076688ab-9c18-4da7-bf65-a8c8448b3be7" containerID="f218da78d5b18377f46d2eee50dfbbbd1f887290e53306f7650fe2c201166fa3" exitCode=0
Jul 08 02:40:25.845670 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:25.845653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92h9q" event={"ID":"076688ab-9c18-4da7-bf65-a8c8448b3be7","Type":"ContainerDied","Data":"f218da78d5b18377f46d2eee50dfbbbd1f887290e53306f7650fe2c201166fa3"}
Jul 08 02:40:25.870503 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:25.870463    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68ljt" podStartSLOduration=4.885232611 podStartE2EDuration="27.87044891s" totalImagesPullingTime="22.985216299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:40:24.857961931 +0000 UTC m=+26.587220790" watchObservedRunningTime="2026-07-08 02:40:25.87044891 +0000 UTC m=+27.599707769"
Jul 08 02:40:26.719431 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:26.719399    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:26.719610 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:26.719399    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:26.719610 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:26.719532    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:26.719730 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:26.719610    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:27.719939 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:27.719813    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:27.720241 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:27.720019    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:27.854328 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:27.854299    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 02:40:27.854788 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:27.854757    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl" event={"ID":"0459a02d-aa66-4d52-a7f4-f7291092440b","Type":"ContainerStarted","Data":"c0ebbf4aa5d9eff4b4e7cc02df0421099868d252344fd4962be31c9f249a1ea4"}
Jul 08 02:40:27.855120 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:27.855095    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:27.855230 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:27.855180    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:27.855320 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:27.855302    2580 scope.go:117] "RemoveContainer" containerID="178f0d26c5769635e548d5b9b84e23ff21a90328f25eebb31ae1b95ac3fac411"
Jul 08 02:40:27.857445 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:27.857422    2580 generic.go:356] "Generic (PLEG): container finished" podID="076688ab-9c18-4da7-bf65-a8c8448b3be7" containerID="e9168a897326301487588c721abae70e4bb9e0d5af991d931a44a6b14e2a909e" exitCode=0
Jul 08 02:40:27.857536 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:27.857471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92h9q" event={"ID":"076688ab-9c18-4da7-bf65-a8c8448b3be7","Type":"ContainerDied","Data":"e9168a897326301487588c721abae70e4bb9e0d5af991d931a44a6b14e2a909e"}
Jul 08 02:40:27.875174 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:27.875153    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:28.720117 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:28.720085    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:28.720641 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:28.720088    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:28.720641 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:28.720209    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:28.720641 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:28.720298    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:28.864454 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:28.864425    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 02:40:28.864864 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:28.864834    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl" event={"ID":"0459a02d-aa66-4d52-a7f4-f7291092440b","Type":"ContainerStarted","Data":"9adbe8d1fb3debee69bc030d5118152d918584082d6a1e2ac473077bfd7f8f35"}
Jul 08 02:40:28.865050 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:28.865028    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:28.882732 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:28.882700    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:40:28.938134 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:28.938060    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl" podStartSLOduration=9.101296927 podStartE2EDuration="30.938035759s" totalImagesPullingTime="21.836738832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:40:28.900553072 +0000 UTC m=+30.629811931" watchObservedRunningTime="2026-07-08 02:40:28.938035759 +0000 UTC m=+30.667294620"
Jul 08 02:40:29.719763 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:29.719728    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:29.719961 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:29.719877    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:30.144227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:30.144192    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8mhpl"]
Jul 08 02:40:30.144767 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:30.144312    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:30.144767 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:30.144442    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:30.153090 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:30.153048    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bhrdk"]
Jul 08 02:40:30.153229 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:30.153218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:30.153400 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:30.153353    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:30.172534 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:30.172298    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6s6xl"]
Jul 08 02:40:30.172534 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:30.172414    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:30.172534 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:30.172495    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:31.720073 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:31.720043    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:31.720521 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:31.720060    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:31.720521 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:31.720173    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:31.720521 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:31.720185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:31.720521 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:31.720307    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:31.720521 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:31.720388    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:32.441203 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:32.440980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl997\" (UniqueName: \"kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997\") pod \"network-check-target-6s6xl\" (UID: \"32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e\") " pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:32.441358 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:32.441176    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:40:32.441358 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:32.441252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:32.441358 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:32.441294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:32.441358 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:32.441259    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:40:32.441358 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:32.441334    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:32.441358 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:32.441341    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fl997 for pod openshift-network-diagnostics/network-check-target-6s6xl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:32.441582 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:32.441371    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:32.441582 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:32.441399    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret podName:0a120d9d-d928-47cc-8200-7aad9d204593 nodeName:}" failed. No retries permitted until 2026-07-08 02:41:04.441382324 +0000 UTC m=+66.170641180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret") pod "global-pull-secret-syncer-8mhpl" (UID: "0a120d9d-d928-47cc-8200-7aad9d204593") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:40:32.441582 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:32.441415    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997 podName:32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e nodeName:}" failed. No retries permitted until 2026-07-08 02:41:04.441406882 +0000 UTC m=+66.170665718 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fl997" (UniqueName: "kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997") pod "network-check-target-6s6xl" (UID: "32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:40:32.441582 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:32.441426    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs podName:3d2357ec-2dcb-4bc2-98bc-2854aa031092 nodeName:}" failed. No retries permitted until 2026-07-08 02:41:04.44142053 +0000 UTC m=+66.170679365 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs") pod "network-metrics-daemon-bhrdk" (UID: "3d2357ec-2dcb-4bc2-98bc-2854aa031092") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:40:33.719900 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:33.719869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:33.720425 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:33.719898    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:33.720425 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:33.719869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:33.720425 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:33.719974    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mhpl" podUID="0a120d9d-d928-47cc-8200-7aad9d204593"
Jul 08 02:40:33.720425 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:33.720053    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s6xl" podUID="32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e"
Jul 08 02:40:33.720425 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:33.720102    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:40:33.880576 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:33.880546    2580 generic.go:356] "Generic (PLEG): container finished" podID="076688ab-9c18-4da7-bf65-a8c8448b3be7" containerID="8baa3a4e9639531170c8eb5b4bfb3c3c88b457c1a60e60ba2b8da561227b3e42" exitCode=0
Jul 08 02:40:33.880697 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:33.880605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92h9q" event={"ID":"076688ab-9c18-4da7-bf65-a8c8448b3be7","Type":"ContainerDied","Data":"8baa3a4e9639531170c8eb5b4bfb3c3c88b457c1a60e60ba2b8da561227b3e42"}
Jul 08 02:40:34.885959 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:34.885928    2580 generic.go:356] "Generic (PLEG): container finished" podID="076688ab-9c18-4da7-bf65-a8c8448b3be7" containerID="04ec59fb533a77c0a3d5373331c5d945313dce613d221186ec228dd381388848" exitCode=0
Jul 08 02:40:34.886447 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:34.885991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92h9q" event={"ID":"076688ab-9c18-4da7-bf65-a8c8448b3be7","Type":"ContainerDied","Data":"04ec59fb533a77c0a3d5373331c5d945313dce613d221186ec228dd381388848"}
Jul 08 02:40:35.637573 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.637545    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-232.ec2.internal" event="NodeReady"
Jul 08 02:40:35.637840 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.637698    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 02:40:35.690277 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.690243    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"]
Jul 08 02:40:35.711880 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.711848    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6996c657c7-dmlmj"]
Jul 08 02:40:35.712023 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.711970    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:40:35.714730 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.714707    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 08 02:40:35.714863 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.714707    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fgz9q\""
Jul 08 02:40:35.715097 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.715079    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 08 02:40:35.732006 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.731987    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.732103 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.731991    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"]
Jul 08 02:40:35.732173 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.732135    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bkf6s"]
Jul 08 02:40:35.736094 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.736073    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 02:40:35.738347 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.738331    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 02:40:35.740765 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.740740    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 02:40:35.740765 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.740763    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6tthw\""
Jul 08 02:40:35.754296 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.754276    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 02:40:35.757960 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.757944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bkf6s"]
Jul 08 02:40:35.758040 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.757968    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6996c657c7-dmlmj"]
Jul 08 02:40:35.758079 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.758061    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:40:35.758182 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.758164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:40:35.758314 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.758298    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bkf6s"
Jul 08 02:40:35.758454 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.758436    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:40:35.766128 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.766104    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 02:40:35.766295 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.766274    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 02:40:35.766413 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.766333    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 02:40:35.766538 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.766521    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n5djs\""
Jul 08 02:40:35.766538 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.766532    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 02:40:35.766656 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.766562    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 02:40:35.766751 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.766734    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 02:40:35.766882 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.766839    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 02:40:35.766960 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.766884    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c7hfw\""
Jul 08 02:40:35.767010 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.766981    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d2c2d\""
Jul 08 02:40:35.811488 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.811461    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xdd7v"]
Jul 08 02:40:35.832028 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.832002    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xdd7v"]
Jul 08 02:40:35.832151 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.832103    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:35.837627 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.837602    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 02:40:35.837742 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.837730    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8d2rg\""
Jul 08 02:40:35.837905 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.837889    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 02:40:35.867220 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.867199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3957494-6ce0-4487-89ff-b272483f09f8-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:40:35.867324 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.867225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4lmp\" (UniqueName: \"kubernetes.io/projected/be2b357e-a17e-4689-843b-b519c8e5dc76-kube-api-access-h4lmp\") pod \"ingress-canary-bkf6s\" (UID: \"be2b357e-a17e-4689-843b-b519c8e5dc76\") " pod="openshift-ingress-canary/ingress-canary-bkf6s"
Jul 08 02:40:35.867324 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.867306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-certificates\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.867399 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.867360    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-installation-pull-secrets\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.867432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.867405    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.867464 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.867433    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-image-registry-private-configuration\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.867464 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.867451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:40:35.867523 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.867488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8tw6\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-kube-api-access-b8tw6\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.867557 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.867526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-trusted-ca\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.867557 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.867542    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-ca-trust-extracted\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.867615 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.867565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-bound-sa-token\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.867615 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.867607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be2b357e-a17e-4689-843b-b519c8e5dc76-cert\") pod \"ingress-canary-bkf6s\" (UID: \"be2b357e-a17e-4689-843b-b519c8e5dc76\") " pod="openshift-ingress-canary/ingress-canary-bkf6s"
Jul 08 02:40:35.891151 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.891090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92h9q" event={"ID":"076688ab-9c18-4da7-bf65-a8c8448b3be7","Type":"ContainerStarted","Data":"8d22f731876d86e535326d122bd1321b8d7f6507f8183cc3bdf1f16c7526abe6"}
Jul 08 02:40:35.922157 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.922114    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-92h9q" podStartSLOduration=8.446366418 podStartE2EDuration="37.922100558s" totalImagesPullingTime="29.47573414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:40:35.921983045 +0000 UTC m=+37.651241903" watchObservedRunningTime="2026-07-08 02:40:35.922100558 +0000 UTC m=+37.651359415"
Jul 08 02:40:35.968939 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.968736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-certificates\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.969171 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.969150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-installation-pull-secrets\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.969248 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.969206    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.969308 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.969247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-image-registry-private-configuration\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.969308 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.969281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:40:35.969412 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:35.969397    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 02:40:35.969486 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:35.969473    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert podName:a3957494-6ce0-4487-89ff-b272483f09f8 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:36.469453532 +0000 UTC m=+38.198712383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-42pzm" (UID: "a3957494-6ce0-4487-89ff-b272483f09f8") : secret "networking-console-plugin-cert" not found
Jul 08 02:40:35.969986 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:35.969824    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 02:40:35.969986 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:35.969856    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6996c657c7-dmlmj: secret "image-registry-tls" not found
Jul 08 02:40:35.969986 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.969877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3704874-db93-4dc6-aeab-b6ad43bd74e6-config-volume\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:35.970652 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:35.969920    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls podName:32bc9f9f-fb76-487a-8c58-b4b2b64f2d92 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:36.469901812 +0000 UTC m=+38.199160662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls") pod "image-registry-6996c657c7-dmlmj" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92") : secret "image-registry-tls" not found
Jul 08 02:40:35.970652 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.970113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8tw6\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-kube-api-access-b8tw6\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.970652 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.970160    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:35.970652 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.970193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d48p2\" (UniqueName: \"kubernetes.io/projected/b3704874-db93-4dc6-aeab-b6ad43bd74e6-kube-api-access-d48p2\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:35.970652 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.970238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-trusted-ca\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.970652 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.970269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-ca-trust-extracted\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.970652 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.970294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-bound-sa-token\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.970652 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.970407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3704874-db93-4dc6-aeab-b6ad43bd74e6-tmp-dir\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:35.970652 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.970452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be2b357e-a17e-4689-843b-b519c8e5dc76-cert\") pod \"ingress-canary-bkf6s\" (UID: \"be2b357e-a17e-4689-843b-b519c8e5dc76\") " pod="openshift-ingress-canary/ingress-canary-bkf6s"
Jul 08 02:40:35.971148 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.970930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3957494-6ce0-4487-89ff-b272483f09f8-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:40:35.971148 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.970965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4lmp\" (UniqueName: \"kubernetes.io/projected/be2b357e-a17e-4689-843b-b519c8e5dc76-kube-api-access-h4lmp\") pod \"ingress-canary-bkf6s\" (UID: \"be2b357e-a17e-4689-843b-b519c8e5dc76\") " pod="openshift-ingress-canary/ingress-canary-bkf6s"
Jul 08 02:40:35.972380 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.971870    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-ca-trust-extracted\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.973237 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.972791    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a3957494-6ce0-4487-89ff-b272483f09f8-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:40:35.974386 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.973783    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-certificates\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.975641 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.975621    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be2b357e-a17e-4689-843b-b519c8e5dc76-cert\") pod \"ingress-canary-bkf6s\" (UID: \"be2b357e-a17e-4689-843b-b519c8e5dc76\") " pod="openshift-ingress-canary/ingress-canary-bkf6s"
Jul 08 02:40:35.975725 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.975640    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-installation-pull-secrets\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.975765 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.975737    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-trusted-ca\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.975860 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.975841    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-image-registry-private-configuration\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.984250 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.984232    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-bound-sa-token\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.984503 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.984487    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8tw6\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-kube-api-access-b8tw6\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:35.989186 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:35.989168    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4lmp\" (UniqueName: \"kubernetes.io/projected/be2b357e-a17e-4689-843b-b519c8e5dc76-kube-api-access-h4lmp\") pod \"ingress-canary-bkf6s\" (UID: \"be2b357e-a17e-4689-843b-b519c8e5dc76\") " pod="openshift-ingress-canary/ingress-canary-bkf6s"
Jul 08 02:40:36.071929 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.071890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3704874-db93-4dc6-aeab-b6ad43bd74e6-config-volume\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:36.072091 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.071939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:36.072091 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.071958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d48p2\" (UniqueName: \"kubernetes.io/projected/b3704874-db93-4dc6-aeab-b6ad43bd74e6-kube-api-access-d48p2\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:36.072091 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.071992    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3704874-db93-4dc6-aeab-b6ad43bd74e6-tmp-dir\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:36.072091 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:36.072060    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 02:40:36.072267 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:36.072131    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls podName:b3704874-db93-4dc6-aeab-b6ad43bd74e6 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:36.572103263 +0000 UTC m=+38.301362100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls") pod "dns-default-xdd7v" (UID: "b3704874-db93-4dc6-aeab-b6ad43bd74e6") : secret "dns-default-metrics-tls" not found
Jul 08 02:40:36.072404 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.072386    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3704874-db93-4dc6-aeab-b6ad43bd74e6-tmp-dir\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:36.072457 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.072437    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3704874-db93-4dc6-aeab-b6ad43bd74e6-config-volume\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:36.078914 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.078895    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bkf6s"
Jul 08 02:40:36.083384 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.083362    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d48p2\" (UniqueName: \"kubernetes.io/projected/b3704874-db93-4dc6-aeab-b6ad43bd74e6-kube-api-access-d48p2\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:36.294060 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.293864    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bkf6s"]
Jul 08 02:40:36.298446 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:40:36.298413    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2b357e_a17e_4689_843b_b519c8e5dc76.slice/crio-acb01982c6894c69676012f02d859c1ca975e9f3e0a0ee30c1d4359c73aa3d9b WatchSource:0}: Error finding container acb01982c6894c69676012f02d859c1ca975e9f3e0a0ee30c1d4359c73aa3d9b: Status 404 returned error can't find the container with id acb01982c6894c69676012f02d859c1ca975e9f3e0a0ee30c1d4359c73aa3d9b
Jul 08 02:40:36.476092 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.475961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:36.476092 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.476006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:40:36.476321 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:36.476133    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 02:40:36.476321 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:36.476151    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6996c657c7-dmlmj: secret "image-registry-tls" not found
Jul 08 02:40:36.476321 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:36.476201    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 02:40:36.476321 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:36.476206    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls podName:32bc9f9f-fb76-487a-8c58-b4b2b64f2d92 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:37.476190974 +0000 UTC m=+39.205449833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls") pod "image-registry-6996c657c7-dmlmj" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92") : secret "image-registry-tls" not found
Jul 08 02:40:36.476321 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:36.476263    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert podName:a3957494-6ce0-4487-89ff-b272483f09f8 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:37.476248163 +0000 UTC m=+39.205507004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-42pzm" (UID: "a3957494-6ce0-4487-89ff-b272483f09f8") : secret "networking-console-plugin-cert" not found
Jul 08 02:40:36.577381 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.577344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:36.577535 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:36.577452    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 02:40:36.577535 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:36.577501    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls podName:b3704874-db93-4dc6-aeab-b6ad43bd74e6 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:37.577489055 +0000 UTC m=+39.306747891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls") pod "dns-default-xdd7v" (UID: "b3704874-db93-4dc6-aeab-b6ad43bd74e6") : secret "dns-default-metrics-tls" not found
Jul 08 02:40:36.894212 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:36.894179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bkf6s" event={"ID":"be2b357e-a17e-4689-843b-b519c8e5dc76","Type":"ContainerStarted","Data":"acb01982c6894c69676012f02d859c1ca975e9f3e0a0ee30c1d4359c73aa3d9b"}
Jul 08 02:40:37.484920 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:37.484883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:37.484920 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:37.484925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:40:37.485256 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:37.485046    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 02:40:37.485256 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:37.485054    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 02:40:37.485256 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:37.485077    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6996c657c7-dmlmj: secret "image-registry-tls" not found
Jul 08 02:40:37.485256 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:37.485102    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert podName:a3957494-6ce0-4487-89ff-b272483f09f8 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:39.485084798 +0000 UTC m=+41.214343637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-42pzm" (UID: "a3957494-6ce0-4487-89ff-b272483f09f8") : secret "networking-console-plugin-cert" not found
Jul 08 02:40:37.485256 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:37.485125    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls podName:32bc9f9f-fb76-487a-8c58-b4b2b64f2d92 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:39.485113002 +0000 UTC m=+41.214371843 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls") pod "image-registry-6996c657c7-dmlmj" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92") : secret "image-registry-tls" not found
Jul 08 02:40:37.586198 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:37.586155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:37.586407 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:37.586383    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 02:40:37.586516 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:37.586461    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls podName:b3704874-db93-4dc6-aeab-b6ad43bd74e6 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:39.586442326 +0000 UTC m=+41.315701164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls") pod "dns-default-xdd7v" (UID: "b3704874-db93-4dc6-aeab-b6ad43bd74e6") : secret "dns-default-metrics-tls" not found
Jul 08 02:40:39.503280 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:39.503244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:39.503623 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:39.503292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:40:39.503623 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:39.503402    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 02:40:39.503623 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:39.503406    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 02:40:39.503623 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:39.503422    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6996c657c7-dmlmj: secret "image-registry-tls" not found
Jul 08 02:40:39.503623 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:39.503478    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert podName:a3957494-6ce0-4487-89ff-b272483f09f8 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:43.503460747 +0000 UTC m=+45.232719583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-42pzm" (UID: "a3957494-6ce0-4487-89ff-b272483f09f8") : secret "networking-console-plugin-cert" not found
Jul 08 02:40:39.503623 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:39.503496    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls podName:32bc9f9f-fb76-487a-8c58-b4b2b64f2d92 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:43.503486446 +0000 UTC m=+45.232745281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls") pod "image-registry-6996c657c7-dmlmj" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92") : secret "image-registry-tls" not found
Jul 08 02:40:39.604338 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:39.604317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:39.604477 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:39.604460    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 02:40:39.604529 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:39.604520    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls podName:b3704874-db93-4dc6-aeab-b6ad43bd74e6 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:43.604506268 +0000 UTC m=+45.333765131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls") pod "dns-default-xdd7v" (UID: "b3704874-db93-4dc6-aeab-b6ad43bd74e6") : secret "dns-default-metrics-tls" not found
Jul 08 02:40:39.904023 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:39.903988    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bkf6s" event={"ID":"be2b357e-a17e-4689-843b-b519c8e5dc76","Type":"ContainerStarted","Data":"2c92ec1af2bfa3d0e412e85971ec2de7a5f04ec34125c71d13a383c2be93242b"}
Jul 08 02:40:39.919839 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:39.919765    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bkf6s" podStartSLOduration=1.639566577 podStartE2EDuration="4.919747509s" totalImagesPullingTime="3.280180932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:40:39.919175538 +0000 UTC m=+41.648434592" watchObservedRunningTime="2026-07-08 02:40:39.919747509 +0000 UTC m=+41.649006363"
Jul 08 02:40:43.536877 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:43.536831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:43.536877 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:43.536877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:40:43.537310 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:43.536970    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 02:40:43.537310 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:43.536978    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 02:40:43.537310 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:43.537001    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6996c657c7-dmlmj: secret "image-registry-tls" not found
Jul 08 02:40:43.537310 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:43.537045    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls podName:32bc9f9f-fb76-487a-8c58-b4b2b64f2d92 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:51.537031573 +0000 UTC m=+53.266290411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls") pod "image-registry-6996c657c7-dmlmj" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92") : secret "image-registry-tls" not found
Jul 08 02:40:43.537310 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:43.537063    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert podName:a3957494-6ce0-4487-89ff-b272483f09f8 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:51.537052781 +0000 UTC m=+53.266311618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-42pzm" (UID: "a3957494-6ce0-4487-89ff-b272483f09f8") : secret "networking-console-plugin-cert" not found
Jul 08 02:40:43.637710 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:43.637670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:43.637896 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:43.637854    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 02:40:43.637936 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:43.637925    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls podName:b3704874-db93-4dc6-aeab-b6ad43bd74e6 nodeName:}" failed. No retries permitted until 2026-07-08 02:40:51.637908787 +0000 UTC m=+53.367167623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls") pod "dns-default-xdd7v" (UID: "b3704874-db93-4dc6-aeab-b6ad43bd74e6") : secret "dns-default-metrics-tls" not found
Jul 08 02:40:51.600042 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:51.600007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:40:51.600579 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:51.600048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:40:51.600579 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:51.600165    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 02:40:51.600579 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:51.600170    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 02:40:51.600579 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:51.600189    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6996c657c7-dmlmj: secret "image-registry-tls" not found
Jul 08 02:40:51.600579 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:51.600222    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert podName:a3957494-6ce0-4487-89ff-b272483f09f8 nodeName:}" failed. No retries permitted until 2026-07-08 02:41:07.600208039 +0000 UTC m=+69.329466874 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-42pzm" (UID: "a3957494-6ce0-4487-89ff-b272483f09f8") : secret "networking-console-plugin-cert" not found
Jul 08 02:40:51.600579 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:51.600256    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls podName:32bc9f9f-fb76-487a-8c58-b4b2b64f2d92 nodeName:}" failed. No retries permitted until 2026-07-08 02:41:07.600242212 +0000 UTC m=+69.329501048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls") pod "image-registry-6996c657c7-dmlmj" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92") : secret "image-registry-tls" not found
Jul 08 02:40:51.701319 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:40:51.701278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:40:51.701482 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:51.701394    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 02:40:51.701482 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:40:51.701451    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls podName:b3704874-db93-4dc6-aeab-b6ad43bd74e6 nodeName:}" failed. No retries permitted until 2026-07-08 02:41:07.701439197 +0000 UTC m=+69.430698033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls") pod "dns-default-xdd7v" (UID: "b3704874-db93-4dc6-aeab-b6ad43bd74e6") : secret "dns-default-metrics-tls" not found
Jul 08 02:41:00.881504 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:00.881473    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wkfl"
Jul 08 02:41:04.497557 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.497521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:41:04.497557 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.497562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:41:04.497975 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.497601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl997\" (UniqueName: \"kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997\") pod \"network-check-target-6s6xl\" (UID: \"32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e\") " pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:41:04.500516 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.500499    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 02:41:04.500516 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.500514    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 02:41:04.500693 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.500673    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 02:41:04.508777 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:04.508753    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 02:41:04.508897 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:04.508825    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs podName:3d2357ec-2dcb-4bc2-98bc-2854aa031092 nodeName:}" failed. No retries permitted until 2026-07-08 02:42:08.508809022 +0000 UTC m=+130.238067870 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs") pod "network-metrics-daemon-bhrdk" (UID: "3d2357ec-2dcb-4bc2-98bc-2854aa031092") : secret "metrics-daemon-secret" not found
Jul 08 02:41:04.511022 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.511003    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 02:41:04.512404 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.512383    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a120d9d-d928-47cc-8200-7aad9d204593-original-pull-secret\") pod \"global-pull-secret-syncer-8mhpl\" (UID: \"0a120d9d-d928-47cc-8200-7aad9d204593\") " pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:41:04.521083 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.521064    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl997\" (UniqueName: \"kubernetes.io/projected/32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e-kube-api-access-fl997\") pod \"network-check-target-6s6xl\" (UID: \"32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e\") " pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:41:04.567778 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.567759    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mhpl"
Jul 08 02:41:04.585577 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.585556    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d2c2d\""
Jul 08 02:41:04.593566 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.593542    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:41:04.718550 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.718498    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8mhpl"]
Jul 08 02:41:04.722259 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:41:04.722235    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a120d9d_d928_47cc_8200_7aad9d204593.slice/crio-69ed574db2d760f71528acdd6ea7ec88d7dc9454b88481842a9c8dd3291bf79a WatchSource:0}: Error finding container 69ed574db2d760f71528acdd6ea7ec88d7dc9454b88481842a9c8dd3291bf79a: Status 404 returned error can't find the container with id 69ed574db2d760f71528acdd6ea7ec88d7dc9454b88481842a9c8dd3291bf79a
Jul 08 02:41:04.739253 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.739231    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6s6xl"]
Jul 08 02:41:04.744052 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:41:04.744030    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32cf5f6f_b0ed_460d_9ee1_cb40f73c6f7e.slice/crio-67c93ead16ec503442ab1ac3b5bcb87e0ce94d49e65bb4c7e9b168907acefd26 WatchSource:0}: Error finding container 67c93ead16ec503442ab1ac3b5bcb87e0ce94d49e65bb4c7e9b168907acefd26: Status 404 returned error can't find the container with id 67c93ead16ec503442ab1ac3b5bcb87e0ce94d49e65bb4c7e9b168907acefd26
Jul 08 02:41:04.961554 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.961514    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6s6xl" event={"ID":"32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e","Type":"ContainerStarted","Data":"67c93ead16ec503442ab1ac3b5bcb87e0ce94d49e65bb4c7e9b168907acefd26"}
Jul 08 02:41:04.962531 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:04.962500    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8mhpl" event={"ID":"0a120d9d-d928-47cc-8200-7aad9d204593","Type":"ContainerStarted","Data":"69ed574db2d760f71528acdd6ea7ec88d7dc9454b88481842a9c8dd3291bf79a"}
Jul 08 02:41:07.622646 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:07.622605    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:41:07.622646 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:07.622645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:41:07.623088 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:07.622747    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 02:41:07.623088 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:07.622810    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert podName:a3957494-6ce0-4487-89ff-b272483f09f8 nodeName:}" failed. No retries permitted until 2026-07-08 02:41:39.622783352 +0000 UTC m=+101.352042188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-42pzm" (UID: "a3957494-6ce0-4487-89ff-b272483f09f8") : secret "networking-console-plugin-cert" not found
Jul 08 02:41:07.623088 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:07.622908    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 02:41:07.623088 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:07.622924    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6996c657c7-dmlmj: secret "image-registry-tls" not found
Jul 08 02:41:07.623088 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:07.622983    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls podName:32bc9f9f-fb76-487a-8c58-b4b2b64f2d92 nodeName:}" failed. No retries permitted until 2026-07-08 02:41:39.622968126 +0000 UTC m=+101.352226981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls") pod "image-registry-6996c657c7-dmlmj" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92") : secret "image-registry-tls" not found
Jul 08 02:41:07.729839 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:07.724311    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:41:07.729839 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:07.726711    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 02:41:07.729839 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:07.726812    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls podName:b3704874-db93-4dc6-aeab-b6ad43bd74e6 nodeName:}" failed. No retries permitted until 2026-07-08 02:41:39.726774486 +0000 UTC m=+101.456033341 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls") pod "dns-default-xdd7v" (UID: "b3704874-db93-4dc6-aeab-b6ad43bd74e6") : secret "dns-default-metrics-tls" not found
Jul 08 02:41:08.976074 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:08.976040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6s6xl" event={"ID":"32cf5f6f-b0ed-460d-9ee1-cb40f73c6f7e","Type":"ContainerStarted","Data":"bdda33347775824818b91531087916b2840ca2118421795f019cb53bc721bf61"}
Jul 08 02:41:08.976527 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:08.976196    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:41:08.990603 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:08.990551    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6s6xl" podStartSLOduration=67.392103426 podStartE2EDuration="1m10.990532959s" totalImagesPullingTime="3.598429533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:41:08.990385938 +0000 UTC m=+70.719644811" watchObservedRunningTime="2026-07-08 02:41:08.990532959 +0000 UTC m=+70.719791818"
Jul 08 02:41:10.982089 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:10.982051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8mhpl" event={"ID":"0a120d9d-d928-47cc-8200-7aad9d204593","Type":"ContainerStarted","Data":"077be85cfdc95b5d5770f6780c31464cbf1d80e5c98cad84e3c3a08e6c073439"}
Jul 08 02:41:10.996180 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:10.996128    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8mhpl" podStartSLOduration=67.796156027 podStartE2EDuration="1m12.9961143s" totalImagesPullingTime="5.199958273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:41:10.995237282 +0000 UTC m=+72.724496140" watchObservedRunningTime="2026-07-08 02:41:10.9961143 +0000 UTC m=+72.725373158"
Jul 08 02:41:39.650837 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:39.650784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:41:39.651209 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:39.650848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:41:39.651209 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:39.650952    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 02:41:39.651209 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:39.650974    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6996c657c7-dmlmj: secret "image-registry-tls" not found
Jul 08 02:41:39.651209 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:39.650958    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 02:41:39.651209 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:39.651048    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls podName:32bc9f9f-fb76-487a-8c58-b4b2b64f2d92 nodeName:}" failed. No retries permitted until 2026-07-08 02:42:43.651025411 +0000 UTC m=+165.380284248 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls") pod "image-registry-6996c657c7-dmlmj" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92") : secret "image-registry-tls" not found
Jul 08 02:41:39.651209 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:39.651074    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert podName:a3957494-6ce0-4487-89ff-b272483f09f8 nodeName:}" failed. No retries permitted until 2026-07-08 02:42:43.651063998 +0000 UTC m=+165.380322836 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-42pzm" (UID: "a3957494-6ce0-4487-89ff-b272483f09f8") : secret "networking-console-plugin-cert" not found
Jul 08 02:41:39.751357 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:39.751320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:41:39.751512 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:39.751457    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 02:41:39.751512 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:41:39.751512    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls podName:b3704874-db93-4dc6-aeab-b6ad43bd74e6 nodeName:}" failed. No retries permitted until 2026-07-08 02:42:43.751498794 +0000 UTC m=+165.480757630 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls") pod "dns-default-xdd7v" (UID: "b3704874-db93-4dc6-aeab-b6ad43bd74e6") : secret "dns-default-metrics-tls" not found
Jul 08 02:41:39.980992 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:41:39.980914    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6s6xl"
Jul 08 02:42:08.545996 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:42:08.545958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:42:08.546414 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:08.546066    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 02:42:08.546414 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:08.546125    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs podName:3d2357ec-2dcb-4bc2-98bc-2854aa031092 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:10.546111587 +0000 UTC m=+252.275370422 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs") pod "network-metrics-daemon-bhrdk" (UID: "3d2357ec-2dcb-4bc2-98bc-2854aa031092") : secret "metrics-daemon-secret" not found
Jul 08 02:42:38.720716 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:38.720680    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm" podUID="a3957494-6ce0-4487-89ff-b272483f09f8"
Jul 08 02:42:38.739827 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:38.739782    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj" podUID="32bc9f9f-fb76-487a-8c58-b4b2b64f2d92"
Jul 08 02:42:38.772433 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:38.772408    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:42:38.840689 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:38.840669    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xdd7v" podUID="b3704874-db93-4dc6-aeab-b6ad43bd74e6"
Jul 08 02:42:39.184155 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:42:39.184130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:42:39.184296 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:42:39.184130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:42:43.673127 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:42:43.673089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:42:43.673127 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:42:43.673132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:42:43.673728 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:43.673234    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 08 02:42:43.673728 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:43.673233    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 02:42:43.673728 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:43.673255    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6996c657c7-dmlmj: secret "image-registry-tls" not found
Jul 08 02:42:43.673728 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:43.673306    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls podName:32bc9f9f-fb76-487a-8c58-b4b2b64f2d92 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:45.673285792 +0000 UTC m=+287.402544629 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls") pod "image-registry-6996c657c7-dmlmj" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92") : secret "image-registry-tls" not found
Jul 08 02:42:43.673728 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:43.673325    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert podName:a3957494-6ce0-4487-89ff-b272483f09f8 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:45.673315739 +0000 UTC m=+287.402574575 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-42pzm" (UID: "a3957494-6ce0-4487-89ff-b272483f09f8") : secret "networking-console-plugin-cert" not found
Jul 08 02:42:43.774470 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:42:43.774423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:42:43.774663 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:43.774579    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 02:42:43.774663 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:42:43.774649    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls podName:b3704874-db93-4dc6-aeab-b6ad43bd74e6 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:45.774631359 +0000 UTC m=+287.503890198 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls") pod "dns-default-xdd7v" (UID: "b3704874-db93-4dc6-aeab-b6ad43bd74e6") : secret "dns-default-metrics-tls" not found
Jul 08 02:42:49.719715 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:42:49.719623    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:42:52.719777 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:42:52.719739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:44:02.354282 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.354248    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j7pqc"]
Jul 08 02:44:02.355917 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.355902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j7pqc"
Jul 08 02:44:02.358001 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.357965    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 08 02:44:02.358126 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.358059    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6ss6v\""
Jul 08 02:44:02.358126 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.358111    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 08 02:44:02.360591 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.360569    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"]
Jul 08 02:44:02.362077 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.362053    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"]
Jul 08 02:44:02.362492 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.362202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"
Jul 08 02:44:02.364118 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.364098    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"
Jul 08 02:44:02.364666 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.364647    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 08 02:44:02.364666 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.364659    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 08 02:44:02.364826 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.364724    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2gc5f\""
Jul 08 02:44:02.364826 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.364817    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 08 02:44:02.364979 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.364945    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 08 02:44:02.369655 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.369638    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 08 02:44:02.369812 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.369639    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 08 02:44:02.370062 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.369660    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 08 02:44:02.370894 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.370749    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j7pqc"]
Jul 08 02:44:02.372424 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.371117    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w258p\""
Jul 08 02:44:02.372424 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.371830    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 08 02:44:02.379406 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.379385    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"]
Jul 08 02:44:02.382393 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.382374    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"]
Jul 08 02:44:02.437354 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.437326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrlv5\" (UniqueName: \"kubernetes.io/projected/3c7d85cc-d389-4e15-b7d9-7fdb4272671f-kube-api-access-wrlv5\") pod \"volume-data-source-validator-5d456fdbcd-j7pqc\" (UID: \"3c7d85cc-d389-4e15-b7d9-7fdb4272671f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j7pqc"
Jul 08 02:44:02.437354 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.437355    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84bac534-bd2b-4a06-b4f2-4e453b5e1be3-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-xxzhf\" (UID: \"84bac534-bd2b-4a06-b4f2-4e453b5e1be3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"
Jul 08 02:44:02.437539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.437374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/84bac534-bd2b-4a06-b4f2-4e453b5e1be3-config\") pod \"service-ca-operator-5d46d9ffd4-xxzhf\" (UID: \"84bac534-bd2b-4a06-b4f2-4e453b5e1be3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"
Jul 08 02:44:02.437539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.437407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebda22f1-b276-4316-a811-fffe735f5fd7-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kgp2r\" (UID: \"ebda22f1-b276-4316-a811-fffe735f5fd7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"
Jul 08 02:44:02.437539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.437430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wz6b\" (UniqueName: \"kubernetes.io/projected/ebda22f1-b276-4316-a811-fffe735f5fd7-kube-api-access-6wz6b\") pod \"kube-storage-version-migrator-operator-846bf668f7-kgp2r\" (UID: \"ebda22f1-b276-4316-a811-fffe735f5fd7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"
Jul 08 02:44:02.437539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.437466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrdph\" (UniqueName: \"kubernetes.io/projected/84bac534-bd2b-4a06-b4f2-4e453b5e1be3-kube-api-access-zrdph\") pod \"service-ca-operator-5d46d9ffd4-xxzhf\" (UID: \"84bac534-bd2b-4a06-b4f2-4e453b5e1be3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"
Jul 08 02:44:02.437539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.437502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebda22f1-b276-4316-a811-fffe735f5fd7-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kgp2r\" (UID: \"ebda22f1-b276-4316-a811-fffe735f5fd7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"
Jul 08 02:44:02.455954 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.455931    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-46djp"]
Jul 08 02:44:02.457627 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.457609    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-46djp"
Jul 08 02:44:02.459948 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.459931    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4nlz9\""
Jul 08 02:44:02.460107 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.460083    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"]
Jul 08 02:44:02.461625 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.461608    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:02.465122 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.465103    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 08 02:44:02.465218 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.465123    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 02:44:02.465218 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.465137    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 02:44:02.465218 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.465123    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qg6kd\""
Jul 08 02:44:02.465362 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.465217    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 08 02:44:02.473893 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.473873    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-46djp"]
Jul 08 02:44:02.476929 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.476912    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"]
Jul 08 02:44:02.538726 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.538694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlv5\" (UniqueName: \"kubernetes.io/projected/3c7d85cc-d389-4e15-b7d9-7fdb4272671f-kube-api-access-wrlv5\") pod \"volume-data-source-validator-5d456fdbcd-j7pqc\" (UID: \"3c7d85cc-d389-4e15-b7d9-7fdb4272671f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j7pqc"
Jul 08 02:44:02.538922 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.538760    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h82w\" (UniqueName: \"kubernetes.io/projected/5eb056ea-9fb4-4373-83ec-35dc0b86f4a7-kube-api-access-7h82w\") pod \"network-check-source-989f8b8dc-46djp\" (UID: \"5eb056ea-9fb4-4373-83ec-35dc0b86f4a7\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-46djp"
Jul 08 02:44:02.538922 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.538810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wz6b\" (UniqueName: \"kubernetes.io/projected/ebda22f1-b276-4316-a811-fffe735f5fd7-kube-api-access-6wz6b\") pod \"kube-storage-version-migrator-operator-846bf668f7-kgp2r\" (UID: \"ebda22f1-b276-4316-a811-fffe735f5fd7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"
Jul 08 02:44:02.538922 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.538839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84bac534-bd2b-4a06-b4f2-4e453b5e1be3-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-xxzhf\" (UID: \"84bac534-bd2b-4a06-b4f2-4e453b5e1be3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"
Jul 08 02:44:02.538922 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.538861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrdph\" (UniqueName: \"kubernetes.io/projected/84bac534-bd2b-4a06-b4f2-4e453b5e1be3-kube-api-access-zrdph\") pod \"service-ca-operator-5d46d9ffd4-xxzhf\" (UID: \"84bac534-bd2b-4a06-b4f2-4e453b5e1be3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"
Jul 08 02:44:02.538922 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.538891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:02.538922 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.538919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebda22f1-b276-4316-a811-fffe735f5fd7-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kgp2r\" (UID: \"ebda22f1-b276-4316-a811-fffe735f5fd7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"
Jul 08 02:44:02.539155 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.538943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s485x\" (UniqueName: \"kubernetes.io/projected/5216b4bf-66e1-45f5-94c2-dca791e67f14-kube-api-access-s485x\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:02.539155 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.539032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/84bac534-bd2b-4a06-b4f2-4e453b5e1be3-config\") pod \"service-ca-operator-5d46d9ffd4-xxzhf\" (UID: \"84bac534-bd2b-4a06-b4f2-4e453b5e1be3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"
Jul 08 02:44:02.539155 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.539083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebda22f1-b276-4316-a811-fffe735f5fd7-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kgp2r\" (UID: \"ebda22f1-b276-4316-a811-fffe735f5fd7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"
Jul 08 02:44:02.539155 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.539110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5216b4bf-66e1-45f5-94c2-dca791e67f14-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:02.539467 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.539447    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/84bac534-bd2b-4a06-b4f2-4e453b5e1be3-config\") pod \"service-ca-operator-5d46d9ffd4-xxzhf\" (UID: \"84bac534-bd2b-4a06-b4f2-4e453b5e1be3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"
Jul 08 02:44:02.539675 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.539566    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebda22f1-b276-4316-a811-fffe735f5fd7-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kgp2r\" (UID: \"ebda22f1-b276-4316-a811-fffe735f5fd7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"
Jul 08 02:44:02.541331 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.541307    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84bac534-bd2b-4a06-b4f2-4e453b5e1be3-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-xxzhf\" (UID: \"84bac534-bd2b-4a06-b4f2-4e453b5e1be3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"
Jul 08 02:44:02.541423 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.541316    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebda22f1-b276-4316-a811-fffe735f5fd7-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kgp2r\" (UID: \"ebda22f1-b276-4316-a811-fffe735f5fd7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"
Jul 08 02:44:02.546501 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.546479    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wz6b\" (UniqueName: \"kubernetes.io/projected/ebda22f1-b276-4316-a811-fffe735f5fd7-kube-api-access-6wz6b\") pod \"kube-storage-version-migrator-operator-846bf668f7-kgp2r\" (UID: \"ebda22f1-b276-4316-a811-fffe735f5fd7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"
Jul 08 02:44:02.546607 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.546562    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrdph\" (UniqueName: \"kubernetes.io/projected/84bac534-bd2b-4a06-b4f2-4e453b5e1be3-kube-api-access-zrdph\") pod \"service-ca-operator-5d46d9ffd4-xxzhf\" (UID: \"84bac534-bd2b-4a06-b4f2-4e453b5e1be3\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"
Jul 08 02:44:02.547873 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.547851    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrlv5\" (UniqueName: \"kubernetes.io/projected/3c7d85cc-d389-4e15-b7d9-7fdb4272671f-kube-api-access-wrlv5\") pod \"volume-data-source-validator-5d456fdbcd-j7pqc\" (UID: \"3c7d85cc-d389-4e15-b7d9-7fdb4272671f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j7pqc"
Jul 08 02:44:02.639829 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.639731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h82w\" (UniqueName: \"kubernetes.io/projected/5eb056ea-9fb4-4373-83ec-35dc0b86f4a7-kube-api-access-7h82w\") pod \"network-check-source-989f8b8dc-46djp\" (UID: \"5eb056ea-9fb4-4373-83ec-35dc0b86f4a7\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-46djp"
Jul 08 02:44:02.639829 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.639777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:02.640034 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:02.639888    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 02:44:02.640034 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:02.639948    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls podName:5216b4bf-66e1-45f5-94c2-dca791e67f14 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:03.139929967 +0000 UTC m=+244.869188804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6n6lw" (UID: "5216b4bf-66e1-45f5-94c2-dca791e67f14") : secret "cluster-monitoring-operator-tls" not found
Jul 08 02:44:02.640034 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.639965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s485x\" (UniqueName: \"kubernetes.io/projected/5216b4bf-66e1-45f5-94c2-dca791e67f14-kube-api-access-s485x\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:02.640192 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.640033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5216b4bf-66e1-45f5-94c2-dca791e67f14-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:02.640691 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.640668    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5216b4bf-66e1-45f5-94c2-dca791e67f14-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:02.648217 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.648188    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s485x\" (UniqueName: \"kubernetes.io/projected/5216b4bf-66e1-45f5-94c2-dca791e67f14-kube-api-access-s485x\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:02.648332 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.648295    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h82w\" (UniqueName: \"kubernetes.io/projected/5eb056ea-9fb4-4373-83ec-35dc0b86f4a7-kube-api-access-7h82w\") pod \"network-check-source-989f8b8dc-46djp\" (UID: \"5eb056ea-9fb4-4373-83ec-35dc0b86f4a7\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-46djp"
Jul 08 02:44:02.666047 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.666023    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j7pqc"
Jul 08 02:44:02.679461 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.679442    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"
Jul 08 02:44:02.684056 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.684033    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"
Jul 08 02:44:02.767349 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.767319    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-46djp"
Jul 08 02:44:02.807092 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.806501    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j7pqc"]
Jul 08 02:44:02.809815 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:02.809753    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7d85cc_d389_4e15_b7d9_7fdb4272671f.slice/crio-ccd3210eab283ac3f247fa4cae0200d9be707458b7771d880ad949995c644e93 WatchSource:0}: Error finding container ccd3210eab283ac3f247fa4cae0200d9be707458b7771d880ad949995c644e93: Status 404 returned error can't find the container with id ccd3210eab283ac3f247fa4cae0200d9be707458b7771d880ad949995c644e93
Jul 08 02:44:02.825522 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.825490    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf"]
Jul 08 02:44:02.829085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:02.829057    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84bac534_bd2b_4a06_b4f2_4e453b5e1be3.slice/crio-fd6a8be8bfcb6d61355015b164738c603d94b86af8e9b6f2aab88f4fd199e467 WatchSource:0}: Error finding container fd6a8be8bfcb6d61355015b164738c603d94b86af8e9b6f2aab88f4fd199e467: Status 404 returned error can't find the container with id fd6a8be8bfcb6d61355015b164738c603d94b86af8e9b6f2aab88f4fd199e467
Jul 08 02:44:02.841012 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.840989    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r"]
Jul 08 02:44:02.845823 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:02.845771    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebda22f1_b276_4316_a811_fffe735f5fd7.slice/crio-d4c3aca1fe8202aee854ace4a4b2926d9814802bcd09f91c5c1a8c46ba9e929d WatchSource:0}: Error finding container d4c3aca1fe8202aee854ace4a4b2926d9814802bcd09f91c5c1a8c46ba9e929d: Status 404 returned error can't find the container with id d4c3aca1fe8202aee854ace4a4b2926d9814802bcd09f91c5c1a8c46ba9e929d
Jul 08 02:44:02.906221 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:02.906150    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-46djp"]
Jul 08 02:44:02.908989 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:02.908963    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb056ea_9fb4_4373_83ec_35dc0b86f4a7.slice/crio-e8976dc8e9736e4caebab60ec6785a241fbfb5afe6d380bcc8420234a41c79d0 WatchSource:0}: Error finding container e8976dc8e9736e4caebab60ec6785a241fbfb5afe6d380bcc8420234a41c79d0: Status 404 returned error can't find the container with id e8976dc8e9736e4caebab60ec6785a241fbfb5afe6d380bcc8420234a41c79d0
Jul 08 02:44:03.144355 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:03.144315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:03.144530 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:03.144483    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 02:44:03.144580 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:03.144561    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls podName:5216b4bf-66e1-45f5-94c2-dca791e67f14 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:04.144537856 +0000 UTC m=+245.873796695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6n6lw" (UID: "5216b4bf-66e1-45f5-94c2-dca791e67f14") : secret "cluster-monitoring-operator-tls" not found
Jul 08 02:44:03.380285 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:03.380243    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r" event={"ID":"ebda22f1-b276-4316-a811-fffe735f5fd7","Type":"ContainerStarted","Data":"d4c3aca1fe8202aee854ace4a4b2926d9814802bcd09f91c5c1a8c46ba9e929d"}
Jul 08 02:44:03.381320 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:03.381295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j7pqc" event={"ID":"3c7d85cc-d389-4e15-b7d9-7fdb4272671f","Type":"ContainerStarted","Data":"ccd3210eab283ac3f247fa4cae0200d9be707458b7771d880ad949995c644e93"}
Jul 08 02:44:03.382718 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:03.382695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-46djp" event={"ID":"5eb056ea-9fb4-4373-83ec-35dc0b86f4a7","Type":"ContainerStarted","Data":"03b2bb371f0ce2295f0419eff8cd62f1160f0889cd8abc2ab7653009e2e323be"}
Jul 08 02:44:03.382818 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:03.382742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-46djp" event={"ID":"5eb056ea-9fb4-4373-83ec-35dc0b86f4a7","Type":"ContainerStarted","Data":"e8976dc8e9736e4caebab60ec6785a241fbfb5afe6d380bcc8420234a41c79d0"}
Jul 08 02:44:03.383759 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:03.383732    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf" event={"ID":"84bac534-bd2b-4a06-b4f2-4e453b5e1be3","Type":"ContainerStarted","Data":"fd6a8be8bfcb6d61355015b164738c603d94b86af8e9b6f2aab88f4fd199e467"}
Jul 08 02:44:03.397281 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:03.397229    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-46djp" podStartSLOduration=1.3972121849999999 podStartE2EDuration="1.397212185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:03.396641396 +0000 UTC m=+245.125900254" watchObservedRunningTime="2026-07-08 02:44:03.397212185 +0000 UTC m=+245.126471020"
Jul 08 02:44:04.153775 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:04.153738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:04.154565 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:04.154023    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 02:44:04.154565 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:04.154197    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls podName:5216b4bf-66e1-45f5-94c2-dca791e67f14 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:06.154175432 +0000 UTC m=+247.883434270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6n6lw" (UID: "5216b4bf-66e1-45f5-94c2-dca791e67f14") : secret "cluster-monitoring-operator-tls" not found
Jul 08 02:44:04.388864 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:04.388831    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j7pqc" event={"ID":"3c7d85cc-d389-4e15-b7d9-7fdb4272671f","Type":"ContainerStarted","Data":"ebfe47eed7c29813b04333e87625050be140ab56501d938c56e6adebcd564fdf"}
Jul 08 02:44:04.405144 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:04.405058    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-j7pqc" podStartSLOduration=0.896399229 podStartE2EDuration="2.405041664s" totalImagesPullingTime="1.508642435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:04.404815896 +0000 UTC m=+246.134074767" watchObservedRunningTime="2026-07-08 02:44:04.405041664 +0000 UTC m=+246.134300520"
Jul 08 02:44:06.169785 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.169756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:06.170098 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:06.169893    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 02:44:06.170098 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:06.169952    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls podName:5216b4bf-66e1-45f5-94c2-dca791e67f14 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:10.169936387 +0000 UTC m=+251.899195223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6n6lw" (UID: "5216b4bf-66e1-45f5-94c2-dca791e67f14") : secret "cluster-monitoring-operator-tls" not found
Jul 08 02:44:06.398654 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.398615    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf" event={"ID":"84bac534-bd2b-4a06-b4f2-4e453b5e1be3","Type":"ContainerStarted","Data":"cc7c36072ab509e2c1f809106b0ec49df38ea5fbcc87e6a58ca473c2071ffc7a"}
Jul 08 02:44:06.400000 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.399974    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r" event={"ID":"ebda22f1-b276-4316-a811-fffe735f5fd7","Type":"ContainerStarted","Data":"45ba337b80a5efdfad5c5ed296ef5721abed3f2ab261e3ff519e323e6211c3f3"}
Jul 08 02:44:06.413392 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.413349    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf" podStartSLOduration=1.9052635 podStartE2EDuration="4.413335557s" totalImagesPullingTime="2.508072057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:06.4124689 +0000 UTC m=+248.141727758" watchObservedRunningTime="2026-07-08 02:44:06.413335557 +0000 UTC m=+248.142594415"
Jul 08 02:44:06.428614 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.428519    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r" podStartSLOduration=1.108799046 podStartE2EDuration="4.428501565s" totalImagesPullingTime="3.319702519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:06.427764925 +0000 UTC m=+248.157023787" watchObservedRunningTime="2026-07-08 02:44:06.428501565 +0000 UTC m=+248.157760424"
Jul 08 02:44:06.979169 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.979134    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bjvpg"]
Jul 08 02:44:06.982424 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.982398    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:06.984787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.984763    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 02:44:06.985041 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.985024    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6xd4b\""
Jul 08 02:44:06.985587 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.985570    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 02:44:06.985667 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.985590    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 02:44:06.985667 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.985654    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 02:44:06.997913 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:06.997889    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bjvpg"]
Jul 08 02:44:07.076626 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.076574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.076789 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.076670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/63c89d51-08c2-4cc4-9991-f88d4a9c6835-crio-socket\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.076789 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.076717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.076789 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.076786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkscr\" (UniqueName: \"kubernetes.io/projected/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-api-access-vkscr\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.076948 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.076883    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/63c89d51-08c2-4cc4-9991-f88d4a9c6835-data-volume\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.178155 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.178116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.178595 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.178175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkscr\" (UniqueName: \"kubernetes.io/projected/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-api-access-vkscr\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.178595 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.178265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/63c89d51-08c2-4cc4-9991-f88d4a9c6835-data-volume\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.178595 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.178302    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.178595 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.178344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/63c89d51-08c2-4cc4-9991-f88d4a9c6835-crio-socket\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.178595 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:07.178432    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 02:44:07.178595 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.178430    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/63c89d51-08c2-4cc4-9991-f88d4a9c6835-crio-socket\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.178595 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:07.178511    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls podName:63c89d51-08c2-4cc4-9991-f88d4a9c6835 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:07.678496643 +0000 UTC m=+249.407755483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjvpg" (UID: "63c89d51-08c2-4cc4-9991-f88d4a9c6835") : secret "insights-runtime-extractor-tls" not found
Jul 08 02:44:07.178595 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:07.178432    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 02:44:07.178595 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:07.178577    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm podName:63c89d51-08c2-4cc4-9991-f88d4a9c6835 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:07.678565125 +0000 UTC m=+249.407823961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjvpg" (UID: "63c89d51-08c2-4cc4-9991-f88d4a9c6835") : configmap "kube-rbac-proxy" not found
Jul 08 02:44:07.178981 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.178682    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/63c89d51-08c2-4cc4-9991-f88d4a9c6835-data-volume\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.186492 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.186469    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkscr\" (UniqueName: \"kubernetes.io/projected/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-api-access-vkscr\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.306788 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.306752    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2rhn"]
Jul 08 02:44:07.309889 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.309866    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2rhn"
Jul 08 02:44:07.312404 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.312379    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 08 02:44:07.312740 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.312706    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sngfp\""
Jul 08 02:44:07.312908 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.312892    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 08 02:44:07.316448 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.316428    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2rhn"]
Jul 08 02:44:07.379891 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.379853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf5xf\" (UniqueName: \"kubernetes.io/projected/845016c5-20c2-4588-a668-d74ed9b8f215-kube-api-access-cf5xf\") pod \"migrator-d57d58cc9-j2rhn\" (UID: \"845016c5-20c2-4588-a668-d74ed9b8f215\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2rhn"
Jul 08 02:44:07.481176 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.481141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf5xf\" (UniqueName: \"kubernetes.io/projected/845016c5-20c2-4588-a668-d74ed9b8f215-kube-api-access-cf5xf\") pod \"migrator-d57d58cc9-j2rhn\" (UID: \"845016c5-20c2-4588-a668-d74ed9b8f215\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2rhn"
Jul 08 02:44:07.491423 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.491390    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf5xf\" (UniqueName: \"kubernetes.io/projected/845016c5-20c2-4588-a668-d74ed9b8f215-kube-api-access-cf5xf\") pod \"migrator-d57d58cc9-j2rhn\" (UID: \"845016c5-20c2-4588-a668-d74ed9b8f215\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2rhn"
Jul 08 02:44:07.619600 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.619499    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2rhn"
Jul 08 02:44:07.683394 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.682815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.683394 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.682877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:07.683394 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:07.683003    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 02:44:07.683394 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:07.683068    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm podName:63c89d51-08c2-4cc4-9991-f88d4a9c6835 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:08.683048765 +0000 UTC m=+250.412307607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjvpg" (UID: "63c89d51-08c2-4cc4-9991-f88d4a9c6835") : configmap "kube-rbac-proxy" not found
Jul 08 02:44:07.683394 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:07.683155    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 02:44:07.683394 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:07.683192    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls podName:63c89d51-08c2-4cc4-9991-f88d4a9c6835 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:08.683180462 +0000 UTC m=+250.412439301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjvpg" (UID: "63c89d51-08c2-4cc4-9991-f88d4a9c6835") : secret "insights-runtime-extractor-tls" not found
Jul 08 02:44:07.751191 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:07.751169    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2rhn"]
Jul 08 02:44:07.753615 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:07.753587    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845016c5_20c2_4588_a668_d74ed9b8f215.slice/crio-49b8055bc0381319820cd62267071e35b687c2a2c17ffff50b53b799d25a1f97 WatchSource:0}: Error finding container 49b8055bc0381319820cd62267071e35b687c2a2c17ffff50b53b799d25a1f97: Status 404 returned error can't find the container with id 49b8055bc0381319820cd62267071e35b687c2a2c17ffff50b53b799d25a1f97
Jul 08 02:44:08.407072 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:08.407040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2rhn" event={"ID":"845016c5-20c2-4588-a668-d74ed9b8f215","Type":"ContainerStarted","Data":"49b8055bc0381319820cd62267071e35b687c2a2c17ffff50b53b799d25a1f97"}
Jul 08 02:44:08.689268 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:08.689193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:08.689404 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:08.689270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:08.689404 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:08.689311    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 02:44:08.689404 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:08.689374    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm podName:63c89d51-08c2-4cc4-9991-f88d4a9c6835 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:10.689359698 +0000 UTC m=+252.418618534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjvpg" (UID: "63c89d51-08c2-4cc4-9991-f88d4a9c6835") : configmap "kube-rbac-proxy" not found
Jul 08 02:44:08.689404 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:08.689375    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 02:44:08.689537 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:08.689413    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls podName:63c89d51-08c2-4cc4-9991-f88d4a9c6835 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:10.689402677 +0000 UTC m=+252.418661512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjvpg" (UID: "63c89d51-08c2-4cc4-9991-f88d4a9c6835") : secret "insights-runtime-extractor-tls" not found
Jul 08 02:44:09.175485 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:09.175458    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zv4zt_1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1/dns-node-resolver/0.log"
Jul 08 02:44:09.411218 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:09.411184    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2rhn" event={"ID":"845016c5-20c2-4588-a668-d74ed9b8f215","Type":"ContainerStarted","Data":"85d049afdd14378f089865597dc2ce503a64ae009c23dea7703761241653a914"}
Jul 08 02:44:09.775479 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:09.775456    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n9r7r_9d5fe15c-c8aa-408f-8b62-b5e06bbb578b/node-ca/0.log"
Jul 08 02:44:10.201124 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:10.201030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:10.201274 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:10.201179    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 02:44:10.201274 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:10.201248    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls podName:5216b4bf-66e1-45f5-94c2-dca791e67f14 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:18.201231624 +0000 UTC m=+259.930490460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6n6lw" (UID: "5216b4bf-66e1-45f5-94c2-dca791e67f14") : secret "cluster-monitoring-operator-tls" not found
Jul 08 02:44:10.415887 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:10.415853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2rhn" event={"ID":"845016c5-20c2-4588-a668-d74ed9b8f215","Type":"ContainerStarted","Data":"04a6e9b3ebecb2d605f34639d5d66f174bd81ea7cd45a90e661729ff60f1c2b1"}
Jul 08 02:44:10.431720 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:10.431675    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j2rhn" podStartSLOduration=1.8684715710000002 podStartE2EDuration="3.43165988s" totalImagesPullingTime="1.563188309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:10.430515695 +0000 UTC m=+252.159774552" watchObservedRunningTime="2026-07-08 02:44:10.43165988 +0000 UTC m=+252.160918763"
Jul 08 02:44:10.604080 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:10.604031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:44:10.604293 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:10.604217    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 02:44:10.604370 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:10.604303    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs podName:3d2357ec-2dcb-4bc2-98bc-2854aa031092 nodeName:}" failed. No retries permitted until 2026-07-08 02:46:12.604282842 +0000 UTC m=+374.333541678 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs") pod "network-metrics-daemon-bhrdk" (UID: "3d2357ec-2dcb-4bc2-98bc-2854aa031092") : secret "metrics-daemon-secret" not found
Jul 08 02:44:10.704687 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:10.704629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:10.704889 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:10.704746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:10.704889 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:10.704768    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 02:44:10.704889 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:10.704855    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm podName:63c89d51-08c2-4cc4-9991-f88d4a9c6835 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:14.704840332 +0000 UTC m=+256.434099179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bjvpg" (UID: "63c89d51-08c2-4cc4-9991-f88d4a9c6835") : configmap "kube-rbac-proxy" not found
Jul 08 02:44:10.704889 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:10.704867    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 02:44:10.705221 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:10.704904    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls podName:63c89d51-08c2-4cc4-9991-f88d4a9c6835 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:14.70489386 +0000 UTC m=+256.434152697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjvpg" (UID: "63c89d51-08c2-4cc4-9991-f88d4a9c6835") : secret "insights-runtime-extractor-tls" not found
Jul 08 02:44:10.777183 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:10.777137    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bkf6s_be2b357e-a17e-4689-843b-b519c8e5dc76/serve-healthcheck-canary/0.log"
Jul 08 02:44:14.735957 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:14.735929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:14.736367 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:14.735984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:14.736367 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:14.736080    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 02:44:14.736367 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:14.736141    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls podName:63c89d51-08c2-4cc4-9991-f88d4a9c6835 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:22.736124779 +0000 UTC m=+264.465383617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bjvpg" (UID: "63c89d51-08c2-4cc4-9991-f88d4a9c6835") : secret "insights-runtime-extractor-tls" not found
Jul 08 02:44:14.736489 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:14.736429    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63c89d51-08c2-4cc4-9991-f88d4a9c6835-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:18.266403 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:18.266359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:18.266781 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:18.266514    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 02:44:18.266781 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:18.266576    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls podName:5216b4bf-66e1-45f5-94c2-dca791e67f14 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:34.266561703 +0000 UTC m=+275.995820539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6n6lw" (UID: "5216b4bf-66e1-45f5-94c2-dca791e67f14") : secret "cluster-monitoring-operator-tls" not found
Jul 08 02:44:22.802672 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:22.802558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:22.805104 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:22.805078    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63c89d51-08c2-4cc4-9991-f88d4a9c6835-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bjvpg\" (UID: \"63c89d51-08c2-4cc4-9991-f88d4a9c6835\") " pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:22.891408 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:22.891368    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bjvpg"
Jul 08 02:44:23.023769 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:23.023741    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bjvpg"]
Jul 08 02:44:23.026628 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:23.026597    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c89d51_08c2_4cc4_9991_f88d4a9c6835.slice/crio-2b8438d13d561643e4a931962875792dff1b0078d254448daa315e2522f5493d WatchSource:0}: Error finding container 2b8438d13d561643e4a931962875792dff1b0078d254448daa315e2522f5493d: Status 404 returned error can't find the container with id 2b8438d13d561643e4a931962875792dff1b0078d254448daa315e2522f5493d
Jul 08 02:44:23.454240 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:23.454208    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bjvpg" event={"ID":"63c89d51-08c2-4cc4-9991-f88d4a9c6835","Type":"ContainerStarted","Data":"2b8438d13d561643e4a931962875792dff1b0078d254448daa315e2522f5493d"}
Jul 08 02:44:27.469229 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:27.469185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bjvpg" event={"ID":"63c89d51-08c2-4cc4-9991-f88d4a9c6835","Type":"ContainerStarted","Data":"6bee72e94bb5a313bb21dd95b6d60eef784a691f2f688f328ae401687e47d3b4"}
Jul 08 02:44:28.474219 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:28.474186    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bjvpg" event={"ID":"63c89d51-08c2-4cc4-9991-f88d4a9c6835","Type":"ContainerStarted","Data":"f883840508f36379afb08158296af7c09106d23aaf65935e16931c4c64aac3ed"}
Jul 08 02:44:30.751904 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:30.751866    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-gkfc9"]
Jul 08 02:44:30.762314 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:30.762290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-gkfc9"
Jul 08 02:44:30.766834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:30.766663    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-n9pd4\""
Jul 08 02:44:30.766834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:30.766667    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 02:44:30.766834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:30.766670    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 02:44:30.772913 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:30.772819    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-gkfc9"]
Jul 08 02:44:30.873739 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:30.873703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6mnb\" (UniqueName: \"kubernetes.io/projected/2eda82f4-339e-41c4-8b6e-bfa45619d281-kube-api-access-b6mnb\") pod \"downloads-685bfb5f64-gkfc9\" (UID: \"2eda82f4-339e-41c4-8b6e-bfa45619d281\") " pod="openshift-console/downloads-685bfb5f64-gkfc9"
Jul 08 02:44:30.975058 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:30.975015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6mnb\" (UniqueName: \"kubernetes.io/projected/2eda82f4-339e-41c4-8b6e-bfa45619d281-kube-api-access-b6mnb\") pod \"downloads-685bfb5f64-gkfc9\" (UID: \"2eda82f4-339e-41c4-8b6e-bfa45619d281\") " pod="openshift-console/downloads-685bfb5f64-gkfc9"
Jul 08 02:44:30.986226 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:30.986196    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6mnb\" (UniqueName: \"kubernetes.io/projected/2eda82f4-339e-41c4-8b6e-bfa45619d281-kube-api-access-b6mnb\") pod \"downloads-685bfb5f64-gkfc9\" (UID: \"2eda82f4-339e-41c4-8b6e-bfa45619d281\") " pod="openshift-console/downloads-685bfb5f64-gkfc9"
Jul 08 02:44:31.074252 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:31.074219    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-gkfc9"
Jul 08 02:44:31.268497 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:31.268472    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-gkfc9"]
Jul 08 02:44:31.270953 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:31.270929    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eda82f4_339e_41c4_8b6e_bfa45619d281.slice/crio-28610fcbf23b30db1a2e590f4a5f47c757373fd2508646e50d378fe5c49acdfc WatchSource:0}: Error finding container 28610fcbf23b30db1a2e590f4a5f47c757373fd2508646e50d378fe5c49acdfc: Status 404 returned error can't find the container with id 28610fcbf23b30db1a2e590f4a5f47c757373fd2508646e50d378fe5c49acdfc
Jul 08 02:44:31.487775 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:31.487703    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-gkfc9" event={"ID":"2eda82f4-339e-41c4-8b6e-bfa45619d281","Type":"ContainerStarted","Data":"28610fcbf23b30db1a2e590f4a5f47c757373fd2508646e50d378fe5c49acdfc"}
Jul 08 02:44:31.489463 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:31.489438    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bjvpg" event={"ID":"63c89d51-08c2-4cc4-9991-f88d4a9c6835","Type":"ContainerStarted","Data":"6e9a6543231c257c25726dd4388e7726a34194bbed89173974ddf3b2328c1898"}
Jul 08 02:44:31.508083 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:31.508039    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bjvpg" podStartSLOduration=17.457085995 podStartE2EDuration="25.508022334s" totalImagesPullingTime="8.050936339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:44:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:31.507662487 +0000 UTC m=+273.236921345" watchObservedRunningTime="2026-07-08 02:44:31.508022334 +0000 UTC m=+273.237281378"
Jul 08 02:44:34.297505 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:34.297472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:34.300178 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:34.300153    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5216b4bf-66e1-45f5-94c2-dca791e67f14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6n6lw\" (UID: \"5216b4bf-66e1-45f5-94c2-dca791e67f14\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:34.572029 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:34.571957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"
Jul 08 02:44:34.704322 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:34.704294    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw"]
Jul 08 02:44:34.707554 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:34.707525    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5216b4bf_66e1_45f5_94c2_dca791e67f14.slice/crio-ace497c83fd52045dd276de436a9fbd6c569454ddac2f6d801ad218fc808a8f0 WatchSource:0}: Error finding container ace497c83fd52045dd276de436a9fbd6c569454ddac2f6d801ad218fc808a8f0: Status 404 returned error can't find the container with id ace497c83fd52045dd276de436a9fbd6c569454ddac2f6d801ad218fc808a8f0
Jul 08 02:44:35.502449 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:35.502418    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw" event={"ID":"5216b4bf-66e1-45f5-94c2-dca791e67f14","Type":"ContainerStarted","Data":"ace497c83fd52045dd276de436a9fbd6c569454ddac2f6d801ad218fc808a8f0"}
Jul 08 02:44:36.358317 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.358284    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-759f79f45d-cf489"]
Jul 08 02:44:36.362508 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.362490    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.365760 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.365736    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 02:44:36.365887 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.365774    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ws27b\""
Jul 08 02:44:36.365887 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.365861    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 02:44:36.365887 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.365882    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 02:44:36.366034 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.365883    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 02:44:36.366170 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.366139    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 02:44:36.370732 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.370623    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759f79f45d-cf489"]
Jul 08 02:44:36.518621 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.518596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84672eb0-9146-4124-beb4-6a28ac0764e2-console-serving-cert\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.518999 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.518631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-oauth-serving-cert\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.518999 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.518671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8fk8\" (UniqueName: \"kubernetes.io/projected/84672eb0-9146-4124-beb4-6a28ac0764e2-kube-api-access-d8fk8\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.518999 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.518702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-console-config\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.518999 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.518751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-service-ca\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.518999 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.518836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84672eb0-9146-4124-beb4-6a28ac0764e2-console-oauth-config\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.620731 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.620197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-service-ca\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.620731 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.620258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84672eb0-9146-4124-beb4-6a28ac0764e2-console-oauth-config\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.620731 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.620315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84672eb0-9146-4124-beb4-6a28ac0764e2-console-serving-cert\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.620731 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.620350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-oauth-serving-cert\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.620731 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.620397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8fk8\" (UniqueName: \"kubernetes.io/projected/84672eb0-9146-4124-beb4-6a28ac0764e2-kube-api-access-d8fk8\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.620731 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.620426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-console-config\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.621696 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.621456    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-service-ca\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.622098 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.622056    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-console-config\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.622261 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.622222    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-oauth-serving-cert\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.623966 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.623941    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84672eb0-9146-4124-beb4-6a28ac0764e2-console-serving-cert\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.624264 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.624213    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84672eb0-9146-4124-beb4-6a28ac0764e2-console-oauth-config\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.628986 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.628967    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8fk8\" (UniqueName: \"kubernetes.io/projected/84672eb0-9146-4124-beb4-6a28ac0764e2-kube-api-access-d8fk8\") pod \"console-759f79f45d-cf489\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") " pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.673952 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.673925    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:36.829832 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:36.829790    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759f79f45d-cf489"]
Jul 08 02:44:36.832683 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:36.832653    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84672eb0_9146_4124_beb4_6a28ac0764e2.slice/crio-c2b14965d6b325ccc86920628a106d2f19cdb70193973ce54def24e3a6a4440b WatchSource:0}: Error finding container c2b14965d6b325ccc86920628a106d2f19cdb70193973ce54def24e3a6a4440b: Status 404 returned error can't find the container with id c2b14965d6b325ccc86920628a106d2f19cdb70193973ce54def24e3a6a4440b
Jul 08 02:44:37.512206 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:37.512165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759f79f45d-cf489" event={"ID":"84672eb0-9146-4124-beb4-6a28ac0764e2","Type":"ContainerStarted","Data":"c2b14965d6b325ccc86920628a106d2f19cdb70193973ce54def24e3a6a4440b"}
Jul 08 02:44:38.519980 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:38.519943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw" event={"ID":"5216b4bf-66e1-45f5-94c2-dca791e67f14","Type":"ContainerStarted","Data":"d1474664fc607cdca50afad148322736da0b667c62e672bd0ff4f9fff2e69864"}
Jul 08 02:44:38.536055 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:38.536002    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6n6lw" podStartSLOduration=33.340101484 podStartE2EDuration="36.535983498s" totalImagesPullingTime="3.195882014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:38.53511301 +0000 UTC m=+280.264371870" watchObservedRunningTime="2026-07-08 02:44:38.535983498 +0000 UTC m=+280.265242357"
Jul 08 02:44:40.529203 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:40.529170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759f79f45d-cf489" event={"ID":"84672eb0-9146-4124-beb4-6a28ac0764e2","Type":"ContainerStarted","Data":"fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6"}
Jul 08 02:44:40.545269 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:40.545223    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-759f79f45d-cf489" podStartSLOduration=1.298898051 podStartE2EDuration="4.545208136s" totalImagesPullingTime="3.246310085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:40.543959122 +0000 UTC m=+282.273218000" watchObservedRunningTime="2026-07-08 02:44:40.545208136 +0000 UTC m=+282.274466994"
Jul 08 02:44:41.458550 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.458520    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"]
Jul 08 02:44:41.462069 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.462051    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.464359 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.464335    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 08 02:44:41.464444 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.464382    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 08 02:44:41.465359 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.465339    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bccxm\""
Jul 08 02:44:41.465471 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.465339    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 02:44:41.472330 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.472313    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"]
Jul 08 02:44:41.561612 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.561586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/354fca5c-1821-4abf-a750-9f8575a494b2-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-fb22b\" (UID: \"354fca5c-1821-4abf-a750-9f8575a494b2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.561948 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.561635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/354fca5c-1821-4abf-a750-9f8575a494b2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-fb22b\" (UID: \"354fca5c-1821-4abf-a750-9f8575a494b2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.561948 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.561680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jlk9\" (UniqueName: \"kubernetes.io/projected/354fca5c-1821-4abf-a750-9f8575a494b2-kube-api-access-2jlk9\") pod \"prometheus-operator-567f7b8b7c-fb22b\" (UID: \"354fca5c-1821-4abf-a750-9f8575a494b2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.561948 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.561701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/354fca5c-1821-4abf-a750-9f8575a494b2-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fb22b\" (UID: \"354fca5c-1821-4abf-a750-9f8575a494b2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.662810 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.662775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/354fca5c-1821-4abf-a750-9f8575a494b2-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-fb22b\" (UID: \"354fca5c-1821-4abf-a750-9f8575a494b2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.662985 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.662882    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/354fca5c-1821-4abf-a750-9f8575a494b2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-fb22b\" (UID: \"354fca5c-1821-4abf-a750-9f8575a494b2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.662985 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.662924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jlk9\" (UniqueName: \"kubernetes.io/projected/354fca5c-1821-4abf-a750-9f8575a494b2-kube-api-access-2jlk9\") pod \"prometheus-operator-567f7b8b7c-fb22b\" (UID: \"354fca5c-1821-4abf-a750-9f8575a494b2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.662985 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.662970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/354fca5c-1821-4abf-a750-9f8575a494b2-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fb22b\" (UID: \"354fca5c-1821-4abf-a750-9f8575a494b2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.664522 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.664490    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/354fca5c-1821-4abf-a750-9f8575a494b2-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-fb22b\" (UID: \"354fca5c-1821-4abf-a750-9f8575a494b2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.669425 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.669395    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/354fca5c-1821-4abf-a750-9f8575a494b2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-fb22b\" (UID: \"354fca5c-1821-4abf-a750-9f8575a494b2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.669541 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.669439    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/354fca5c-1821-4abf-a750-9f8575a494b2-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fb22b\" (UID: \"354fca5c-1821-4abf-a750-9f8575a494b2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.671280 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.671255    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jlk9\" (UniqueName: \"kubernetes.io/projected/354fca5c-1821-4abf-a750-9f8575a494b2-kube-api-access-2jlk9\") pod \"prometheus-operator-567f7b8b7c-fb22b\" (UID: \"354fca5c-1821-4abf-a750-9f8575a494b2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.773283 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.773250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"
Jul 08 02:44:41.897748 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:41.897717    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b"]
Jul 08 02:44:41.900666 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:41.900631    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354fca5c_1821_4abf_a750_9f8575a494b2.slice/crio-f5f4f12298f675e60eeed50b3e3ae2e7974b12aa3ee82b41b361c37adc802a80 WatchSource:0}: Error finding container f5f4f12298f675e60eeed50b3e3ae2e7974b12aa3ee82b41b361c37adc802a80: Status 404 returned error can't find the container with id f5f4f12298f675e60eeed50b3e3ae2e7974b12aa3ee82b41b361c37adc802a80
Jul 08 02:44:42.185517 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:42.185417    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm" podUID="a3957494-6ce0-4487-89ff-b272483f09f8"
Jul 08 02:44:42.185517 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:42.185460    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj" podUID="32bc9f9f-fb76-487a-8c58-b4b2b64f2d92"
Jul 08 02:44:42.538352 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:42.538054    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:44:42.538352 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:42.538064    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b" event={"ID":"354fca5c-1821-4abf-a750-9f8575a494b2","Type":"ContainerStarted","Data":"f5f4f12298f675e60eeed50b3e3ae2e7974b12aa3ee82b41b361c37adc802a80"}
Jul 08 02:44:42.538588 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:42.538378    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:44:43.544737 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:43.544697    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b" event={"ID":"354fca5c-1821-4abf-a750-9f8575a494b2","Type":"ContainerStarted","Data":"f9c7fc8ceb8d31293019ac8e5605945ec949693a1dd84ef67ec9ef998071634d"}
Jul 08 02:44:43.545189 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:43.544761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b" event={"ID":"354fca5c-1821-4abf-a750-9f8575a494b2","Type":"ContainerStarted","Data":"8b06bab3684dc0270a1f61f26c1c4051e82a0aaac3a16a6fe1f549fc22445061"}
Jul 08 02:44:43.560253 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:43.560201    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fb22b" podStartSLOduration=1.118227173 podStartE2EDuration="2.560180816s" totalImagesPullingTime="1.441953643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:43.560172574 +0000 UTC m=+285.289431433" watchObservedRunningTime="2026-07-08 02:44:43.560180816 +0000 UTC m=+285.289439673"
Jul 08 02:44:45.699659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.699624    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:44:45.699659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.699663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:44:45.702650 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.702622    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"image-registry-6996c657c7-dmlmj\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") " pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:44:45.702761 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.702628    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3957494-6ce0-4487-89ff-b272483f09f8-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-42pzm\" (UID: \"a3957494-6ce0-4487-89ff-b272483f09f8\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:44:45.800360 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.800326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:44:45.803250 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.803222    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3704874-db93-4dc6-aeab-b6ad43bd74e6-metrics-tls\") pod \"dns-default-xdd7v\" (UID: \"b3704874-db93-4dc6-aeab-b6ad43bd74e6\") " pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:44:45.823654 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.823620    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8d2rg\""
Jul 08 02:44:45.830869 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.830848    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:44:45.833074 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.833050    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"]
Jul 08 02:44:45.836722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.836698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:45.839665 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.839480    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 08 02:44:45.839835 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.839812    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 08 02:44:45.840097 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.840078    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cj8pl\""
Jul 08 02:44:45.840175 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.840146    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 08 02:44:45.841039 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.841018    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fgz9q\""
Jul 08 02:44:45.841433 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.841415    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6tthw\""
Jul 08 02:44:45.849024 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.849001    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"
Jul 08 02:44:45.849596 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.849503    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:44:45.850475 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.850450    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"]
Jul 08 02:44:45.852674 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.851700    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5pj9z"]
Jul 08 02:44:45.855550 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.855529    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:45.858525 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.858429    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 02:44:45.859193 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.858969    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 02:44:45.859193 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.859001    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f7vjp\""
Jul 08 02:44:45.859193 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.859017    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 02:44:45.999161 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:45.999075    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xdd7v"]
Jul 08 02:44:46.002212 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-metrics-client-ca\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.002380 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh2tl\" (UniqueName: \"kubernetes.io/projected/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-kube-api-access-zh2tl\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.002380 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-textfile\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.002380 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-sys\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.002380 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8592922a-0e91-4403-9c68-1c3b09140821-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.003834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-accelerators-collector-config\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.003834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8592922a-0e91-4403-9c68-1c3b09140821-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.003834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-tls\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.003834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.003834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8592922a-0e91-4403-9c68-1c3b09140821-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.003834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8592922a-0e91-4403-9c68-1c3b09140821-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.003834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8592922a-0e91-4403-9c68-1c3b09140821-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.003834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lqlm\" (UniqueName: \"kubernetes.io/projected/8592922a-0e91-4403-9c68-1c3b09140821-kube-api-access-8lqlm\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.003834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002605    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-root\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.003834 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.002634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-wtmp\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.004259 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:46.004137    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3704874_db93_4dc6_aeab_b6ad43bd74e6.slice/crio-ea384b7ea81a4b560be15eefc692d987e2fd2e565638f9b3c35008c738838231 WatchSource:0}: Error finding container ea384b7ea81a4b560be15eefc692d987e2fd2e565638f9b3c35008c738838231: Status 404 returned error can't find the container with id ea384b7ea81a4b560be15eefc692d987e2fd2e565638f9b3c35008c738838231
Jul 08 02:44:46.023375 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.023342    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-42pzm"]
Jul 08 02:44:46.026533 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:46.026508    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3957494_6ce0_4487_89ff_b272483f09f8.slice/crio-662fe55fc1af25c81d3892436d5e80431a71b0661271aea438cae89dd7570a40 WatchSource:0}: Error finding container 662fe55fc1af25c81d3892436d5e80431a71b0661271aea438cae89dd7570a40: Status 404 returned error can't find the container with id 662fe55fc1af25c81d3892436d5e80431a71b0661271aea438cae89dd7570a40
Jul 08 02:44:46.049629 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.047405    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6996c657c7-dmlmj"]
Jul 08 02:44:46.103034 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.103006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-metrics-client-ca\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.103138 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.103051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh2tl\" (UniqueName: \"kubernetes.io/projected/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-kube-api-access-zh2tl\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.103369 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.103352    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-textfile\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.103410 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.103388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-sys\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.103445 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.103417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8592922a-0e91-4403-9c68-1c3b09140821-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.103490 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.103475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-accelerators-collector-config\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.103530 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.103501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8592922a-0e91-4403-9c68-1c3b09140821-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.103573 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.103527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-tls\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.103621 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.103570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.103621 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.103588    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-metrics-client-ca\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.103621 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.103597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8592922a-0e91-4403-9c68-1c3b09140821-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.104054 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.104029    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-accelerators-collector-config\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.104100 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.104069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8592922a-0e91-4403-9c68-1c3b09140821-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.104100 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.104093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8592922a-0e91-4403-9c68-1c3b09140821-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.104199 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.104108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lqlm\" (UniqueName: \"kubernetes.io/projected/8592922a-0e91-4403-9c68-1c3b09140821-kube-api-access-8lqlm\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.104199 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.104130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-root\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.104199 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.104158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-wtmp\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.104321 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:46.104266    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 02:44:46.104321 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.104306    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8592922a-0e91-4403-9c68-1c3b09140821-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.104416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.104322    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-wtmp\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.104416 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:46.104328    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-tls podName:090865a2-15fb-4ccb-b0bb-fbe6f3442f43 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:46.604311991 +0000 UTC m=+288.333570830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-tls") pod "node-exporter-5pj9z" (UID: "090865a2-15fb-4ccb-b0bb-fbe6f3442f43") : secret "node-exporter-tls" not found
Jul 08 02:44:46.104532 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.104515    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-sys\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.104616 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.104595    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-textfile\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.104669 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.104656    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-root\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.104876 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.104854    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8592922a-0e91-4403-9c68-1c3b09140821-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.105146 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.105102    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8592922a-0e91-4403-9c68-1c3b09140821-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.107290 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.107267    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8592922a-0e91-4403-9c68-1c3b09140821-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.107438 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.107410    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8592922a-0e91-4403-9c68-1c3b09140821-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.107542 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.107453    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.111562 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.111541    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh2tl\" (UniqueName: \"kubernetes.io/projected/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-kube-api-access-zh2tl\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.113288 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.113265    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lqlm\" (UniqueName: \"kubernetes.io/projected/8592922a-0e91-4403-9c68-1c3b09140821-kube-api-access-8lqlm\") pod \"kube-state-metrics-7c9dbb8b7d-jr7fs\" (UID: \"8592922a-0e91-4403-9c68-1c3b09140821\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.164958 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.164932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"
Jul 08 02:44:46.311628 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.311595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs"]
Jul 08 02:44:46.314470 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:46.314448    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8592922a_0e91_4403_9c68_1c3b09140821.slice/crio-47004db3aaf70d89e86c5a53a9e1f3b4b056a6c24c0e0cd86bb3c1be3c3ba6b4 WatchSource:0}: Error finding container 47004db3aaf70d89e86c5a53a9e1f3b4b056a6c24c0e0cd86bb3c1be3c3ba6b4: Status 404 returned error can't find the container with id 47004db3aaf70d89e86c5a53a9e1f3b4b056a6c24c0e0cd86bb3c1be3c3ba6b4
Jul 08 02:44:46.559232 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.559186    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm" event={"ID":"a3957494-6ce0-4487-89ff-b272483f09f8","Type":"ContainerStarted","Data":"662fe55fc1af25c81d3892436d5e80431a71b0661271aea438cae89dd7570a40"}
Jul 08 02:44:46.561561 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.561044    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj" event={"ID":"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92","Type":"ContainerStarted","Data":"fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7"}
Jul 08 02:44:46.561561 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.561094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj" event={"ID":"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92","Type":"ContainerStarted","Data":"1503ca0563c421afeeb29c816f44f0909c4bc73fa7c733d68e5d3597697e98ad"}
Jul 08 02:44:46.561561 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.561160    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:44:46.562435 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.562405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xdd7v" event={"ID":"b3704874-db93-4dc6-aeab-b6ad43bd74e6","Type":"ContainerStarted","Data":"ea384b7ea81a4b560be15eefc692d987e2fd2e565638f9b3c35008c738838231"}
Jul 08 02:44:46.563895 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.563869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs" event={"ID":"8592922a-0e91-4403-9c68-1c3b09140821","Type":"ContainerStarted","Data":"47004db3aaf70d89e86c5a53a9e1f3b4b056a6c24c0e0cd86bb3c1be3c3ba6b4"}
Jul 08 02:44:46.582497 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.582445    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj" podStartSLOduration=288.582426303 podStartE2EDuration="4m48.582426303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:46.58108213 +0000 UTC m=+288.310341023" watchObservedRunningTime="2026-07-08 02:44:46.582426303 +0000 UTC m=+288.311685164"
Jul 08 02:44:46.608684 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.608652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-tls\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:46.608860 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:46.608839    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 02:44:46.608956 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:46.608934    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-tls podName:090865a2-15fb-4ccb-b0bb-fbe6f3442f43 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:47.608913684 +0000 UTC m=+289.338172532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-tls") pod "node-exporter-5pj9z" (UID: "090865a2-15fb-4ccb-b0bb-fbe6f3442f43") : secret "node-exporter-tls" not found
Jul 08 02:44:46.674067 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.674024    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:46.674193 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.674084    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:44:46.675743 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.675711    2580 patch_prober.go:28] interesting pod/console-759f79f45d-cf489 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body=
Jul 08 02:44:46.675876 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:46.675763    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-759f79f45d-cf489" podUID="84672eb0-9146-4124-beb4-6a28ac0764e2" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused"
Jul 08 02:44:47.619735 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.619691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-tls\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:47.622675 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.622639    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/090865a2-15fb-4ccb-b0bb-fbe6f3442f43-node-exporter-tls\") pod \"node-exporter-5pj9z\" (UID: \"090865a2-15fb-4ccb-b0bb-fbe6f3442f43\") " pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:47.675222 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.675180    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5pj9z"
Jul 08 02:44:47.797629 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.797599    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f58668bbc-d42zs"]
Jul 08 02:44:47.801625 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.801601    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:47.804048 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.804017    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 08 02:44:47.804147 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.804079    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kp4lx\""
Jul 08 02:44:47.804147 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.804120    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 08 02:44:47.804259 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.804161    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 08 02:44:47.804259 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.804249    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 08 02:44:47.804355 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.804316    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 08 02:44:47.804399 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.804381    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7iv45pl1skoo6\""
Jul 08 02:44:47.812868 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.812771    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f58668bbc-d42zs"]
Jul 08 02:44:47.922432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.922347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-tls\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:47.922432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.922416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:47.922637 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.922452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:47.922637 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.922510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l9kc\" (UniqueName: \"kubernetes.io/projected/366c44f6-fbd2-480c-9135-240198046c55-kube-api-access-4l9kc\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:47.922637 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.922541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:47.922637 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.922564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/366c44f6-fbd2-480c-9135-240198046c55-metrics-client-ca\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:47.922637 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.922596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-grpc-tls\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:47.922637 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:47.922624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.023699 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.023670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-grpc-tls\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.023867 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.023706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.023867 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.023848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-tls\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.023989 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.023916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.023989 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.023943    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.023989 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.023981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l9kc\" (UniqueName: \"kubernetes.io/projected/366c44f6-fbd2-480c-9135-240198046c55-kube-api-access-4l9kc\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.024143 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.024024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.024143 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.024049    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/366c44f6-fbd2-480c-9135-240198046c55-metrics-client-ca\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.024869 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.024822    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/366c44f6-fbd2-480c-9135-240198046c55-metrics-client-ca\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.026952 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.026921    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.027201 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.027170    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-tls\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.027313 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.027200    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.027658 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.027636    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.027976 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.027710    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-grpc-tls\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.028145 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.028120    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/366c44f6-fbd2-480c-9135-240198046c55-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.032209 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.032186    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l9kc\" (UniqueName: \"kubernetes.io/projected/366c44f6-fbd2-480c-9135-240198046c55-kube-api-access-4l9kc\") pod \"thanos-querier-7f58668bbc-d42zs\" (UID: \"366c44f6-fbd2-480c-9135-240198046c55\") " pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:48.114409 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:48.114378    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:44:50.149669 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.149633    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-696854596d-8bqln"]
Jul 08 02:44:50.153066 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.153048    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.155549 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.155511    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 08 02:44:50.155657 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.155606    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 08 02:44:50.156552 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.156415    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 08 02:44:50.156552 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.156437    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 02:44:50.156552 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.156415    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-swnlc\""
Jul 08 02:44:50.156552 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.156544    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-rpeg9e3h7s3s\""
Jul 08 02:44:50.166084 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.166063    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-696854596d-8bqln"]
Jul 08 02:44:50.341974 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.341936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fjxx\" (UniqueName: \"kubernetes.io/projected/db9d4c47-0567-4f76-a151-5126668662b3-kube-api-access-8fjxx\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.342162 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.342030    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db9d4c47-0567-4f76-a151-5126668662b3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.342162 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.342079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/db9d4c47-0567-4f76-a151-5126668662b3-metrics-server-audit-profiles\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.342162 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.342131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/db9d4c47-0567-4f76-a151-5126668662b3-secret-metrics-server-tls\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.342310 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.342177    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/db9d4c47-0567-4f76-a151-5126668662b3-secret-metrics-server-client-certs\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.342310 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.342224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/db9d4c47-0567-4f76-a151-5126668662b3-audit-log\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.342310 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.342256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db9d4c47-0567-4f76-a151-5126668662b3-client-ca-bundle\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.442847 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.442756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/db9d4c47-0567-4f76-a151-5126668662b3-audit-log\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.442847 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.442823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db9d4c47-0567-4f76-a151-5126668662b3-client-ca-bundle\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.443050 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.442865    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fjxx\" (UniqueName: \"kubernetes.io/projected/db9d4c47-0567-4f76-a151-5126668662b3-kube-api-access-8fjxx\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.443050 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.442910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db9d4c47-0567-4f76-a151-5126668662b3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.443050 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.442950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/db9d4c47-0567-4f76-a151-5126668662b3-metrics-server-audit-profiles\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.443050 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.442995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/db9d4c47-0567-4f76-a151-5126668662b3-secret-metrics-server-tls\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.443050 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.443038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/db9d4c47-0567-4f76-a151-5126668662b3-secret-metrics-server-client-certs\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.443283 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.443195    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/db9d4c47-0567-4f76-a151-5126668662b3-audit-log\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.443915 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.443870    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db9d4c47-0567-4f76-a151-5126668662b3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.444313 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.444291    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/db9d4c47-0567-4f76-a151-5126668662b3-metrics-server-audit-profiles\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.445725 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.445705    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db9d4c47-0567-4f76-a151-5126668662b3-client-ca-bundle\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.446312 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.446287    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/db9d4c47-0567-4f76-a151-5126668662b3-secret-metrics-server-client-certs\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.446405 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.446287    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/db9d4c47-0567-4f76-a151-5126668662b3-secret-metrics-server-tls\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.450916 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.450896    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fjxx\" (UniqueName: \"kubernetes.io/projected/db9d4c47-0567-4f76-a151-5126668662b3-kube-api-access-8fjxx\") pod \"metrics-server-696854596d-8bqln\" (UID: \"db9d4c47-0567-4f76-a151-5126668662b3\") " pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.464746 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.464722    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:44:50.624108 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.624072    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"]
Jul 08 02:44:50.628112 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.628085    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"
Jul 08 02:44:50.630568 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.630544    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759f79f45d-cf489"]
Jul 08 02:44:50.633189 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.633151    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vfcrc\""
Jul 08 02:44:50.633303 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.633284    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 08 02:44:50.637917 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.637894    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"]
Jul 08 02:44:50.746213 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.746119    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl2lq\" (UniqueName: \"kubernetes.io/projected/d29863d9-b0d2-4b5b-b974-38d866542673-kube-api-access-cl2lq\") pod \"monitoring-plugin-d5dcff7cf-q6k4d\" (UID: \"d29863d9-b0d2-4b5b-b974-38d866542673\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"
Jul 08 02:44:50.746381 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.746226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d29863d9-b0d2-4b5b-b974-38d866542673-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-q6k4d\" (UID: \"d29863d9-b0d2-4b5b-b974-38d866542673\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"
Jul 08 02:44:50.846847 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.846810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl2lq\" (UniqueName: \"kubernetes.io/projected/d29863d9-b0d2-4b5b-b974-38d866542673-kube-api-access-cl2lq\") pod \"monitoring-plugin-d5dcff7cf-q6k4d\" (UID: \"d29863d9-b0d2-4b5b-b974-38d866542673\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"
Jul 08 02:44:50.847009 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.846896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d29863d9-b0d2-4b5b-b974-38d866542673-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-q6k4d\" (UID: \"d29863d9-b0d2-4b5b-b974-38d866542673\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"
Jul 08 02:44:50.847075 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:50.847036    2580 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 08 02:44:50.847118 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:50.847108    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29863d9-b0d2-4b5b-b974-38d866542673-monitoring-plugin-cert podName:d29863d9-b0d2-4b5b-b974-38d866542673 nodeName:}" failed. No retries permitted until 2026-07-08 02:44:51.347089172 +0000 UTC m=+293.076348010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d29863d9-b0d2-4b5b-b974-38d866542673-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-q6k4d" (UID: "d29863d9-b0d2-4b5b-b974-38d866542673") : secret "monitoring-plugin-cert" not found
Jul 08 02:44:50.857457 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:50.857422    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl2lq\" (UniqueName: \"kubernetes.io/projected/d29863d9-b0d2-4b5b-b974-38d866542673-kube-api-access-cl2lq\") pod \"monitoring-plugin-d5dcff7cf-q6k4d\" (UID: \"d29863d9-b0d2-4b5b-b974-38d866542673\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"
Jul 08 02:44:51.351094 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:51.351063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d29863d9-b0d2-4b5b-b974-38d866542673-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-q6k4d\" (UID: \"d29863d9-b0d2-4b5b-b974-38d866542673\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"
Jul 08 02:44:51.353637 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:51.353613    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d29863d9-b0d2-4b5b-b974-38d866542673-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-q6k4d\" (UID: \"d29863d9-b0d2-4b5b-b974-38d866542673\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"
Jul 08 02:44:51.540637 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:51.540599    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"
Jul 08 02:44:52.004633 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.004371    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 02:44:52.009824 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.009778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.012730 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.012505    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 02:44:52.012730 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.012561    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-57vu4mgl5cbie\""
Jul 08 02:44:52.012923 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.012827    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8bqfk\""
Jul 08 02:44:52.013050 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.013034    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 02:44:52.013118 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.013034    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 02:44:52.013282 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.013259    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 02:44:52.013396 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.013291    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 02:44:52.013396 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.013342    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 02:44:52.013522 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.013489    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 02:44:52.013713 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.013697    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 02:44:52.014016 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.013933    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 02:44:52.014016 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.013944    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 02:44:52.014016 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.013979    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 02:44:52.014310 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.014138    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 02:44:52.014310 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.014284    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 02:44:52.015440 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.015417    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 02:44:52.025252 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.025162    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 02:44:52.159432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159395    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5147928-0a76-40bb-b562-43dfd6a5aefc-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.159635 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.159635 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.159635 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159508    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.159766 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.159766 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.159766 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.159902 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.159902 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-config\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.159902 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.159902 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.160055 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42x7v\" (UniqueName: \"kubernetes.io/projected/b5147928-0a76-40bb-b562-43dfd6a5aefc-kube-api-access-42x7v\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.160055 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.159938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.160142 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.160052    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.160142 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.160078    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.160142 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.160114    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5147928-0a76-40bb-b562-43dfd6a5aefc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.160142 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.160138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.160335 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.160204    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.160335 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.160239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.160335 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.160259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.260936 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.260895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261133 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.260954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261133 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.260976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261133 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261004    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261133 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261133 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261133 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261133 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261124    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-config\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42x7v\" (UniqueName: \"kubernetes.io/projected/b5147928-0a76-40bb-b562-43dfd6a5aefc-kube-api-access-42x7v\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5147928-0a76-40bb-b562-43dfd6a5aefc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.261432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5147928-0a76-40bb-b562-43dfd6a5aefc-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.263428 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.261974    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.263428 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.262621    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.263428 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.262619    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.263428 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.262693    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.263428 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.262973    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.263428 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.263136    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.263823 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.263625    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.265444 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.265414    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.265554 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.265464    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.269946 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.269661    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.269946 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.269711    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.269946 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.269836    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.269946 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.269904    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-config\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.270940 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.270916    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.271063 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.271045    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5147928-0a76-40bb-b562-43dfd6a5aefc-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.271326 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.271304    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5147928-0a76-40bb-b562-43dfd6a5aefc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.271711 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.271686    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.272243 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.272213    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5147928-0a76-40bb-b562-43dfd6a5aefc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.272416 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.272399    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42x7v\" (UniqueName: \"kubernetes.io/projected/b5147928-0a76-40bb-b562-43dfd6a5aefc-kube-api-access-42x7v\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.273020 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.272998    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5147928-0a76-40bb-b562-43dfd6a5aefc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5147928-0a76-40bb-b562-43dfd6a5aefc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:52.323088 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:52.322818    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:44:55.720893 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:44:55.720842    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bhrdk" podUID="3d2357ec-2dcb-4bc2-98bc-2854aa031092"
Jul 08 02:44:56.188140 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.185838    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f58668bbc-d42zs"]
Jul 08 02:44:56.191926 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:56.191841    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366c44f6_fbd2_480c_9135_240198046c55.slice/crio-c311d885cd4c1bf8f3f21b5aa8942e8557856231e4fb4fc944265dd87e0ae734 WatchSource:0}: Error finding container c311d885cd4c1bf8f3f21b5aa8942e8557856231e4fb4fc944265dd87e0ae734: Status 404 returned error can't find the container with id c311d885cd4c1bf8f3f21b5aa8942e8557856231e4fb4fc944265dd87e0ae734
Jul 08 02:44:56.200631 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.200568    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-696854596d-8bqln"]
Jul 08 02:44:56.217128 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:56.217098    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9d4c47_0567_4f76_a151_5126668662b3.slice/crio-b6c46908332451c4c63df6fa479f05f9e1ddf196ef4e0ab2cf8a2c1e115af6fe WatchSource:0}: Error finding container b6c46908332451c4c63df6fa479f05f9e1ddf196ef4e0ab2cf8a2c1e115af6fe: Status 404 returned error can't find the container with id b6c46908332451c4c63df6fa479f05f9e1ddf196ef4e0ab2cf8a2c1e115af6fe
Jul 08 02:44:56.227511 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.227454    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"]
Jul 08 02:44:56.238038 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:44:56.238013    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd29863d9_b0d2_4b5b_b974_38d866542673.slice/crio-c13b6dab2b1533bcc63abbb7aa2c15ffa678a731403885a2cf0197168f0faca0 WatchSource:0}: Error finding container c13b6dab2b1533bcc63abbb7aa2c15ffa678a731403885a2cf0197168f0faca0: Status 404 returned error can't find the container with id c13b6dab2b1533bcc63abbb7aa2c15ffa678a731403885a2cf0197168f0faca0
Jul 08 02:44:56.239944 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.239920    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 02:44:56.612088 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.611115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs" event={"ID":"8592922a-0e91-4403-9c68-1c3b09140821","Type":"ContainerStarted","Data":"0db11f67adfe9b0d6515d33783b475019d8174a4c5b955b8c317f4092bc5bd91"}
Jul 08 02:44:56.612088 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.611182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs" event={"ID":"8592922a-0e91-4403-9c68-1c3b09140821","Type":"ContainerStarted","Data":"ff5a8b18a2d4fcb2cf29fa4402bef49d63a9b07c0d6c3631d8d3df0b3f5c5aa6"}
Jul 08 02:44:56.612088 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.611211    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs" event={"ID":"8592922a-0e91-4403-9c68-1c3b09140821","Type":"ContainerStarted","Data":"827b7d8ea383a18fd01c421ccee6b023f11efe93f12d2ea7aeee6aecb62a89f9"}
Jul 08 02:44:56.614964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.614482    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm" event={"ID":"a3957494-6ce0-4487-89ff-b272483f09f8","Type":"ContainerStarted","Data":"60c6a279346aa83895f902a3cc516b2582338425e15283e7f4cc16d60ca80d96"}
Jul 08 02:44:56.617045 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.617004    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d" event={"ID":"d29863d9-b0d2-4b5b-b974-38d866542673","Type":"ContainerStarted","Data":"c13b6dab2b1533bcc63abbb7aa2c15ffa678a731403885a2cf0197168f0faca0"}
Jul 08 02:44:56.619567 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.619499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5pj9z" event={"ID":"090865a2-15fb-4ccb-b0bb-fbe6f3442f43","Type":"ContainerStarted","Data":"e93977985f361ce4b0263a18912a434c5dcb45f804f27de19a0947dd522dee31"}
Jul 08 02:44:56.621013 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.620983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5147928-0a76-40bb-b562-43dfd6a5aefc","Type":"ContainerStarted","Data":"bdc7b667f6f9939942135dc043d2cca44f6baa799b33a5d203e1df86c19a0c99"}
Jul 08 02:44:56.623161 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.623133    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-gkfc9" event={"ID":"2eda82f4-339e-41c4-8b6e-bfa45619d281","Type":"ContainerStarted","Data":"474831d9b388de5f06c9b04d81c16326d058de67956fba99f584fd58e5326cc0"}
Jul 08 02:44:56.623935 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.623916    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-gkfc9"
Jul 08 02:44:56.626776 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.626754    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xdd7v" event={"ID":"b3704874-db93-4dc6-aeab-b6ad43bd74e6","Type":"ContainerStarted","Data":"1f7a344608f3dfb0905e5971aa1b6a002381678ab1f3fd9fa1f6035ebb53fdd3"}
Jul 08 02:44:56.626887 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.626818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xdd7v" event={"ID":"b3704874-db93-4dc6-aeab-b6ad43bd74e6","Type":"ContainerStarted","Data":"f92cb25e0bc9cb0a8168dfa7c3534011f68a938e4815a80e1da75ff52c7cc60d"}
Jul 08 02:44:56.627145 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.627130    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:44:56.628936 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.628914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs" event={"ID":"366c44f6-fbd2-480c-9135-240198046c55","Type":"ContainerStarted","Data":"c311d885cd4c1bf8f3f21b5aa8942e8557856231e4fb4fc944265dd87e0ae734"}
Jul 08 02:44:56.630266 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.630250    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-gkfc9"
Jul 08 02:44:56.632353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.632303    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr7fs" podStartSLOduration=1.956500073 podStartE2EDuration="11.63228473s" totalImagesPullingTime="9.675784657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:56.631367428 +0000 UTC m=+298.360626310" watchObservedRunningTime="2026-07-08 02:44:56.63228473 +0000 UTC m=+298.361543589"
Jul 08 02:44:56.637096 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.637074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-696854596d-8bqln" event={"ID":"db9d4c47-0567-4f76-a151-5126668662b3","Type":"ContainerStarted","Data":"b6c46908332451c4c63df6fa479f05f9e1ddf196ef4e0ab2cf8a2c1e115af6fe"}
Jul 08 02:44:56.647821 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.647753    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xdd7v" podStartSLOduration=251.655719833 podStartE2EDuration="4m21.647737268s" totalImagesPullingTime="9.992017435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:56.646763627 +0000 UTC m=+298.376022490" watchObservedRunningTime="2026-07-08 02:44:56.647737268 +0000 UTC m=+298.376996127"
Jul 08 02:44:56.664420 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.664373    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-gkfc9" podStartSLOduration=1.717456666 podStartE2EDuration="26.6643544s" totalImagesPullingTime="24.946897734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:56.6631917 +0000 UTC m=+298.392450560" watchObservedRunningTime="2026-07-08 02:44:56.6643544 +0000 UTC m=+298.393613258"
Jul 08 02:44:56.682350 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:44:56.681522    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-42pzm" podStartSLOduration=275.728491826 podStartE2EDuration="4m45.681502619s" totalImagesPullingTime="9.953010793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:44:56.681069492 +0000 UTC m=+298.410328352" watchObservedRunningTime="2026-07-08 02:44:56.681502619 +0000 UTC m=+298.410761484"
Jul 08 02:45:01.137288 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.137266    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 02:45:01.139019 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.138996    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 02:45:01.141600 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.141577    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 02:45:01.589492 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.589464    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 02:45:01.672597 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.672549    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs" event={"ID":"366c44f6-fbd2-480c-9135-240198046c55","Type":"ContainerStarted","Data":"962845a4300c4f5fbcbeb71c7022153945dc4b9a31cf06b20bdb78bef80b8afe"}
Jul 08 02:45:01.672786 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.672682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs" event={"ID":"366c44f6-fbd2-480c-9135-240198046c55","Type":"ContainerStarted","Data":"96991f2fb9a375e663f75593faf1188179c14c0686a1e92c6416d2e613bb9f3a"}
Jul 08 02:45:01.672786 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.672724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs" event={"ID":"366c44f6-fbd2-480c-9135-240198046c55","Type":"ContainerStarted","Data":"de0aa292e90db9d5454da06a1ada116e0a014a2dfdc61beb811dad5eed14c3b6"}
Jul 08 02:45:01.674489 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.674457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-696854596d-8bqln" event={"ID":"db9d4c47-0567-4f76-a151-5126668662b3","Type":"ContainerStarted","Data":"dbac3d53d496aa6900917d48e23160094a6d02e0a55bea66a0d2f1ca417e60d3"}
Jul 08 02:45:01.679364 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.679338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d" event={"ID":"d29863d9-b0d2-4b5b-b974-38d866542673","Type":"ContainerStarted","Data":"e947002199b4a3b6eae860f60fd8948c3620ef750fc065251de059bdfbcfcc5c"}
Jul 08 02:45:01.680202 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.680174    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"
Jul 08 02:45:01.682762 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.682739    2580 generic.go:356] "Generic (PLEG): container finished" podID="090865a2-15fb-4ccb-b0bb-fbe6f3442f43" containerID="71b0b063779b6cdb0393c3c3a4bc7fcc85bf1b4852cb91e727469afc225ea9f4" exitCode=0
Jul 08 02:45:01.682977 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.682824    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5pj9z" event={"ID":"090865a2-15fb-4ccb-b0bb-fbe6f3442f43","Type":"ContainerDied","Data":"71b0b063779b6cdb0393c3c3a4bc7fcc85bf1b4852cb91e727469afc225ea9f4"}
Jul 08 02:45:01.685965 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.685947    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d"
Jul 08 02:45:01.686172 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.686153    2580 generic.go:356] "Generic (PLEG): container finished" podID="b5147928-0a76-40bb-b562-43dfd6a5aefc" containerID="c5e7f8cb5707a6b281f81900bdfd130280a012921e39c0a50f8ee94383681912" exitCode=0
Jul 08 02:45:01.686234 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.686191    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5147928-0a76-40bb-b562-43dfd6a5aefc","Type":"ContainerDied","Data":"c5e7f8cb5707a6b281f81900bdfd130280a012921e39c0a50f8ee94383681912"}
Jul 08 02:45:01.714882 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.714819    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-696854596d-8bqln" podStartSLOduration=6.839930716 podStartE2EDuration="11.714777304s" totalImagesPullingTime="4.874846588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:45:01.694710062 +0000 UTC m=+303.423968921" watchObservedRunningTime="2026-07-08 02:45:01.714777304 +0000 UTC m=+303.444036165"
Jul 08 02:45:01.759281 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:01.759231    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-q6k4d" podStartSLOduration=6.9043709060000005 podStartE2EDuration="11.759209954s" totalImagesPullingTime="4.854839048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:45:01.730531561 +0000 UTC m=+303.459790429" watchObservedRunningTime="2026-07-08 02:45:01.759209954 +0000 UTC m=+303.488468796"
Jul 08 02:45:02.696426 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:02.695704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5pj9z" event={"ID":"090865a2-15fb-4ccb-b0bb-fbe6f3442f43","Type":"ContainerStarted","Data":"20ea94fceabc51b96c0e0ef419de3fe8f9fa82f3f856d9c5a7935c2631248278"}
Jul 08 02:45:02.696426 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:02.695771    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5pj9z" event={"ID":"090865a2-15fb-4ccb-b0bb-fbe6f3442f43","Type":"ContainerStarted","Data":"46a9478df128d72a8f88039723272ab9578959988851021daa506c1068cec8be"}
Jul 08 02:45:02.717500 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:02.716941    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5pj9z" podStartSLOduration=12.518617898 podStartE2EDuration="17.716918589s" totalImagesPullingTime="5.085603454s" totalInitContainerRuntime="112.697237ms" isStatefulPod=true podCreationTimestamp="2026-07-08 02:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:45:02.714101485 +0000 UTC m=+304.443360345" watchObservedRunningTime="2026-07-08 02:45:02.716918589 +0000 UTC m=+304.446177448"
Jul 08 02:45:03.711931 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:03.711661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs" event={"ID":"366c44f6-fbd2-480c-9135-240198046c55","Type":"ContainerStarted","Data":"6e1a0382206f80c6d5889bbfd04300493dd17107715a680b09638114368f7c9b"}
Jul 08 02:45:03.711931 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:03.711768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs" event={"ID":"366c44f6-fbd2-480c-9135-240198046c55","Type":"ContainerStarted","Data":"2f83c42f1de335556f87620953d76159fc3788cc1c06716e1cfd8817ccb03ddb"}
Jul 08 02:45:04.726718 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:04.726678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs" event={"ID":"366c44f6-fbd2-480c-9135-240198046c55","Type":"ContainerStarted","Data":"8d98de4b15000da8aa31ac30a839bad4a910479727d4bba6cadde2a93e01363e"}
Jul 08 02:45:04.727273 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:04.726770    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:45:04.745982 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:04.745165    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs" podStartSLOduration=11.006573852 podStartE2EDuration="17.745144573s" totalImagesPullingTime="6.738570721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:45:04.742315662 +0000 UTC m=+306.471574520" watchObservedRunningTime="2026-07-08 02:45:04.745144573 +0000 UTC m=+306.474403432"
Jul 08 02:45:05.854478 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:05.854450    2580 patch_prober.go:28] interesting pod/image-registry-6996c657c7-dmlmj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 02:45:05.854778 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:05.854499    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj" podUID="32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 02:45:06.653897 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:06.653828    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xdd7v"
Jul 08 02:45:06.733110 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:06.733079    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5147928-0a76-40bb-b562-43dfd6a5aefc","Type":"ContainerStarted","Data":"84a600333a4f8c38d382bd21637aad1aabd993188632683161d0e6fb85b05e77"}
Jul 08 02:45:06.733283 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:06.733139    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5147928-0a76-40bb-b562-43dfd6a5aefc","Type":"ContainerStarted","Data":"340cff9ab2202f8899842e2391fc6e0c3bb1e3a36bf483f94a2b1c4d654f788d"}
Jul 08 02:45:06.733283 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:06.733170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5147928-0a76-40bb-b562-43dfd6a5aefc","Type":"ContainerStarted","Data":"9adde391ea8e60503243c68bad294e2cc9b33e8b1284ecdeaa2150c61ce78b71"}
Jul 08 02:45:06.733283 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:06.733195    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5147928-0a76-40bb-b562-43dfd6a5aefc","Type":"ContainerStarted","Data":"34371745c2b2666f47732dd3176e6c1cf102fee5a024a1fb7bac871275fbe241"}
Jul 08 02:45:06.733283 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:06.733219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5147928-0a76-40bb-b562-43dfd6a5aefc","Type":"ContainerStarted","Data":"a9d54e133de04b60623f8f020102d6792dcf8da8e41ac5f82331198c2538864a"}
Jul 08 02:45:06.733283 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:06.733246    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5147928-0a76-40bb-b562-43dfd6a5aefc","Type":"ContainerStarted","Data":"22e77aec683676abd93a49a12fdec7da3aeab420c60e15ecfe4b0e90ef061776"}
Jul 08 02:45:06.761935 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:06.761883    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.817304532 podStartE2EDuration="15.761862571s" totalImagesPullingTime="8.925681632s" totalInitContainerRuntime="18.876407ms" isStatefulPod=false podCreationTimestamp="2026-07-08 02:44:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:45:06.759001331 +0000 UTC m=+308.488260211" watchObservedRunningTime="2026-07-08 02:45:06.761862571 +0000 UTC m=+308.491121429"
Jul 08 02:45:07.323330 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:07.323299    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:45:07.574476 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:07.574397    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:45:09.719518 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:09.719487    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:45:10.465425 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:10.465387    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:45:10.465595 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:10.465445    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:45:10.730948 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:10.730871    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f58668bbc-d42zs"
Jul 08 02:45:15.661673 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:15.661606    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-759f79f45d-cf489" podUID="84672eb0-9146-4124-beb4-6a28ac0764e2" containerName="console" containerID="cri-o://fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6" gracePeriod=15
Jul 08 02:45:15.943907 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:15.943856    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:45:16.085239 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.085204    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84672eb0-9146-4124-beb4-6a28ac0764e2-console-oauth-config\") pod \"84672eb0-9146-4124-beb4-6a28ac0764e2\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") "
Jul 08 02:45:16.085388 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.085254    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-oauth-serving-cert\") pod \"84672eb0-9146-4124-beb4-6a28ac0764e2\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") "
Jul 08 02:45:16.085388 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.085283    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-console-config\") pod \"84672eb0-9146-4124-beb4-6a28ac0764e2\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") "
Jul 08 02:45:16.085388 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.085325    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8fk8\" (UniqueName: \"kubernetes.io/projected/84672eb0-9146-4124-beb4-6a28ac0764e2-kube-api-access-d8fk8\") pod \"84672eb0-9146-4124-beb4-6a28ac0764e2\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") "
Jul 08 02:45:16.085388 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.085371    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84672eb0-9146-4124-beb4-6a28ac0764e2-console-serving-cert\") pod \"84672eb0-9146-4124-beb4-6a28ac0764e2\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") "
Jul 08 02:45:16.085602 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.085411    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-service-ca\") pod \"84672eb0-9146-4124-beb4-6a28ac0764e2\" (UID: \"84672eb0-9146-4124-beb4-6a28ac0764e2\") "
Jul 08 02:45:16.086813 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.086507    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-service-ca" (OuterVolumeSpecName: "service-ca") pod "84672eb0-9146-4124-beb4-6a28ac0764e2" (UID: "84672eb0-9146-4124-beb4-6a28ac0764e2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:45:16.087344 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.087310    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "84672eb0-9146-4124-beb4-6a28ac0764e2" (UID: "84672eb0-9146-4124-beb4-6a28ac0764e2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:45:16.087483 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.087444    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-console-config" (OuterVolumeSpecName: "console-config") pod "84672eb0-9146-4124-beb4-6a28ac0764e2" (UID: "84672eb0-9146-4124-beb4-6a28ac0764e2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:45:16.089303 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.089280    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84672eb0-9146-4124-beb4-6a28ac0764e2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "84672eb0-9146-4124-beb4-6a28ac0764e2" (UID: "84672eb0-9146-4124-beb4-6a28ac0764e2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 02:45:16.089303 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.089284    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84672eb0-9146-4124-beb4-6a28ac0764e2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "84672eb0-9146-4124-beb4-6a28ac0764e2" (UID: "84672eb0-9146-4124-beb4-6a28ac0764e2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 02:45:16.089450 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.089317    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84672eb0-9146-4124-beb4-6a28ac0764e2-kube-api-access-d8fk8" (OuterVolumeSpecName: "kube-api-access-d8fk8") pod "84672eb0-9146-4124-beb4-6a28ac0764e2" (UID: "84672eb0-9146-4124-beb4-6a28ac0764e2"). InnerVolumeSpecName "kube-api-access-d8fk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:45:16.186642 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.186622    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84672eb0-9146-4124-beb4-6a28ac0764e2-console-oauth-config\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:16.186642 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.186640    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-oauth-serving-cert\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:16.186755 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.186649    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-console-config\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:16.186755 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.186658    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8fk8\" (UniqueName: \"kubernetes.io/projected/84672eb0-9146-4124-beb4-6a28ac0764e2-kube-api-access-d8fk8\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:16.186755 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.186665    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84672eb0-9146-4124-beb4-6a28ac0764e2-console-serving-cert\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:16.186755 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.186673    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84672eb0-9146-4124-beb4-6a28ac0764e2-service-ca\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:16.774360 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.774329    2580 generic.go:356] "Generic (PLEG): container finished" podID="84672eb0-9146-4124-beb4-6a28ac0764e2" containerID="fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6" exitCode=0
Jul 08 02:45:16.774717 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.774366    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759f79f45d-cf489"
Jul 08 02:45:16.774717 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.774362    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759f79f45d-cf489" event={"ID":"84672eb0-9146-4124-beb4-6a28ac0764e2","Type":"ContainerDied","Data":"fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6"}
Jul 08 02:45:16.774717 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.774428    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759f79f45d-cf489" event={"ID":"84672eb0-9146-4124-beb4-6a28ac0764e2","Type":"ContainerDied","Data":"c2b14965d6b325ccc86920628a106d2f19cdb70193973ce54def24e3a6a4440b"}
Jul 08 02:45:16.774717 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.774453    2580 scope.go:117] "RemoveContainer" containerID="fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6"
Jul 08 02:45:16.790339 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.790312    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759f79f45d-cf489"]
Jul 08 02:45:16.796919 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.796868    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-759f79f45d-cf489"]
Jul 08 02:45:16.797390 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.797364    2580 scope.go:117] "RemoveContainer" containerID="fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6"
Jul 08 02:45:16.800204 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:45:16.800176    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6\": container with ID starting with fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6 not found: ID does not exist" containerID="fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6"
Jul 08 02:45:16.800371 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:16.800330    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6"} err="failed to get container status \"fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6\": rpc error: code = NotFound desc = could not find container \"fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6\": container with ID starting with fa18bbb6f218194e685747a4aa410b4bfb034baf27b3d44f03572b1ca3edd8a6 not found: ID does not exist"
Jul 08 02:45:18.725300 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:18.725261    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84672eb0-9146-4124-beb4-6a28ac0764e2" path="/var/lib/kubelet/pods/84672eb0-9146-4124-beb4-6a28ac0764e2/volumes"
Jul 08 02:45:21.156041 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:21.156008    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6996c657c7-dmlmj"]
Jul 08 02:45:22.799530 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:22.799500    2580 generic.go:356] "Generic (PLEG): container finished" podID="ebda22f1-b276-4316-a811-fffe735f5fd7" containerID="45ba337b80a5efdfad5c5ed296ef5721abed3f2ab261e3ff519e323e6211c3f3" exitCode=0
Jul 08 02:45:22.799948 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:22.799562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r" event={"ID":"ebda22f1-b276-4316-a811-fffe735f5fd7","Type":"ContainerDied","Data":"45ba337b80a5efdfad5c5ed296ef5721abed3f2ab261e3ff519e323e6211c3f3"}
Jul 08 02:45:22.799948 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:22.799881    2580 scope.go:117] "RemoveContainer" containerID="45ba337b80a5efdfad5c5ed296ef5721abed3f2ab261e3ff519e323e6211c3f3"
Jul 08 02:45:23.806243 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:23.806203    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kgp2r" event={"ID":"ebda22f1-b276-4316-a811-fffe735f5fd7","Type":"ContainerStarted","Data":"c00e4084c704aa5afc38329be76946746d0aa5247d519fe9935fe14006654aeb"}
Jul 08 02:45:30.471112 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:30.471076    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:45:30.474972 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:30.474945    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-696854596d-8bqln"
Jul 08 02:45:31.840674 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:31.840647    2580 generic.go:356] "Generic (PLEG): container finished" podID="84bac534-bd2b-4a06-b4f2-4e453b5e1be3" containerID="cc7c36072ab509e2c1f809106b0ec49df38ea5fbcc87e6a58ca473c2071ffc7a" exitCode=0
Jul 08 02:45:31.841081 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:31.840724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf" event={"ID":"84bac534-bd2b-4a06-b4f2-4e453b5e1be3","Type":"ContainerDied","Data":"cc7c36072ab509e2c1f809106b0ec49df38ea5fbcc87e6a58ca473c2071ffc7a"}
Jul 08 02:45:31.841081 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:31.841035    2580 scope.go:117] "RemoveContainer" containerID="cc7c36072ab509e2c1f809106b0ec49df38ea5fbcc87e6a58ca473c2071ffc7a"
Jul 08 02:45:32.847275 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:32.847233    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-xxzhf" event={"ID":"84bac534-bd2b-4a06-b4f2-4e453b5e1be3","Type":"ContainerStarted","Data":"867258751e05e953922c0c958fd749ab2b5ddff3494d4c2cb7cf4ac8fcce83ec"}
Jul 08 02:45:46.183777 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.183739    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj" podUID="32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" containerName="registry" containerID="cri-o://fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7" gracePeriod=30
Jul 08 02:45:46.456444 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.456385    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:45:46.543042 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.543012    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-trusted-ca\") pod \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") "
Jul 08 02:45:46.543197 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.543138    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-certificates\") pod \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") "
Jul 08 02:45:46.543197 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.543171    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-ca-trust-extracted\") pod \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") "
Jul 08 02:45:46.543308 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.543230    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-installation-pull-secrets\") pod \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") "
Jul 08 02:45:46.543308 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.543284    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-image-registry-private-configuration\") pod \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") "
Jul 08 02:45:46.543412 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.543318    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8tw6\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-kube-api-access-b8tw6\") pod \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") "
Jul 08 02:45:46.543412 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.543347    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-bound-sa-token\") pod \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") "
Jul 08 02:45:46.543412 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.543375    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") pod \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\" (UID: \"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92\") "
Jul 08 02:45:46.543578 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.543554    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:45:46.543751 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.543653    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:45:46.546106 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.546078    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:45:46.546206 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.546139    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 02:45:46.546263 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.546202    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:45:46.546351 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.546328    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 02:45:46.546662 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.546640    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-kube-api-access-b8tw6" (OuterVolumeSpecName: "kube-api-access-b8tw6") pod "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92"). InnerVolumeSpecName "kube-api-access-b8tw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:45:46.552053 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.552027    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" (UID: "32bc9f9f-fb76-487a-8c58-b4b2b64f2d92"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:45:46.643970 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.643948    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-trusted-ca\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:46.643970 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.643968    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-certificates\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:46.644104 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.643978    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-ca-trust-extracted\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:46.644104 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.643987    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-installation-pull-secrets\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:46.644104 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.643996    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-image-registry-private-configuration\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:46.644104 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.644005    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8tw6\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-kube-api-access-b8tw6\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:46.644104 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.644013    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-bound-sa-token\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:46.644104 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.644021    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92-registry-tls\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:45:46.907914 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.907880    2580 generic.go:356] "Generic (PLEG): container finished" podID="32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" containerID="fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7" exitCode=0
Jul 08 02:45:46.908071 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.907928    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj"
Jul 08 02:45:46.908071 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.907971    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj" event={"ID":"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92","Type":"ContainerDied","Data":"fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7"}
Jul 08 02:45:46.908071 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.908025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6996c657c7-dmlmj" event={"ID":"32bc9f9f-fb76-487a-8c58-b4b2b64f2d92","Type":"ContainerDied","Data":"1503ca0563c421afeeb29c816f44f0909c4bc73fa7c733d68e5d3597697e98ad"}
Jul 08 02:45:46.908071 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.908048    2580 scope.go:117] "RemoveContainer" containerID="fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7"
Jul 08 02:45:46.916235 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.916217    2580 scope.go:117] "RemoveContainer" containerID="fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7"
Jul 08 02:45:46.916490 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:45:46.916474    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7\": container with ID starting with fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7 not found: ID does not exist" containerID="fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7"
Jul 08 02:45:46.916539 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.916498    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7"} err="failed to get container status \"fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7\": rpc error: code = NotFound desc = could not find container \"fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7\": container with ID starting with fe01be3b52a393a855b52e44eb73ab4ca195f41b31d1ac2661ff95960d8ff3f7 not found: ID does not exist"
Jul 08 02:45:46.923576 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.923502    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6996c657c7-dmlmj"]
Jul 08 02:45:46.927360 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:46.927341    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6996c657c7-dmlmj"]
Jul 08 02:45:48.723758 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:48.723726    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" path="/var/lib/kubelet/pods/32bc9f9f-fb76-487a-8c58-b4b2b64f2d92/volumes"
Jul 08 02:45:52.323067 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:52.323031    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:45:52.342880 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:52.342854    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:45:52.947690 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:45:52.947661    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 02:46:12.659618 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:46:12.659531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:46:12.661991 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:46:12.661973    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d2357ec-2dcb-4bc2-98bc-2854aa031092-metrics-certs\") pod \"network-metrics-daemon-bhrdk\" (UID: \"3d2357ec-2dcb-4bc2-98bc-2854aa031092\") " pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:46:12.722603 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:46:12.722581    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n5djs\""
Jul 08 02:46:12.730467 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:46:12.730449    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bhrdk"
Jul 08 02:46:12.859778 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:46:12.859756    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bhrdk"]
Jul 08 02:46:12.862233 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:46:12.862209    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2357ec_2dcb_4bc2_98bc_2854aa031092.slice/crio-bbbf60b94d5117ae6ac95bed31c4fd6ac0b2e24c3d31c70c4256d88d6f0b90bc WatchSource:0}: Error finding container bbbf60b94d5117ae6ac95bed31c4fd6ac0b2e24c3d31c70c4256d88d6f0b90bc: Status 404 returned error can't find the container with id bbbf60b94d5117ae6ac95bed31c4fd6ac0b2e24c3d31c70c4256d88d6f0b90bc
Jul 08 02:46:13.013930 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:46:13.013894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bhrdk" event={"ID":"3d2357ec-2dcb-4bc2-98bc-2854aa031092","Type":"ContainerStarted","Data":"bbbf60b94d5117ae6ac95bed31c4fd6ac0b2e24c3d31c70c4256d88d6f0b90bc"}
Jul 08 02:46:14.022490 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:46:14.022439    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bhrdk" event={"ID":"3d2357ec-2dcb-4bc2-98bc-2854aa031092","Type":"ContainerStarted","Data":"0c2380dd8ad151e6fdb0587316d5c471b9bf45e348da20a9b4e9072f28bec35e"}
Jul 08 02:46:15.027988 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:46:15.027953    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bhrdk" event={"ID":"3d2357ec-2dcb-4bc2-98bc-2854aa031092","Type":"ContainerStarted","Data":"f590a421de5a221d99d858f647e8de8448193bea6cb7a12edb9a4775517711ad"}
Jul 08 02:46:15.044791 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:46:15.044741    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bhrdk" podStartSLOduration=376.005960779 podStartE2EDuration="6m17.044724323s" totalImagesPullingTime="1.038763544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:46:15.043831992 +0000 UTC m=+376.773090850" watchObservedRunningTime="2026-07-08 02:46:15.044724323 +0000 UTC m=+376.773983182"
Jul 08 02:47:49.576339 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.576268    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ghtcs"]
Jul 08 02:47:49.576752 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.576599    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84672eb0-9146-4124-beb4-6a28ac0764e2" containerName="console"
Jul 08 02:47:49.576752 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.576611    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="84672eb0-9146-4124-beb4-6a28ac0764e2" containerName="console"
Jul 08 02:47:49.576752 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.576623    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" containerName="registry"
Jul 08 02:47:49.576752 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.576628    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" containerName="registry"
Jul 08 02:47:49.576752 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.576692    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="84672eb0-9146-4124-beb4-6a28ac0764e2" containerName="console"
Jul 08 02:47:49.576752 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.576701    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="32bc9f9f-fb76-487a-8c58-b4b2b64f2d92" containerName="registry"
Jul 08 02:47:49.579788 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.579771    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs"
Jul 08 02:47:49.582574 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.582555    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ss7jd\""
Jul 08 02:47:49.583481 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.583448    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 02:47:49.583570 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.583484    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 02:47:49.592335 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.592316    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ghtcs"]
Jul 08 02:47:49.627896 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.627877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/971e23c5-d15a-41ee-ad65-18b0f1f48910-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ghtcs\" (UID: \"971e23c5-d15a-41ee-ad65-18b0f1f48910\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs"
Jul 08 02:47:49.627978 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.627935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcjpf\" (UniqueName: \"kubernetes.io/projected/971e23c5-d15a-41ee-ad65-18b0f1f48910-kube-api-access-zcjpf\") pod \"cert-manager-webhook-6486ffd997-ghtcs\" (UID: \"971e23c5-d15a-41ee-ad65-18b0f1f48910\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs"
Jul 08 02:47:49.729050 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.729024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcjpf\" (UniqueName: \"kubernetes.io/projected/971e23c5-d15a-41ee-ad65-18b0f1f48910-kube-api-access-zcjpf\") pod \"cert-manager-webhook-6486ffd997-ghtcs\" (UID: \"971e23c5-d15a-41ee-ad65-18b0f1f48910\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs"
Jul 08 02:47:49.729189 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.729061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/971e23c5-d15a-41ee-ad65-18b0f1f48910-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ghtcs\" (UID: \"971e23c5-d15a-41ee-ad65-18b0f1f48910\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs"
Jul 08 02:47:49.738160 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.738137    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/971e23c5-d15a-41ee-ad65-18b0f1f48910-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ghtcs\" (UID: \"971e23c5-d15a-41ee-ad65-18b0f1f48910\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs"
Jul 08 02:47:49.739558 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.739533    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcjpf\" (UniqueName: \"kubernetes.io/projected/971e23c5-d15a-41ee-ad65-18b0f1f48910-kube-api-access-zcjpf\") pod \"cert-manager-webhook-6486ffd997-ghtcs\" (UID: \"971e23c5-d15a-41ee-ad65-18b0f1f48910\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs"
Jul 08 02:47:49.901127 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:49.901065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs"
Jul 08 02:47:50.032181 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:50.032157    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ghtcs"]
Jul 08 02:47:50.034208 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:47:50.034183    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod971e23c5_d15a_41ee_ad65_18b0f1f48910.slice/crio-1e826fa515f50ed47e1f59ab24481da460981ca286d10094a1f4babee25e1c9c WatchSource:0}: Error finding container 1e826fa515f50ed47e1f59ab24481da460981ca286d10094a1f4babee25e1c9c: Status 404 returned error can't find the container with id 1e826fa515f50ed47e1f59ab24481da460981ca286d10094a1f4babee25e1c9c
Jul 08 02:47:50.417811 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:50.417766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs" event={"ID":"971e23c5-d15a-41ee-ad65-18b0f1f48910","Type":"ContainerStarted","Data":"1e826fa515f50ed47e1f59ab24481da460981ca286d10094a1f4babee25e1c9c"}
Jul 08 02:47:53.435918 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:53.435833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs" event={"ID":"971e23c5-d15a-41ee-ad65-18b0f1f48910","Type":"ContainerStarted","Data":"99e774fc6f441cf820550b74c906ceef218a9388b0b6c826f3fd5704631944e5"}
Jul 08 02:47:53.436248 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:53.435947    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs"
Jul 08 02:47:53.458687 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:53.458645    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs" podStartSLOduration=1.397712831 podStartE2EDuration="4.458631296s" totalImagesPullingTime="3.060918465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:47:53.458193282 +0000 UTC m=+475.187452141" watchObservedRunningTime="2026-07-08 02:47:53.458631296 +0000 UTC m=+475.187890155"
Jul 08 02:47:59.443167 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:47:59.443137    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ghtcs"
Jul 08 02:48:12.163987 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.163959    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg"]
Jul 08 02:48:12.168324 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.168308    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg"
Jul 08 02:48:12.172319 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.171884    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 02:48:12.172319 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.172174    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 02:48:12.174238 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.173973    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qwscd\""
Jul 08 02:48:12.184737 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.184711    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg"]
Jul 08 02:48:12.310896 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.310869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfrs9\" (UniqueName: \"kubernetes.io/projected/eac7f9d8-a35d-49e1-b273-5623cc5f48c5-kube-api-access-jfrs9\") pod \"openshift-lws-operator-fd8ccff4c-d97dg\" (UID: \"eac7f9d8-a35d-49e1-b273-5623cc5f48c5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg"
Jul 08 02:48:12.311007 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.310935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eac7f9d8-a35d-49e1-b273-5623cc5f48c5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d97dg\" (UID: \"eac7f9d8-a35d-49e1-b273-5623cc5f48c5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg"
Jul 08 02:48:12.411753 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.411728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfrs9\" (UniqueName: \"kubernetes.io/projected/eac7f9d8-a35d-49e1-b273-5623cc5f48c5-kube-api-access-jfrs9\") pod \"openshift-lws-operator-fd8ccff4c-d97dg\" (UID: \"eac7f9d8-a35d-49e1-b273-5623cc5f48c5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg"
Jul 08 02:48:12.411870 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.411774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eac7f9d8-a35d-49e1-b273-5623cc5f48c5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d97dg\" (UID: \"eac7f9d8-a35d-49e1-b273-5623cc5f48c5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg"
Jul 08 02:48:12.412083 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.412068    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eac7f9d8-a35d-49e1-b273-5623cc5f48c5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d97dg\" (UID: \"eac7f9d8-a35d-49e1-b273-5623cc5f48c5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg"
Jul 08 02:48:12.421864 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.421791    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfrs9\" (UniqueName: \"kubernetes.io/projected/eac7f9d8-a35d-49e1-b273-5623cc5f48c5-kube-api-access-jfrs9\") pod \"openshift-lws-operator-fd8ccff4c-d97dg\" (UID: \"eac7f9d8-a35d-49e1-b273-5623cc5f48c5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg"
Jul 08 02:48:12.485768 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.485747    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg"
Jul 08 02:48:12.611840 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:12.611817    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg"]
Jul 08 02:48:12.614580 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:48:12.614555    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeac7f9d8_a35d_49e1_b273_5623cc5f48c5.slice/crio-5cec50ca6eda5d8e27b49020f1d336f12b6e7c61d3b3161fa3c96155afba6f43 WatchSource:0}: Error finding container 5cec50ca6eda5d8e27b49020f1d336f12b6e7c61d3b3161fa3c96155afba6f43: Status 404 returned error can't find the container with id 5cec50ca6eda5d8e27b49020f1d336f12b6e7c61d3b3161fa3c96155afba6f43
Jul 08 02:48:13.520696 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:13.520662    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg" event={"ID":"eac7f9d8-a35d-49e1-b273-5623cc5f48c5","Type":"ContainerStarted","Data":"5cec50ca6eda5d8e27b49020f1d336f12b6e7c61d3b3161fa3c96155afba6f43"}
Jul 08 02:48:16.537131 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:16.537092    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg" event={"ID":"eac7f9d8-a35d-49e1-b273-5623cc5f48c5","Type":"ContainerStarted","Data":"7da25001423846843093802fc6cb2717eb585010d3e673bda80323a8923aebe1"}
Jul 08 02:48:16.555200 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:16.555144    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d97dg" podStartSLOduration=1.441565555 podStartE2EDuration="4.555129426s" totalImagesPullingTime="3.113563871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:48:16.553643806 +0000 UTC m=+498.282902666" watchObservedRunningTime="2026-07-08 02:48:16.555129426 +0000 UTC m=+498.284388283"
Jul 08 02:48:35.227454 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.227419    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"]
Jul 08 02:48:35.230960 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.230938    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.233650 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.233627    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 02:48:35.233650 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.233642    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 02:48:35.233835 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.233652    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 02:48:35.233835 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.233670    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7n7w2\""
Jul 08 02:48:35.233835 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.233704    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 02:48:35.245736 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.245715    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"]
Jul 08 02:48:35.289297 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.289268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/508a2757-010f-4f93-b010-a18a04ea842f-manifests\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.289439 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.289308    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/508a2757-010f-4f93-b010-a18a04ea842f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.289439 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.289343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/508a2757-010f-4f93-b010-a18a04ea842f-tmp\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.289439 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.289424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7h9f\" (UniqueName: \"kubernetes.io/projected/508a2757-010f-4f93-b010-a18a04ea842f-kube-api-access-d7h9f\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.289545 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.289480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/508a2757-010f-4f93-b010-a18a04ea842f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.389952 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.389918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7h9f\" (UniqueName: \"kubernetes.io/projected/508a2757-010f-4f93-b010-a18a04ea842f-kube-api-access-d7h9f\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.390206 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.390188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/508a2757-010f-4f93-b010-a18a04ea842f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.390787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.390766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/508a2757-010f-4f93-b010-a18a04ea842f-manifests\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.390972 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.390956    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/508a2757-010f-4f93-b010-a18a04ea842f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.391079 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.391066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/508a2757-010f-4f93-b010-a18a04ea842f-tmp\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.392130 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.392111    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/508a2757-010f-4f93-b010-a18a04ea842f-manifests\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.394063 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.394021    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/508a2757-010f-4f93-b010-a18a04ea842f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.395099 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.395080    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/508a2757-010f-4f93-b010-a18a04ea842f-tmp\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.395276 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.395259    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/508a2757-010f-4f93-b010-a18a04ea842f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.407011 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.406992    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7h9f\" (UniqueName: \"kubernetes.io/projected/508a2757-010f-4f93-b010-a18a04ea842f-kube-api-access-d7h9f\") pod \"opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv\" (UID: \"508a2757-010f-4f93-b010-a18a04ea842f\") " pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.545998 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.545974    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:35.696572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:35.696543    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"]
Jul 08 02:48:35.699693 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:48:35.699673    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508a2757_010f_4f93_b010_a18a04ea842f.slice/crio-6c9a224932d39ab78a27f60e98f4e9e25dedaf06316426c5dd71fcc51cb61040 WatchSource:0}: Error finding container 6c9a224932d39ab78a27f60e98f4e9e25dedaf06316426c5dd71fcc51cb61040: Status 404 returned error can't find the container with id 6c9a224932d39ab78a27f60e98f4e9e25dedaf06316426c5dd71fcc51cb61040
Jul 08 02:48:36.627160 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:36.627122    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv" event={"ID":"508a2757-010f-4f93-b010-a18a04ea842f","Type":"ContainerStarted","Data":"6c9a224932d39ab78a27f60e98f4e9e25dedaf06316426c5dd71fcc51cb61040"}
Jul 08 02:48:39.643668 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:39.643632    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv" event={"ID":"508a2757-010f-4f93-b010-a18a04ea842f","Type":"ContainerStarted","Data":"6ef15af9c26333c35c2c8198d46086cc990273f53d374ff935a5cf3f9a2e4a66"}
Jul 08 02:48:40.649230 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:40.649189    2580 generic.go:356] "Generic (PLEG): container finished" podID="508a2757-010f-4f93-b010-a18a04ea842f" containerID="6ef15af9c26333c35c2c8198d46086cc990273f53d374ff935a5cf3f9a2e4a66" exitCode=0
Jul 08 02:48:40.649698 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:40.649275    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv" event={"ID":"508a2757-010f-4f93-b010-a18a04ea842f","Type":"ContainerDied","Data":"6ef15af9c26333c35c2c8198d46086cc990273f53d374ff935a5cf3f9a2e4a66"}
Jul 08 02:48:41.656069 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:41.656032    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv" event={"ID":"508a2757-010f-4f93-b010-a18a04ea842f","Type":"ContainerStarted","Data":"555c270ddff5779cf1ba63be2cf0566ad9528a81d956392d8fd6cb8ac496fd51"}
Jul 08 02:48:41.656464 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:41.656165    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:41.677772 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:41.677725    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv" podStartSLOduration=2.031313969 podStartE2EDuration="6.677709515s" totalImagesPullingTime="3.589392626s" totalInitContainerRuntime="1.05700292s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:48:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:48:41.676871433 +0000 UTC m=+523.406130291" watchObservedRunningTime="2026-07-08 02:48:41.677709515 +0000 UTC m=+523.406968378"
Jul 08 02:48:52.663642 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:52.663611    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv"
Jul 08 02:48:54.800598 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.800571    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"]
Jul 08 02:48:54.803851 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.803835    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"
Jul 08 02:48:54.807466 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.807445    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 02:48:54.808251 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.808225    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 02:48:54.808561 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.808539    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 02:48:54.810808 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.810509    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 02:48:54.822058 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.822038    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"]
Jul 08 02:48:54.856529 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.856507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/025a3e0f-b41a-4edf-a8f8-325ba09d1bd6-tls-certs\") pod \"kube-auth-proxy-dcfc578f7-rzm6r\" (UID: \"025a3e0f-b41a-4edf-a8f8-325ba09d1bd6\") " pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"
Jul 08 02:48:54.856643 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.856625    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/025a3e0f-b41a-4edf-a8f8-325ba09d1bd6-tmp\") pod \"kube-auth-proxy-dcfc578f7-rzm6r\" (UID: \"025a3e0f-b41a-4edf-a8f8-325ba09d1bd6\") " pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"
Jul 08 02:48:54.856701 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.856683    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p4wk\" (UniqueName: \"kubernetes.io/projected/025a3e0f-b41a-4edf-a8f8-325ba09d1bd6-kube-api-access-8p4wk\") pod \"kube-auth-proxy-dcfc578f7-rzm6r\" (UID: \"025a3e0f-b41a-4edf-a8f8-325ba09d1bd6\") " pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"
Jul 08 02:48:54.957934 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.957895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/025a3e0f-b41a-4edf-a8f8-325ba09d1bd6-tmp\") pod \"kube-auth-proxy-dcfc578f7-rzm6r\" (UID: \"025a3e0f-b41a-4edf-a8f8-325ba09d1bd6\") " pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"
Jul 08 02:48:54.957934 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.957934    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p4wk\" (UniqueName: \"kubernetes.io/projected/025a3e0f-b41a-4edf-a8f8-325ba09d1bd6-kube-api-access-8p4wk\") pod \"kube-auth-proxy-dcfc578f7-rzm6r\" (UID: \"025a3e0f-b41a-4edf-a8f8-325ba09d1bd6\") " pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"
Jul 08 02:48:54.958167 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.957961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/025a3e0f-b41a-4edf-a8f8-325ba09d1bd6-tls-certs\") pod \"kube-auth-proxy-dcfc578f7-rzm6r\" (UID: \"025a3e0f-b41a-4edf-a8f8-325ba09d1bd6\") " pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"
Jul 08 02:48:54.960327 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.960303    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/025a3e0f-b41a-4edf-a8f8-325ba09d1bd6-tmp\") pod \"kube-auth-proxy-dcfc578f7-rzm6r\" (UID: \"025a3e0f-b41a-4edf-a8f8-325ba09d1bd6\") " pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"
Jul 08 02:48:54.960529 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.960512    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/025a3e0f-b41a-4edf-a8f8-325ba09d1bd6-tls-certs\") pod \"kube-auth-proxy-dcfc578f7-rzm6r\" (UID: \"025a3e0f-b41a-4edf-a8f8-325ba09d1bd6\") " pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"
Jul 08 02:48:54.970839 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:54.970816    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p4wk\" (UniqueName: \"kubernetes.io/projected/025a3e0f-b41a-4edf-a8f8-325ba09d1bd6-kube-api-access-8p4wk\") pod \"kube-auth-proxy-dcfc578f7-rzm6r\" (UID: \"025a3e0f-b41a-4edf-a8f8-325ba09d1bd6\") " pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"
Jul 08 02:48:55.034002 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.033969    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-k6mzm"]
Jul 08 02:48:55.038017 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.037995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm"
Jul 08 02:48:55.041578 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.041556    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 08 02:48:55.041700 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.041613    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2jks8\""
Jul 08 02:48:55.048068 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.048048    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-k6mzm"]
Jul 08 02:48:55.113515 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.113434    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"
Jul 08 02:48:55.159979 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.159935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7493c91c-9317-467f-b410-5b78ceb71f3f-cert\") pod \"odh-model-controller-7998c67dc4-k6mzm\" (UID: \"7493c91c-9317-467f-b410-5b78ceb71f3f\") " pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm"
Jul 08 02:48:55.160159 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.159986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-589sn\" (UniqueName: \"kubernetes.io/projected/7493c91c-9317-467f-b410-5b78ceb71f3f-kube-api-access-589sn\") pod \"odh-model-controller-7998c67dc4-k6mzm\" (UID: \"7493c91c-9317-467f-b410-5b78ceb71f3f\") " pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm"
Jul 08 02:48:55.250079 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.250031    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r"]
Jul 08 02:48:55.252356 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:48:55.252329    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025a3e0f_b41a_4edf_a8f8_325ba09d1bd6.slice/crio-f06f121317e6127a7b1d43e7e53a6f2a177633cfbd92b3f791dba0c8e35020d5 WatchSource:0}: Error finding container f06f121317e6127a7b1d43e7e53a6f2a177633cfbd92b3f791dba0c8e35020d5: Status 404 returned error can't find the container with id f06f121317e6127a7b1d43e7e53a6f2a177633cfbd92b3f791dba0c8e35020d5
Jul 08 02:48:55.261363 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.261343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7493c91c-9317-467f-b410-5b78ceb71f3f-cert\") pod \"odh-model-controller-7998c67dc4-k6mzm\" (UID: \"7493c91c-9317-467f-b410-5b78ceb71f3f\") " pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm"
Jul 08 02:48:55.261449 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.261377    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-589sn\" (UniqueName: \"kubernetes.io/projected/7493c91c-9317-467f-b410-5b78ceb71f3f-kube-api-access-589sn\") pod \"odh-model-controller-7998c67dc4-k6mzm\" (UID: \"7493c91c-9317-467f-b410-5b78ceb71f3f\") " pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm"
Jul 08 02:48:55.261524 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:48:55.261505    2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 08 02:48:55.261589 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:48:55.261579    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7493c91c-9317-467f-b410-5b78ceb71f3f-cert podName:7493c91c-9317-467f-b410-5b78ceb71f3f nodeName:}" failed. No retries permitted until 2026-07-08 02:48:55.761558415 +0000 UTC m=+537.490817255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7493c91c-9317-467f-b410-5b78ceb71f3f-cert") pod "odh-model-controller-7998c67dc4-k6mzm" (UID: "7493c91c-9317-467f-b410-5b78ceb71f3f") : secret "odh-model-controller-webhook-cert" not found
Jul 08 02:48:55.270858 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.270836    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-589sn\" (UniqueName: \"kubernetes.io/projected/7493c91c-9317-467f-b410-5b78ceb71f3f-kube-api-access-589sn\") pod \"odh-model-controller-7998c67dc4-k6mzm\" (UID: \"7493c91c-9317-467f-b410-5b78ceb71f3f\") " pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm"
Jul 08 02:48:55.722661 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.722631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r" event={"ID":"025a3e0f-b41a-4edf-a8f8-325ba09d1bd6","Type":"ContainerStarted","Data":"f06f121317e6127a7b1d43e7e53a6f2a177633cfbd92b3f791dba0c8e35020d5"}
Jul 08 02:48:55.764261 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.764225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7493c91c-9317-467f-b410-5b78ceb71f3f-cert\") pod \"odh-model-controller-7998c67dc4-k6mzm\" (UID: \"7493c91c-9317-467f-b410-5b78ceb71f3f\") " pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm"
Jul 08 02:48:55.766919 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.766899    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7493c91c-9317-467f-b410-5b78ceb71f3f-cert\") pod \"odh-model-controller-7998c67dc4-k6mzm\" (UID: \"7493c91c-9317-467f-b410-5b78ceb71f3f\") " pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm"
Jul 08 02:48:55.949351 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:55.949318    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm"
Jul 08 02:48:56.043645 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.043613    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7f2jr"]
Jul 08 02:48:56.047958 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.047936    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr"
Jul 08 02:48:56.050484 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.050464    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 08 02:48:56.051265 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.051246    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-cpmlr\""
Jul 08 02:48:56.067138 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.067112    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7f2jr"]
Jul 08 02:48:56.123456 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.123428    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-k6mzm"]
Jul 08 02:48:56.125405 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:48:56.125375    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7493c91c_9317_467f_b410_5b78ceb71f3f.slice/crio-dc56d517560315cd35ba156577fe6855ba215e9bdc619551935f6ed4051e290c WatchSource:0}: Error finding container dc56d517560315cd35ba156577fe6855ba215e9bdc619551935f6ed4051e290c: Status 404 returned error can't find the container with id dc56d517560315cd35ba156577fe6855ba215e9bdc619551935f6ed4051e290c
Jul 08 02:48:56.167594 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.167563    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp4ng\" (UniqueName: \"kubernetes.io/projected/85118aa3-85be-4698-9658-9ec36dc21ead-kube-api-access-gp4ng\") pod \"model-serving-api-54d89bd5fc-7f2jr\" (UID: \"85118aa3-85be-4698-9658-9ec36dc21ead\") " pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr"
Jul 08 02:48:56.167773 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.167605    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85118aa3-85be-4698-9658-9ec36dc21ead-tls-certs\") pod \"model-serving-api-54d89bd5fc-7f2jr\" (UID: \"85118aa3-85be-4698-9658-9ec36dc21ead\") " pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr"
Jul 08 02:48:56.268938 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.268743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp4ng\" (UniqueName: \"kubernetes.io/projected/85118aa3-85be-4698-9658-9ec36dc21ead-kube-api-access-gp4ng\") pod \"model-serving-api-54d89bd5fc-7f2jr\" (UID: \"85118aa3-85be-4698-9658-9ec36dc21ead\") " pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr"
Jul 08 02:48:56.268938 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.268840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85118aa3-85be-4698-9658-9ec36dc21ead-tls-certs\") pod \"model-serving-api-54d89bd5fc-7f2jr\" (UID: \"85118aa3-85be-4698-9658-9ec36dc21ead\") " pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr"
Jul 08 02:48:56.272344 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.272314    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85118aa3-85be-4698-9658-9ec36dc21ead-tls-certs\") pod \"model-serving-api-54d89bd5fc-7f2jr\" (UID: \"85118aa3-85be-4698-9658-9ec36dc21ead\") " pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr"
Jul 08 02:48:56.300406 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.300350    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp4ng\" (UniqueName: \"kubernetes.io/projected/85118aa3-85be-4698-9658-9ec36dc21ead-kube-api-access-gp4ng\") pod \"model-serving-api-54d89bd5fc-7f2jr\" (UID: \"85118aa3-85be-4698-9658-9ec36dc21ead\") " pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr"
Jul 08 02:48:56.363396 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.363349    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr"
Jul 08 02:48:56.429439 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.429374    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"]
Jul 08 02:48:56.434680 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.434567    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.438154 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.437925    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 02:48:56.443485 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.438372    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 02:48:56.443485 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.438638    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 02:48:56.443485 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.438891    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-45thl\""
Jul 08 02:48:56.443485 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.439104    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 02:48:56.451407 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.450190    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"]
Jul 08 02:48:56.536841 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.536764    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7f2jr"]
Jul 08 02:48:56.538769 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:48:56.538743    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85118aa3_85be_4698_9658_9ec36dc21ead.slice/crio-bbcb1b6f63cc2e87980ef8c83f56661962e15ac1ec79ff9f7d88f605f1483617 WatchSource:0}: Error finding container bbcb1b6f63cc2e87980ef8c83f56661962e15ac1ec79ff9f7d88f605f1483617: Status 404 returned error can't find the container with id bbcb1b6f63cc2e87980ef8c83f56661962e15ac1ec79ff9f7d88f605f1483617
Jul 08 02:48:56.572807 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.572776    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.572912 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.572826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f95jg\" (UniqueName: \"kubernetes.io/projected/e59cd3e7-fdd2-46a1-9238-54226c3d868b-kube-api-access-f95jg\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.572912 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.572854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59cd3e7-fdd2-46a1-9238-54226c3d868b-local-certs\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.572912 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.572881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-cacerts\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.572912 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.572907    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.573070 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.572938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-token\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.573070 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.572974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.673977 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.673945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59cd3e7-fdd2-46a1-9238-54226c3d868b-local-certs\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.673977 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.673980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-cacerts\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.674215 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.674003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.674215 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.674033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-token\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.674215 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.674126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.674365 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.674227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.674365 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.674254    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f95jg\" (UniqueName: \"kubernetes.io/projected/e59cd3e7-fdd2-46a1-9238-54226c3d868b-kube-api-access-f95jg\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.674944 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.674852    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.677068 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.677047    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59cd3e7-fdd2-46a1-9238-54226c3d868b-local-certs\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.677246 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.677230    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.677346 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.677325    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.677382 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.677347    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-cacerts\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.682274 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.682239    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-token\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.682421 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.682402    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f95jg\" (UniqueName: \"kubernetes.io/projected/e59cd3e7-fdd2-46a1-9238-54226c3d868b-kube-api-access-f95jg\") pod \"istiod-openshift-gateway-7574459656-p9bvk\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.730225 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.730179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr" event={"ID":"85118aa3-85be-4698-9658-9ec36dc21ead","Type":"ContainerStarted","Data":"bbcb1b6f63cc2e87980ef8c83f56661962e15ac1ec79ff9f7d88f605f1483617"}
Jul 08 02:48:56.731839 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.731776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm" event={"ID":"7493c91c-9317-467f-b410-5b78ceb71f3f","Type":"ContainerStarted","Data":"dc56d517560315cd35ba156577fe6855ba215e9bdc619551935f6ed4051e290c"}
Jul 08 02:48:56.757403 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.757124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:48:56.942762 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:56.942682    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"]
Jul 08 02:48:56.948478 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:48:56.948439    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59cd3e7_fdd2_46a1_9238_54226c3d868b.slice/crio-ba2294446326ca97fc1758fe464d5ad70dfd83060bbe52dcfcf8ee4997b656a4 WatchSource:0}: Error finding container ba2294446326ca97fc1758fe464d5ad70dfd83060bbe52dcfcf8ee4997b656a4: Status 404 returned error can't find the container with id ba2294446326ca97fc1758fe464d5ad70dfd83060bbe52dcfcf8ee4997b656a4
Jul 08 02:48:57.739479 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:48:57.739443    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk" event={"ID":"e59cd3e7-fdd2-46a1-9238-54226c3d868b","Type":"ContainerStarted","Data":"ba2294446326ca97fc1758fe464d5ad70dfd83060bbe52dcfcf8ee4997b656a4"}
Jul 08 02:49:00.930531 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:00.930490    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 02:49:00.998267 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:00.998223    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 02:49:00.998388 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:00.998307    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 02:49:01.764303 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:01.764261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm" event={"ID":"7493c91c-9317-467f-b410-5b78ceb71f3f","Type":"ContainerStarted","Data":"7666de00f7bb61b067c321ae2184b1922d09440967e7305dbc288ab196901a18"}
Jul 08 02:49:01.764503 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:01.764422    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm"
Jul 08 02:49:01.766032 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:01.766005    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk" event={"ID":"e59cd3e7-fdd2-46a1-9238-54226c3d868b","Type":"ContainerStarted","Data":"3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d"}
Jul 08 02:49:01.766166 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:01.766058    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:49:01.767640 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:01.767612    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr" event={"ID":"85118aa3-85be-4698-9658-9ec36dc21ead","Type":"ContainerStarted","Data":"c58f8e298e60eecec023ebc89f218d5fee005af6a34f72bbb178def5136e84c1"}
Jul 08 02:49:01.767762 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:01.767729    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr"
Jul 08 02:49:01.769196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:01.769173    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r" event={"ID":"025a3e0f-b41a-4edf-a8f8-325ba09d1bd6","Type":"ContainerStarted","Data":"3a4824da83156eb041ee1319ac58533f799caa51c01876b0a6d12c8b0aca7973"}
Jul 08 02:49:01.786768 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:01.786729    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm" podStartSLOduration=1.971994398 podStartE2EDuration="6.786715267s" totalImagesPullingTime="4.814720869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:48:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:49:01.784080532 +0000 UTC m=+543.513339416" watchObservedRunningTime="2026-07-08 02:49:01.786715267 +0000 UTC m=+543.515974142"
Jul 08 02:49:01.817872 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:01.817788    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-dcfc578f7-rzm6r" podStartSLOduration=2.145462621 podStartE2EDuration="7.817770815s" totalImagesPullingTime="5.672308194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:48:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:49:01.81564568 +0000 UTC m=+543.544904539" watchObservedRunningTime="2026-07-08 02:49:01.817770815 +0000 UTC m=+543.547029678"
Jul 08 02:49:01.837093 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:01.837044    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr" podStartSLOduration=1.44712428 podStartE2EDuration="5.837026715s" totalImagesPullingTime="4.389902435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:49:01.835755711 +0000 UTC m=+543.565014571" watchObservedRunningTime="2026-07-08 02:49:01.837026715 +0000 UTC m=+543.566285572"
Jul 08 02:49:01.868338 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:01.868286    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk" podStartSLOduration=1.8230176340000002 podStartE2EDuration="5.868267031s" totalImagesPullingTime="4.045249397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:49:01.867687131 +0000 UTC m=+543.596945989" watchObservedRunningTime="2026-07-08 02:49:01.868267031 +0000 UTC m=+543.597525888"
Jul 08 02:49:02.775911 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:02.775886    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:49:05.710350 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.710313    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"]
Jul 08 02:49:05.713912 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.713892    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"
Jul 08 02:49:05.715996 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.715981    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 08 02:49:05.716673 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.716658    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tsk67\""
Jul 08 02:49:05.724497 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.724476    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"]
Jul 08 02:49:05.726589 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.726561    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"]
Jul 08 02:49:05.730081 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.730065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"
Jul 08 02:49:05.732630 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.732607    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 08 02:49:05.732719 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.732607    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kdmg8\""
Jul 08 02:49:05.741746 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.741726    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"]
Jul 08 02:49:05.863049 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.863000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6c01a05-8d71-495d-99d2-993b68bd1d37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mjt8z\" (UID: \"d6c01a05-8d71-495d-99d2-993b68bd1d37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"
Jul 08 02:49:05.863049 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.863053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vzkd\" (UniqueName: \"kubernetes.io/projected/d6c01a05-8d71-495d-99d2-993b68bd1d37-kube-api-access-9vzkd\") pod \"llmisvc-controller-manager-777c6bd7d5-mjt8z\" (UID: \"d6c01a05-8d71-495d-99d2-993b68bd1d37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"
Jul 08 02:49:05.863274 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.863154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2390c03b-1799-43df-9555-f68ce908a6ee-cert\") pod \"kserve-controller-manager-d6f4b65b8-pkgfr\" (UID: \"2390c03b-1799-43df-9555-f68ce908a6ee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"
Jul 08 02:49:05.863274 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.863182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnbqr\" (UniqueName: \"kubernetes.io/projected/2390c03b-1799-43df-9555-f68ce908a6ee-kube-api-access-mnbqr\") pod \"kserve-controller-manager-d6f4b65b8-pkgfr\" (UID: \"2390c03b-1799-43df-9555-f68ce908a6ee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"
Jul 08 02:49:05.963816 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.963688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2390c03b-1799-43df-9555-f68ce908a6ee-cert\") pod \"kserve-controller-manager-d6f4b65b8-pkgfr\" (UID: \"2390c03b-1799-43df-9555-f68ce908a6ee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"
Jul 08 02:49:05.963816 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.963765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnbqr\" (UniqueName: \"kubernetes.io/projected/2390c03b-1799-43df-9555-f68ce908a6ee-kube-api-access-mnbqr\") pod \"kserve-controller-manager-d6f4b65b8-pkgfr\" (UID: \"2390c03b-1799-43df-9555-f68ce908a6ee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"
Jul 08 02:49:05.964021 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.963875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6c01a05-8d71-495d-99d2-993b68bd1d37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mjt8z\" (UID: \"d6c01a05-8d71-495d-99d2-993b68bd1d37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"
Jul 08 02:49:05.964021 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.963902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vzkd\" (UniqueName: \"kubernetes.io/projected/d6c01a05-8d71-495d-99d2-993b68bd1d37-kube-api-access-9vzkd\") pod \"llmisvc-controller-manager-777c6bd7d5-mjt8z\" (UID: \"d6c01a05-8d71-495d-99d2-993b68bd1d37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"
Jul 08 02:49:05.964021 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:49:05.964010    2580 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 08 02:49:05.964143 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:49:05.964074    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c01a05-8d71-495d-99d2-993b68bd1d37-cert podName:d6c01a05-8d71-495d-99d2-993b68bd1d37 nodeName:}" failed. No retries permitted until 2026-07-08 02:49:06.46405479 +0000 UTC m=+548.193313642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d6c01a05-8d71-495d-99d2-993b68bd1d37-cert") pod "llmisvc-controller-manager-777c6bd7d5-mjt8z" (UID: "d6c01a05-8d71-495d-99d2-993b68bd1d37") : secret "llmisvc-webhook-server-cert" not found
Jul 08 02:49:05.966293 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.966269    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2390c03b-1799-43df-9555-f68ce908a6ee-cert\") pod \"kserve-controller-manager-d6f4b65b8-pkgfr\" (UID: \"2390c03b-1799-43df-9555-f68ce908a6ee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"
Jul 08 02:49:05.976758 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.976735    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vzkd\" (UniqueName: \"kubernetes.io/projected/d6c01a05-8d71-495d-99d2-993b68bd1d37-kube-api-access-9vzkd\") pod \"llmisvc-controller-manager-777c6bd7d5-mjt8z\" (UID: \"d6c01a05-8d71-495d-99d2-993b68bd1d37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"
Jul 08 02:49:05.984604 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:05.984579    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnbqr\" (UniqueName: \"kubernetes.io/projected/2390c03b-1799-43df-9555-f68ce908a6ee-kube-api-access-mnbqr\") pod \"kserve-controller-manager-d6f4b65b8-pkgfr\" (UID: \"2390c03b-1799-43df-9555-f68ce908a6ee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"
Jul 08 02:49:06.025358 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:06.025331    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"
Jul 08 02:49:06.168047 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:06.168014    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"]
Jul 08 02:49:06.170860 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:49:06.170833    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2390c03b_1799_43df_9555_f68ce908a6ee.slice/crio-5b39c255cfeee2c06453d9a36aca1e1f0073aeba971baeecc435664b79ac4eca WatchSource:0}: Error finding container 5b39c255cfeee2c06453d9a36aca1e1f0073aeba971baeecc435664b79ac4eca: Status 404 returned error can't find the container with id 5b39c255cfeee2c06453d9a36aca1e1f0073aeba971baeecc435664b79ac4eca
Jul 08 02:49:06.467560 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:06.467525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6c01a05-8d71-495d-99d2-993b68bd1d37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mjt8z\" (UID: \"d6c01a05-8d71-495d-99d2-993b68bd1d37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"
Jul 08 02:49:06.467729 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:49:06.467656    2580 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 08 02:49:06.467729 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:49:06.467716    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c01a05-8d71-495d-99d2-993b68bd1d37-cert podName:d6c01a05-8d71-495d-99d2-993b68bd1d37 nodeName:}" failed. No retries permitted until 2026-07-08 02:49:07.467702117 +0000 UTC m=+549.196960954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d6c01a05-8d71-495d-99d2-993b68bd1d37-cert") pod "llmisvc-controller-manager-777c6bd7d5-mjt8z" (UID: "d6c01a05-8d71-495d-99d2-993b68bd1d37") : secret "llmisvc-webhook-server-cert" not found
Jul 08 02:49:06.795396 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:06.795355    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr" event={"ID":"2390c03b-1799-43df-9555-f68ce908a6ee","Type":"ContainerStarted","Data":"5b39c255cfeee2c06453d9a36aca1e1f0073aeba971baeecc435664b79ac4eca"}
Jul 08 02:49:07.478285 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:07.478253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6c01a05-8d71-495d-99d2-993b68bd1d37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mjt8z\" (UID: \"d6c01a05-8d71-495d-99d2-993b68bd1d37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"
Jul 08 02:49:07.480707 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:07.480684    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6c01a05-8d71-495d-99d2-993b68bd1d37-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mjt8z\" (UID: \"d6c01a05-8d71-495d-99d2-993b68bd1d37\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"
Jul 08 02:49:07.542548 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:07.542481    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"
Jul 08 02:49:07.684331 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:07.684298    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"]
Jul 08 02:49:07.686451 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:49:07.686426    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd6c01a05_8d71_495d_99d2_993b68bd1d37.slice/crio-54a35f011477272f4451bc72e360035e87d31bdf6a0812d0f9fa404d902e38cb WatchSource:0}: Error finding container 54a35f011477272f4451bc72e360035e87d31bdf6a0812d0f9fa404d902e38cb: Status 404 returned error can't find the container with id 54a35f011477272f4451bc72e360035e87d31bdf6a0812d0f9fa404d902e38cb
Jul 08 02:49:07.801514 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:07.801482    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z" event={"ID":"d6c01a05-8d71-495d-99d2-993b68bd1d37","Type":"ContainerStarted","Data":"54a35f011477272f4451bc72e360035e87d31bdf6a0812d0f9fa404d902e38cb"}
Jul 08 02:49:08.310202 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.310172    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"]
Jul 08 02:49:08.310396 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.310354    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk" podUID="e59cd3e7-fdd2-46a1-9238-54226c3d868b" containerName="discovery" containerID="cri-o://3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d" gracePeriod=30
Jul 08 02:49:08.712458 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.712427    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:49:08.791311 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.791278    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f95jg\" (UniqueName: \"kubernetes.io/projected/e59cd3e7-fdd2-46a1-9238-54226c3d868b-kube-api-access-f95jg\") pod \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") "
Jul 08 02:49:08.791311 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.791317    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-cacerts\") pod \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") "
Jul 08 02:49:08.791538 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.791355    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-token\") pod \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") "
Jul 08 02:49:08.791538 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.791398    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-csr-ca-configmap\") pod \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") "
Jul 08 02:49:08.791538 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.791429    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-kubeconfig\") pod \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") "
Jul 08 02:49:08.791538 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.791468    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59cd3e7-fdd2-46a1-9238-54226c3d868b-local-certs\") pod \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") "
Jul 08 02:49:08.791538 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.791532    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-csr-dns-cert\") pod \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\" (UID: \"e59cd3e7-fdd2-46a1-9238-54226c3d868b\") "
Jul 08 02:49:08.791878 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.791844    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e59cd3e7-fdd2-46a1-9238-54226c3d868b" (UID: "e59cd3e7-fdd2-46a1-9238-54226c3d868b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:49:08.794038 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.794000    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-token" (OuterVolumeSpecName: "istio-token") pod "e59cd3e7-fdd2-46a1-9238-54226c3d868b" (UID: "e59cd3e7-fdd2-46a1-9238-54226c3d868b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:49:08.794388 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.794360    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-cacerts" (OuterVolumeSpecName: "cacerts") pod "e59cd3e7-fdd2-46a1-9238-54226c3d868b" (UID: "e59cd3e7-fdd2-46a1-9238-54226c3d868b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 02:49:08.794549 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.794517    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59cd3e7-fdd2-46a1-9238-54226c3d868b-kube-api-access-f95jg" (OuterVolumeSpecName: "kube-api-access-f95jg") pod "e59cd3e7-fdd2-46a1-9238-54226c3d868b" (UID: "e59cd3e7-fdd2-46a1-9238-54226c3d868b"). InnerVolumeSpecName "kube-api-access-f95jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:49:08.794549 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.794511    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59cd3e7-fdd2-46a1-9238-54226c3d868b-local-certs" (OuterVolumeSpecName: "local-certs") pod "e59cd3e7-fdd2-46a1-9238-54226c3d868b" (UID: "e59cd3e7-fdd2-46a1-9238-54226c3d868b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:49:08.794660 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.794597    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e59cd3e7-fdd2-46a1-9238-54226c3d868b" (UID: "e59cd3e7-fdd2-46a1-9238-54226c3d868b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 02:49:08.794812 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.794770    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e59cd3e7-fdd2-46a1-9238-54226c3d868b" (UID: "e59cd3e7-fdd2-46a1-9238-54226c3d868b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 02:49:08.808355 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.808323    2580 generic.go:356] "Generic (PLEG): container finished" podID="e59cd3e7-fdd2-46a1-9238-54226c3d868b" containerID="3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d" exitCode=0
Jul 08 02:49:08.808747 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.808395    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"
Jul 08 02:49:08.808747 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.808423    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk" event={"ID":"e59cd3e7-fdd2-46a1-9238-54226c3d868b","Type":"ContainerDied","Data":"3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d"}
Jul 08 02:49:08.808747 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.808529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk" event={"ID":"e59cd3e7-fdd2-46a1-9238-54226c3d868b","Type":"ContainerDied","Data":"ba2294446326ca97fc1758fe464d5ad70dfd83060bbe52dcfcf8ee4997b656a4"}
Jul 08 02:49:08.808747 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.808563    2580 scope.go:117] "RemoveContainer" containerID="3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d"
Jul 08 02:49:08.811113 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.811087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr" event={"ID":"2390c03b-1799-43df-9555-f68ce908a6ee","Type":"ContainerStarted","Data":"ce763c8cef64c63c359188936477cf2cee1f338ba2c855bcf2cdf6031f5910d9"}
Jul 08 02:49:08.811273 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.811222    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"
Jul 08 02:49:08.829257 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.829096    2580 scope.go:117] "RemoveContainer" containerID="3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d"
Jul 08 02:49:08.829719 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:49:08.829694    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d\": container with ID starting with 3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d not found: ID does not exist" containerID="3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d"
Jul 08 02:49:08.829817 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.829727    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d"} err="failed to get container status \"3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d\": rpc error: code = NotFound desc = could not find container \"3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d\": container with ID starting with 3665ff9399af6455b7f42bea434b5f119b26f4d7ab3938ad14eab8abca23ca7d not found: ID does not exist"
Jul 08 02:49:08.830035 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.829999    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr" podStartSLOduration=1.394156436 podStartE2EDuration="3.829985579s" totalImagesPullingTime="2.435829143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:49:08.828987781 +0000 UTC m=+550.558246690" watchObservedRunningTime="2026-07-08 02:49:08.829985579 +0000 UTC m=+550.559244435"
Jul 08 02:49:08.844973 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.844942    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"]
Jul 08 02:49:08.850005 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.849976    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-p9bvk"]
Jul 08 02:49:08.892393 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.892349    2580 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59cd3e7-fdd2-46a1-9238-54226c3d868b-local-certs\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:49:08.892393 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.892383    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-csr-dns-cert\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:49:08.892393 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.892398    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f95jg\" (UniqueName: \"kubernetes.io/projected/e59cd3e7-fdd2-46a1-9238-54226c3d868b-kube-api-access-f95jg\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:49:08.892692 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.892413    2580 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-cacerts\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:49:08.892692 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.892426    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-token\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:49:08.892692 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.892440    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-csr-ca-configmap\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:49:08.892692 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:08.892453    2580 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e59cd3e7-fdd2-46a1-9238-54226c3d868b-istio-kubeconfig\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:49:10.727761 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:10.727729    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e59cd3e7-fdd2-46a1-9238-54226c3d868b" path="/var/lib/kubelet/pods/e59cd3e7-fdd2-46a1-9238-54226c3d868b/volumes"
Jul 08 02:49:11.828167 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:11.828138    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z" event={"ID":"d6c01a05-8d71-495d-99d2-993b68bd1d37","Type":"ContainerStarted","Data":"484209188c85f3726acc229f5b9731ef94f9677bf5cf9343f25a7bec82bbef09"}
Jul 08 02:49:11.828629 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:11.828209    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"
Jul 08 02:49:11.846906 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:11.846856    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z" podStartSLOduration=3.394566667 podStartE2EDuration="6.846839174s" totalImagesPullingTime="3.452272507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:49:11.844657421 +0000 UTC m=+553.573916295" watchObservedRunningTime="2026-07-08 02:49:11.846839174 +0000 UTC m=+553.576098080"
Jul 08 02:49:12.776263 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:12.776219    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-k6mzm"
Jul 08 02:49:12.778558 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:12.778539    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7f2jr"
Jul 08 02:49:39.822648 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:39.822620    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkgfr"
Jul 08 02:49:42.835871 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:42.835839    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjt8z"
Jul 08 02:49:55.828840 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:55.828784    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9n8kp"]
Jul 08 02:49:55.829204 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:55.829181    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59cd3e7-fdd2-46a1-9238-54226c3d868b" containerName="discovery"
Jul 08 02:49:55.829204 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:55.829192    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59cd3e7-fdd2-46a1-9238-54226c3d868b" containerName="discovery"
Jul 08 02:49:55.829273 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:55.829262    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59cd3e7-fdd2-46a1-9238-54226c3d868b" containerName="discovery"
Jul 08 02:49:55.832264 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:55.832241    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9n8kp"
Jul 08 02:49:55.835607 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:55.835584    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fv7sp\""
Jul 08 02:49:55.835718 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:55.835618    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 02:49:55.835718 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:55.835584    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 02:49:55.841748 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:55.841726    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9n8kp"]
Jul 08 02:49:55.998082 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:55.998038    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxlch\" (UniqueName: \"kubernetes.io/projected/648113bc-e2e2-46a3-bc9b-ae31fd498711-kube-api-access-pxlch\") pod \"kuadrant-operator-catalog-9n8kp\" (UID: \"648113bc-e2e2-46a3-bc9b-ae31fd498711\") " pod="kuadrant-system/kuadrant-operator-catalog-9n8kp"
Jul 08 02:49:56.099062 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.098961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxlch\" (UniqueName: \"kubernetes.io/projected/648113bc-e2e2-46a3-bc9b-ae31fd498711-kube-api-access-pxlch\") pod \"kuadrant-operator-catalog-9n8kp\" (UID: \"648113bc-e2e2-46a3-bc9b-ae31fd498711\") " pod="kuadrant-system/kuadrant-operator-catalog-9n8kp"
Jul 08 02:49:56.107071 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.107038    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxlch\" (UniqueName: \"kubernetes.io/projected/648113bc-e2e2-46a3-bc9b-ae31fd498711-kube-api-access-pxlch\") pod \"kuadrant-operator-catalog-9n8kp\" (UID: \"648113bc-e2e2-46a3-bc9b-ae31fd498711\") " pod="kuadrant-system/kuadrant-operator-catalog-9n8kp"
Jul 08 02:49:56.144137 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.144107    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9n8kp"
Jul 08 02:49:56.184536 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.184506    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9n8kp"]
Jul 08 02:49:56.277196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.277175    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9n8kp"]
Jul 08 02:49:56.279598 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:49:56.279567    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648113bc_e2e2_46a3_bc9b_ae31fd498711.slice/crio-3ceabc4bfa2326cce6301dda8e3e20a9448a8f5eb05b5a0d7b62e75c73c67281 WatchSource:0}: Error finding container 3ceabc4bfa2326cce6301dda8e3e20a9448a8f5eb05b5a0d7b62e75c73c67281: Status 404 returned error can't find the container with id 3ceabc4bfa2326cce6301dda8e3e20a9448a8f5eb05b5a0d7b62e75c73c67281
Jul 08 02:49:56.390161 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.390085    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pzvtq"]
Jul 08 02:49:56.395043 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.395028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pzvtq"
Jul 08 02:49:56.399979 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.399957    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pzvtq"]
Jul 08 02:49:56.503182 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.503151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f669g\" (UniqueName: \"kubernetes.io/projected/9c579ccf-893d-4805-87ca-e777b995cad1-kube-api-access-f669g\") pod \"kuadrant-operator-catalog-pzvtq\" (UID: \"9c579ccf-893d-4805-87ca-e777b995cad1\") " pod="kuadrant-system/kuadrant-operator-catalog-pzvtq"
Jul 08 02:49:56.604438 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.604399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f669g\" (UniqueName: \"kubernetes.io/projected/9c579ccf-893d-4805-87ca-e777b995cad1-kube-api-access-f669g\") pod \"kuadrant-operator-catalog-pzvtq\" (UID: \"9c579ccf-893d-4805-87ca-e777b995cad1\") " pod="kuadrant-system/kuadrant-operator-catalog-pzvtq"
Jul 08 02:49:56.613303 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.613271    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f669g\" (UniqueName: \"kubernetes.io/projected/9c579ccf-893d-4805-87ca-e777b995cad1-kube-api-access-f669g\") pod \"kuadrant-operator-catalog-pzvtq\" (UID: \"9c579ccf-893d-4805-87ca-e777b995cad1\") " pod="kuadrant-system/kuadrant-operator-catalog-pzvtq"
Jul 08 02:49:56.706079 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.705990    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pzvtq"
Jul 08 02:49:56.842526 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:56.842500    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pzvtq"]
Jul 08 02:49:56.844095 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:49:56.844070    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c579ccf_893d_4805_87ca_e777b995cad1.slice/crio-85923ffbbe9e83c9e9eb8494fec1a83a03e1292e463f5a68ea5a2485c203e56e WatchSource:0}: Error finding container 85923ffbbe9e83c9e9eb8494fec1a83a03e1292e463f5a68ea5a2485c203e56e: Status 404 returned error can't find the container with id 85923ffbbe9e83c9e9eb8494fec1a83a03e1292e463f5a68ea5a2485c203e56e
Jul 08 02:49:57.041609 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:57.041574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pzvtq" event={"ID":"9c579ccf-893d-4805-87ca-e777b995cad1","Type":"ContainerStarted","Data":"85923ffbbe9e83c9e9eb8494fec1a83a03e1292e463f5a68ea5a2485c203e56e"}
Jul 08 02:49:57.042696 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:57.042673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9n8kp" event={"ID":"648113bc-e2e2-46a3-bc9b-ae31fd498711","Type":"ContainerStarted","Data":"3ceabc4bfa2326cce6301dda8e3e20a9448a8f5eb05b5a0d7b62e75c73c67281"}
Jul 08 02:49:59.054779 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:59.054735    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9n8kp" event={"ID":"648113bc-e2e2-46a3-bc9b-ae31fd498711","Type":"ContainerStarted","Data":"4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a"}
Jul 08 02:49:59.054779 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:59.054780    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9n8kp" podUID="648113bc-e2e2-46a3-bc9b-ae31fd498711" containerName="registry-server" containerID="cri-o://4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a" gracePeriod=2
Jul 08 02:49:59.056503 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:59.056475    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pzvtq" event={"ID":"9c579ccf-893d-4805-87ca-e777b995cad1","Type":"ContainerStarted","Data":"40a5bbafafb4058b16feef0700a0ccfb7b6368c7f56dd67c54601f07afaa9894"}
Jul 08 02:49:59.071043 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:59.071005    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9n8kp" podStartSLOduration=1.911000493 podStartE2EDuration="4.070991072s" totalImagesPullingTime="2.159990579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:49:59.069526609 +0000 UTC m=+600.798785488" watchObservedRunningTime="2026-07-08 02:49:59.070991072 +0000 UTC m=+600.800249930"
Jul 08 02:49:59.088975 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:59.088936    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pzvtq" podStartSLOduration=1.490968985 podStartE2EDuration="3.088922088s" totalImagesPullingTime="1.597953103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:49:59.087271641 +0000 UTC m=+600.816530500" watchObservedRunningTime="2026-07-08 02:49:59.088922088 +0000 UTC m=+600.818180947"
Jul 08 02:49:59.298331 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:59.298303    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9n8kp"
Jul 08 02:49:59.431005 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:59.430933    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxlch\" (UniqueName: \"kubernetes.io/projected/648113bc-e2e2-46a3-bc9b-ae31fd498711-kube-api-access-pxlch\") pod \"648113bc-e2e2-46a3-bc9b-ae31fd498711\" (UID: \"648113bc-e2e2-46a3-bc9b-ae31fd498711\") "
Jul 08 02:49:59.437230 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:59.434141    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/648113bc-e2e2-46a3-bc9b-ae31fd498711-kube-api-access-pxlch" (OuterVolumeSpecName: "kube-api-access-pxlch") pod "648113bc-e2e2-46a3-bc9b-ae31fd498711" (UID: "648113bc-e2e2-46a3-bc9b-ae31fd498711"). InnerVolumeSpecName "kube-api-access-pxlch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:49:59.532958 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:49:59.532916    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxlch\" (UniqueName: \"kubernetes.io/projected/648113bc-e2e2-46a3-bc9b-ae31fd498711-kube-api-access-pxlch\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:50:00.064101 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:00.064066    2580 generic.go:356] "Generic (PLEG): container finished" podID="648113bc-e2e2-46a3-bc9b-ae31fd498711" containerID="4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a" exitCode=0
Jul 08 02:50:00.064582 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:00.064119    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9n8kp"
Jul 08 02:50:00.064582 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:00.064154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9n8kp" event={"ID":"648113bc-e2e2-46a3-bc9b-ae31fd498711","Type":"ContainerDied","Data":"4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a"}
Jul 08 02:50:00.064582 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:00.064202    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9n8kp" event={"ID":"648113bc-e2e2-46a3-bc9b-ae31fd498711","Type":"ContainerDied","Data":"3ceabc4bfa2326cce6301dda8e3e20a9448a8f5eb05b5a0d7b62e75c73c67281"}
Jul 08 02:50:00.064582 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:00.064226    2580 scope.go:117] "RemoveContainer" containerID="4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a"
Jul 08 02:50:00.073656 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:00.073639    2580 scope.go:117] "RemoveContainer" containerID="4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a"
Jul 08 02:50:00.073933 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:00.073915    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a\": container with ID starting with 4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a not found: ID does not exist" containerID="4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a"
Jul 08 02:50:00.073992 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:00.073942    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a"} err="failed to get container status \"4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a\": rpc error: code = NotFound desc = could not find container \"4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a\": container with ID starting with 4d4be8ccc5a6daa14e511486b5ac1f1ba11d69fc17ec30033123f28d01b4118a not found: ID does not exist"
Jul 08 02:50:00.085160 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:00.085132    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9n8kp"]
Jul 08 02:50:00.090582 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:00.090560    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9n8kp"]
Jul 08 02:50:00.725730 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:00.725698    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="648113bc-e2e2-46a3-bc9b-ae31fd498711" path="/var/lib/kubelet/pods/648113bc-e2e2-46a3-bc9b-ae31fd498711/volumes"
Jul 08 02:50:01.170156 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:01.170128    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 02:50:01.170684 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:01.170668    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 02:50:06.706401 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:06.706365    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pzvtq"
Jul 08 02:50:06.706934 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:06.706421    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pzvtq"
Jul 08 02:50:06.730957 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:06.730931    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pzvtq"
Jul 08 02:50:07.120659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:07.120634    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pzvtq"
Jul 08 02:50:28.683341 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:28.683264    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4"]
Jul 08 02:50:28.683753 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:28.683627    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648113bc-e2e2-46a3-bc9b-ae31fd498711" containerName="registry-server"
Jul 08 02:50:28.683753 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:28.683638    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="648113bc-e2e2-46a3-bc9b-ae31fd498711" containerName="registry-server"
Jul 08 02:50:28.683753 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:28.683709    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="648113bc-e2e2-46a3-bc9b-ae31fd498711" containerName="registry-server"
Jul 08 02:50:28.688651 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:28.688624    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4"
Jul 08 02:50:28.691718 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:28.691699    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-p8ttk\""
Jul 08 02:50:28.704327 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:28.704295    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4"]
Jul 08 02:50:28.759700 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:28.759672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbltc\" (UniqueName: \"kubernetes.io/projected/dae62038-c44f-403a-813f-e4bb9d4a251f-kube-api-access-pbltc\") pod \"authorino-operator-75cc8d5cb7-2kzl4\" (UID: \"dae62038-c44f-403a-813f-e4bb9d4a251f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4"
Jul 08 02:50:28.860881 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:28.860841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbltc\" (UniqueName: \"kubernetes.io/projected/dae62038-c44f-403a-813f-e4bb9d4a251f-kube-api-access-pbltc\") pod \"authorino-operator-75cc8d5cb7-2kzl4\" (UID: \"dae62038-c44f-403a-813f-e4bb9d4a251f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4"
Jul 08 02:50:28.872114 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:28.872092    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbltc\" (UniqueName: \"kubernetes.io/projected/dae62038-c44f-403a-813f-e4bb9d4a251f-kube-api-access-pbltc\") pod \"authorino-operator-75cc8d5cb7-2kzl4\" (UID: \"dae62038-c44f-403a-813f-e4bb9d4a251f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4"
Jul 08 02:50:28.998672 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:28.998590    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4"
Jul 08 02:50:29.136147 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:29.136122    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4"]
Jul 08 02:50:29.138699 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:50:29.138673    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae62038_c44f_403a_813f_e4bb9d4a251f.slice/crio-c3dfcc215af31534473f9a8d940a20d4c2c0f353de1f7becbd1d5d927c53d7c0 WatchSource:0}: Error finding container c3dfcc215af31534473f9a8d940a20d4c2c0f353de1f7becbd1d5d927c53d7c0: Status 404 returned error can't find the container with id c3dfcc215af31534473f9a8d940a20d4c2c0f353de1f7becbd1d5d927c53d7c0
Jul 08 02:50:29.141093 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:29.141076    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 02:50:29.205098 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:29.205059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4" event={"ID":"dae62038-c44f-403a-813f-e4bb9d4a251f","Type":"ContainerStarted","Data":"c3dfcc215af31534473f9a8d940a20d4c2c0f353de1f7becbd1d5d927c53d7c0"}
Jul 08 02:50:31.858550 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:31.858519    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"]
Jul 08 02:50:31.862328 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:31.862308    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:31.864696 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:31.864673    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-k6r8x\""
Jul 08 02:50:31.871674 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:31.871652    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"]
Jul 08 02:50:31.889010 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:31.888985    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j7nv\" (UniqueName: \"kubernetes.io/projected/a86a7560-8e0b-4c99-88d0-fb10f9fbc220-kube-api-access-6j7nv\") pod \"limitador-operator-controller-manager-859d7b78bd-6qr6w\" (UID: \"a86a7560-8e0b-4c99-88d0-fb10f9fbc220\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:31.989786 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:31.989748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j7nv\" (UniqueName: \"kubernetes.io/projected/a86a7560-8e0b-4c99-88d0-fb10f9fbc220-kube-api-access-6j7nv\") pod \"limitador-operator-controller-manager-859d7b78bd-6qr6w\" (UID: \"a86a7560-8e0b-4c99-88d0-fb10f9fbc220\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:32.017319 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:32.017283    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j7nv\" (UniqueName: \"kubernetes.io/projected/a86a7560-8e0b-4c99-88d0-fb10f9fbc220-kube-api-access-6j7nv\") pod \"limitador-operator-controller-manager-859d7b78bd-6qr6w\" (UID: \"a86a7560-8e0b-4c99-88d0-fb10f9fbc220\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:32.173077 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:32.173000    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:32.223717 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:32.223684    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4" event={"ID":"dae62038-c44f-403a-813f-e4bb9d4a251f","Type":"ContainerStarted","Data":"8778aa71bf5ed1a6c8b3b0241ec636fcdcc5df3ffdcd8e07ec9afc81869ff3d5"}
Jul 08 02:50:32.223910 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:32.223848    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4"
Jul 08 02:50:32.259623 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:32.256677    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4" podStartSLOduration=1.930307349 podStartE2EDuration="4.256632528s" totalImagesPullingTime="2.326325179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:50:32.254251173 +0000 UTC m=+633.983510057" watchObservedRunningTime="2026-07-08 02:50:32.256632528 +0000 UTC m=+633.985891391"
Jul 08 02:50:32.342710 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:32.342683    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"]
Jul 08 02:50:32.345708 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:50:32.345677    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86a7560_8e0b_4c99_88d0_fb10f9fbc220.slice/crio-d7cab213e5e5a44b4d80fb93c8928f3b0a1e31024bcadc6ae2c8fd0ee540a353 WatchSource:0}: Error finding container d7cab213e5e5a44b4d80fb93c8928f3b0a1e31024bcadc6ae2c8fd0ee540a353: Status 404 returned error can't find the container with id d7cab213e5e5a44b4d80fb93c8928f3b0a1e31024bcadc6ae2c8fd0ee540a353
Jul 08 02:50:33.230175 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:33.230132    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w" event={"ID":"a86a7560-8e0b-4c99-88d0-fb10f9fbc220","Type":"ContainerStarted","Data":"d7cab213e5e5a44b4d80fb93c8928f3b0a1e31024bcadc6ae2c8fd0ee540a353"}
Jul 08 02:50:34.237112 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:34.237073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w" event={"ID":"a86a7560-8e0b-4c99-88d0-fb10f9fbc220","Type":"ContainerStarted","Data":"b8bdd5f43045c759e643cfec9afdc72014d665103c9b4a66532fb5e03f4043cc"}
Jul 08 02:50:34.237534 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:34.237179    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:34.256171 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:34.256129    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w" podStartSLOduration=1.577501362 podStartE2EDuration="3.256116642s" totalImagesPullingTime="1.67861528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:50:34.25444924 +0000 UTC m=+635.983708133" watchObservedRunningTime="2026-07-08 02:50:34.256116642 +0000 UTC m=+635.985375499"
Jul 08 02:50:36.951056 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:36.951024    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"]
Jul 08 02:50:36.954809 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:36.954772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:36.957507 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:36.957478    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2d4q9\""
Jul 08 02:50:36.971678 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:36.971654    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"]
Jul 08 02:50:37.038318 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:37.038286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f9cbde2-295e-44c7-9168-34caceebb156-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" (UID: \"3f9cbde2-295e-44c7-9168-34caceebb156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:37.038318 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:37.038320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74x9h\" (UniqueName: \"kubernetes.io/projected/3f9cbde2-295e-44c7-9168-34caceebb156-kube-api-access-74x9h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" (UID: \"3f9cbde2-295e-44c7-9168-34caceebb156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:37.139579 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:37.139547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f9cbde2-295e-44c7-9168-34caceebb156-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" (UID: \"3f9cbde2-295e-44c7-9168-34caceebb156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:37.139579 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:37.139584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74x9h\" (UniqueName: \"kubernetes.io/projected/3f9cbde2-295e-44c7-9168-34caceebb156-kube-api-access-74x9h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" (UID: \"3f9cbde2-295e-44c7-9168-34caceebb156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:37.139962 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:37.139941    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f9cbde2-295e-44c7-9168-34caceebb156-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" (UID: \"3f9cbde2-295e-44c7-9168-34caceebb156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:37.148767 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:37.148739    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74x9h\" (UniqueName: \"kubernetes.io/projected/3f9cbde2-295e-44c7-9168-34caceebb156-kube-api-access-74x9h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" (UID: \"3f9cbde2-295e-44c7-9168-34caceebb156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:37.265231 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:37.265212    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:37.419146 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:37.419107    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"]
Jul 08 02:50:37.421470 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:50:37.421438    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9cbde2_295e_44c7_9168_34caceebb156.slice/crio-32d69c87ec3c3f3c1cd7ac62ce1303bee06a50df8138dd4180ccdfd2253c70b0 WatchSource:0}: Error finding container 32d69c87ec3c3f3c1cd7ac62ce1303bee06a50df8138dd4180ccdfd2253c70b0: Status 404 returned error can't find the container with id 32d69c87ec3c3f3c1cd7ac62ce1303bee06a50df8138dd4180ccdfd2253c70b0
Jul 08 02:50:38.260997 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:38.260951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc" event={"ID":"3f9cbde2-295e-44c7-9168-34caceebb156","Type":"ContainerStarted","Data":"32d69c87ec3c3f3c1cd7ac62ce1303bee06a50df8138dd4180ccdfd2253c70b0"}
Jul 08 02:50:39.490240 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:39.490207    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v"]
Jul 08 02:50:39.493603 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:39.493585    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v"
Jul 08 02:50:39.496022 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:39.496001    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 08 02:50:39.496213 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:39.496197    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lxbsg\""
Jul 08 02:50:39.502787 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:39.502766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v"]
Jul 08 02:50:39.564072 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:39.564032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6pnn\" (UniqueName: \"kubernetes.io/projected/27f0b9dd-6603-44f5-8e65-c323104fccfc-kube-api-access-c6pnn\") pod \"dns-operator-controller-manager-864dd78c4c-jgb6v\" (UID: \"27f0b9dd-6603-44f5-8e65-c323104fccfc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v"
Jul 08 02:50:39.664899 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:39.664863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6pnn\" (UniqueName: \"kubernetes.io/projected/27f0b9dd-6603-44f5-8e65-c323104fccfc-kube-api-access-c6pnn\") pod \"dns-operator-controller-manager-864dd78c4c-jgb6v\" (UID: \"27f0b9dd-6603-44f5-8e65-c323104fccfc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v"
Jul 08 02:50:39.689042 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:39.689016    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6pnn\" (UniqueName: \"kubernetes.io/projected/27f0b9dd-6603-44f5-8e65-c323104fccfc-kube-api-access-c6pnn\") pod \"dns-operator-controller-manager-864dd78c4c-jgb6v\" (UID: \"27f0b9dd-6603-44f5-8e65-c323104fccfc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v"
Jul 08 02:50:39.804826 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:39.804780    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v"
Jul 08 02:50:39.936130 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:39.936098    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v"]
Jul 08 02:50:39.938562 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:50:39.938536    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f0b9dd_6603_44f5_8e65_c323104fccfc.slice/crio-c0d78afcbbeb8b88e256be666f093dada798ac6498d3fb824c741fdd43c9ea32 WatchSource:0}: Error finding container c0d78afcbbeb8b88e256be666f093dada798ac6498d3fb824c741fdd43c9ea32: Status 404 returned error can't find the container with id c0d78afcbbeb8b88e256be666f093dada798ac6498d3fb824c741fdd43c9ea32
Jul 08 02:50:40.272861 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:40.272826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v" event={"ID":"27f0b9dd-6603-44f5-8e65-c323104fccfc","Type":"ContainerStarted","Data":"c0d78afcbbeb8b88e256be666f093dada798ac6498d3fb824c741fdd43c9ea32"}
Jul 08 02:50:42.289597 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:42.289563    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v" event={"ID":"27f0b9dd-6603-44f5-8e65-c323104fccfc","Type":"ContainerStarted","Data":"05241cc6bbad8fe6835ad08daa914a291887c2bef7ab93261edce80e8b596232"}
Jul 08 02:50:42.290088 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:42.289644    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v"
Jul 08 02:50:42.326811 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:42.326747    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v" podStartSLOduration=1.125102347 podStartE2EDuration="3.326728696s" totalImagesPullingTime="2.201626349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:50:42.325394591 +0000 UTC m=+644.054653448" watchObservedRunningTime="2026-07-08 02:50:42.326728696 +0000 UTC m=+644.055987555"
Jul 08 02:50:43.233623 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:43.233597    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2kzl4"
Jul 08 02:50:44.303004 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:44.302968    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc" event={"ID":"3f9cbde2-295e-44c7-9168-34caceebb156","Type":"ContainerStarted","Data":"8b3f76a3b16bca1be48c1130465a862d223fa54ab19d1956036b4b5f1c96b226"}
Jul 08 02:50:44.303385 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:44.303103    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:44.325936 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:44.325856    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc" podStartSLOduration=1.564364656 podStartE2EDuration="8.32583829s" totalImagesPullingTime="6.761473634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:50:44.324943972 +0000 UTC m=+646.054202848" watchObservedRunningTime="2026-07-08 02:50:44.32583829 +0000 UTC m=+646.055097147"
Jul 08 02:50:45.246173 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:45.246142    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:53.298508 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:53.298474    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jgb6v"
Jul 08 02:50:55.311167 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:55.311130    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:56.504621 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:56.504584    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"]
Jul 08 02:50:56.507992 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:56.507976    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:56.529647 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:56.529626    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"]
Jul 08 02:50:56.621856 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:56.621820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7dbc526-6317-475d-aabb-5576afcaf48a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" (UID: \"c7dbc526-6317-475d-aabb-5576afcaf48a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:56.621988 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:56.621879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ctzd\" (UniqueName: \"kubernetes.io/projected/c7dbc526-6317-475d-aabb-5576afcaf48a-kube-api-access-9ctzd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" (UID: \"c7dbc526-6317-475d-aabb-5576afcaf48a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:56.723062 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:56.723033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ctzd\" (UniqueName: \"kubernetes.io/projected/c7dbc526-6317-475d-aabb-5576afcaf48a-kube-api-access-9ctzd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" (UID: \"c7dbc526-6317-475d-aabb-5576afcaf48a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:56.723194 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:56.723140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7dbc526-6317-475d-aabb-5576afcaf48a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" (UID: \"c7dbc526-6317-475d-aabb-5576afcaf48a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:56.723564 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:56.723543    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7dbc526-6317-475d-aabb-5576afcaf48a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" (UID: \"c7dbc526-6317-475d-aabb-5576afcaf48a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:56.731964 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:56.731935    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ctzd\" (UniqueName: \"kubernetes.io/projected/c7dbc526-6317-475d-aabb-5576afcaf48a-kube-api-access-9ctzd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" (UID: \"c7dbc526-6317-475d-aabb-5576afcaf48a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:56.818149 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:56.818127    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:56.953429 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:56.953406    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"]
Jul 08 02:50:56.954936 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:50:56.954915    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7dbc526_6317_475d_aabb_5576afcaf48a.slice/crio-bddd6aeb06b605f64f7ef0bea34e67bd2a6bc59e1ff7698bbfd5da8c6ad16956 WatchSource:0}: Error finding container bddd6aeb06b605f64f7ef0bea34e67bd2a6bc59e1ff7698bbfd5da8c6ad16956: Status 404 returned error can't find the container with id bddd6aeb06b605f64f7ef0bea34e67bd2a6bc59e1ff7698bbfd5da8c6ad16956
Jul 08 02:50:57.121988 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.121923    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"]
Jul 08 02:50:57.126427 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.126394    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"]
Jul 08 02:50:57.136754 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.136731    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"]
Jul 08 02:50:57.136926 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.136906    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" containerName="manager" containerID="cri-o://8b3f76a3b16bca1be48c1130465a862d223fa54ab19d1956036b4b5f1c96b226" gracePeriod=2
Jul 08 02:50:57.145487 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.145463    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"]
Jul 08 02:50:57.150741 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.150718    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"]
Jul 08 02:50:57.151333 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.151316    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" containerName="manager"
Jul 08 02:50:57.151384 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.151337    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" containerName="manager"
Jul 08 02:50:57.151384 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.151361    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" containerName="manager"
Jul 08 02:50:57.151384 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.151371    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" containerName="manager"
Jul 08 02:50:57.151476 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.151471    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" containerName="manager"
Jul 08 02:50:57.151508 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.151484    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" containerName="manager"
Jul 08 02:50:57.154926 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.154909    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"
Jul 08 02:50:57.157336 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.157309    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:57.161575 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.161554    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"]
Jul 08 02:50:57.161755 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.161729    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" containerName="manager" containerID="cri-o://b8bdd5f43045c759e643cfec9afdc72014d665103c9b4a66532fb5e03f4043cc" gracePeriod=2
Jul 08 02:50:57.168037 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.168018    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"]
Jul 08 02:50:57.172029 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.172009    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"]
Jul 08 02:50:57.175358 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.175340    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"
Jul 08 02:50:57.192139 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.191791    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"]
Jul 08 02:50:57.197338 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.197314    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"]
Jul 08 02:50:57.199279 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.199261    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9"]
Jul 08 02:50:57.199627 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.199611    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" containerName="manager"
Jul 08 02:50:57.199627 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.199625    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" containerName="manager"
Jul 08 02:50:57.199781 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.199719    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" containerName="manager"
Jul 08 02:50:57.202907 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.202887    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9"
Jul 08 02:50:57.207748 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.207731    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9"]
Jul 08 02:50:57.215282 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.215254    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6qr6w\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:57.217063 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.217039    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:57.218890 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.218870    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6qr6w\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:57.227479 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.227458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kpbq5\" (UID: \"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"
Jul 08 02:50:57.227571 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.227491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8mh7\" (UniqueName: \"kubernetes.io/projected/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168-kube-api-access-q8mh7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kpbq5\" (UID: \"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"
Jul 08 02:50:57.238449 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.238424    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:57.329078 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.328987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbrrk\" (UniqueName: \"kubernetes.io/projected/9e8def7e-b3a3-4b17-8505-7920ab31389f-kube-api-access-gbrrk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s994p\" (UID: \"9e8def7e-b3a3-4b17-8505-7920ab31389f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"
Jul 08 02:50:57.329078 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.329061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kpbq5\" (UID: \"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"
Jul 08 02:50:57.329226 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.329087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8mh7\" (UniqueName: \"kubernetes.io/projected/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168-kube-api-access-q8mh7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kpbq5\" (UID: \"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"
Jul 08 02:50:57.329226 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.329143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e8def7e-b3a3-4b17-8505-7920ab31389f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s994p\" (UID: \"9e8def7e-b3a3-4b17-8505-7920ab31389f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"
Jul 08 02:50:57.329226 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.329181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45nv4\" (UniqueName: \"kubernetes.io/projected/42c0826a-e397-479a-9362-c3df88f85fc2-kube-api-access-45nv4\") pod \"limitador-operator-controller-manager-859d7b78bd-f6qm9\" (UID: \"42c0826a-e397-479a-9362-c3df88f85fc2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9"
Jul 08 02:50:57.329652 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.329627    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kpbq5\" (UID: \"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"
Jul 08 02:50:57.342260 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.342224    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8mh7\" (UniqueName: \"kubernetes.io/projected/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168-kube-api-access-q8mh7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kpbq5\" (UID: \"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"
Jul 08 02:50:57.371359 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.371332    2580 generic.go:356] "Generic (PLEG): container finished" podID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" containerID="b8bdd5f43045c759e643cfec9afdc72014d665103c9b4a66532fb5e03f4043cc" exitCode=0
Jul 08 02:50:57.373154 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.373090    2580 generic.go:356] "Generic (PLEG): container finished" podID="3f9cbde2-295e-44c7-9168-34caceebb156" containerID="8b3f76a3b16bca1be48c1130465a862d223fa54ab19d1956036b4b5f1c96b226" exitCode=0
Jul 08 02:50:57.375071 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.375053    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh" container="manager"
Jul 08 02:50:57.377354 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.377325    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:57.379625 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.379585    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:57.381621 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.381595    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6qr6w\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:57.391430 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.391409    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:57.393613 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.393589    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:57.395609 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.395586    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:57.397544 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.397522    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6qr6w\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:57.413995 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.413979    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:57.416317 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.416297    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:57.418533 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.418514    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:57.420374 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:57.420355    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6qr6w\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:57.429930 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.429914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e8def7e-b3a3-4b17-8505-7920ab31389f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s994p\" (UID: \"9e8def7e-b3a3-4b17-8505-7920ab31389f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"
Jul 08 02:50:57.429997 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.429945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45nv4\" (UniqueName: \"kubernetes.io/projected/42c0826a-e397-479a-9362-c3df88f85fc2-kube-api-access-45nv4\") pod \"limitador-operator-controller-manager-859d7b78bd-f6qm9\" (UID: \"42c0826a-e397-479a-9362-c3df88f85fc2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9"
Jul 08 02:50:57.430108 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.430082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbrrk\" (UniqueName: \"kubernetes.io/projected/9e8def7e-b3a3-4b17-8505-7920ab31389f-kube-api-access-gbrrk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s994p\" (UID: \"9e8def7e-b3a3-4b17-8505-7920ab31389f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"
Jul 08 02:50:57.430288 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.430267    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e8def7e-b3a3-4b17-8505-7920ab31389f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s994p\" (UID: \"9e8def7e-b3a3-4b17-8505-7920ab31389f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"
Jul 08 02:50:57.441213 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.441192    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45nv4\" (UniqueName: \"kubernetes.io/projected/42c0826a-e397-479a-9362-c3df88f85fc2-kube-api-access-45nv4\") pod \"limitador-operator-controller-manager-859d7b78bd-f6qm9\" (UID: \"42c0826a-e397-479a-9362-c3df88f85fc2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9"
Jul 08 02:50:57.441289 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.441242    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbrrk\" (UniqueName: \"kubernetes.io/projected/9e8def7e-b3a3-4b17-8505-7920ab31389f-kube-api-access-gbrrk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s994p\" (UID: \"9e8def7e-b3a3-4b17-8505-7920ab31389f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"
Jul 08 02:50:57.530572 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.530551    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j7nv\" (UniqueName: \"kubernetes.io/projected/a86a7560-8e0b-4c99-88d0-fb10f9fbc220-kube-api-access-6j7nv\") pod \"a86a7560-8e0b-4c99-88d0-fb10f9fbc220\" (UID: \"a86a7560-8e0b-4c99-88d0-fb10f9fbc220\") "
Jul 08 02:50:57.530965 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.530602    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74x9h\" (UniqueName: \"kubernetes.io/projected/3f9cbde2-295e-44c7-9168-34caceebb156-kube-api-access-74x9h\") pod \"3f9cbde2-295e-44c7-9168-34caceebb156\" (UID: \"3f9cbde2-295e-44c7-9168-34caceebb156\") "
Jul 08 02:50:57.530965 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.530664    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f9cbde2-295e-44c7-9168-34caceebb156-extensions-socket-volume\") pod \"3f9cbde2-295e-44c7-9168-34caceebb156\" (UID: \"3f9cbde2-295e-44c7-9168-34caceebb156\") "
Jul 08 02:50:57.531211 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.531190    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9cbde2-295e-44c7-9168-34caceebb156-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3f9cbde2-295e-44c7-9168-34caceebb156" (UID: "3f9cbde2-295e-44c7-9168-34caceebb156"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:50:57.532618 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.532598    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a86a7560-8e0b-4c99-88d0-fb10f9fbc220-kube-api-access-6j7nv" (OuterVolumeSpecName: "kube-api-access-6j7nv") pod "a86a7560-8e0b-4c99-88d0-fb10f9fbc220" (UID: "a86a7560-8e0b-4c99-88d0-fb10f9fbc220"). InnerVolumeSpecName "kube-api-access-6j7nv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:50:57.532708 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.532692    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f9cbde2-295e-44c7-9168-34caceebb156-kube-api-access-74x9h" (OuterVolumeSpecName: "kube-api-access-74x9h") pod "3f9cbde2-295e-44c7-9168-34caceebb156" (UID: "3f9cbde2-295e-44c7-9168-34caceebb156"). InnerVolumeSpecName "kube-api-access-74x9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:50:57.558580 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.558563    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"
Jul 08 02:50:57.565590 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.565575    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"
Jul 08 02:50:57.572284 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.572261    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9"
Jul 08 02:50:57.632392 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.632305    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f9cbde2-295e-44c7-9168-34caceebb156-extensions-socket-volume\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:50:57.632392 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.632340    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j7nv\" (UniqueName: \"kubernetes.io/projected/a86a7560-8e0b-4c99-88d0-fb10f9fbc220-kube-api-access-6j7nv\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:50:57.632392 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.632357    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74x9h\" (UniqueName: \"kubernetes.io/projected/3f9cbde2-295e-44c7-9168-34caceebb156-kube-api-access-74x9h\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:50:57.722621 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.722594    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"]
Jul 08 02:50:57.724712 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:50:57.724686    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c3ed4c_3d35_4441_9c79_dd1ab8e6e168.slice/crio-9ce672f77ae2aa731b4dc664008e85d1b5fc4fc6c6f2516870e318e3c0119881 WatchSource:0}: Error finding container 9ce672f77ae2aa731b4dc664008e85d1b5fc4fc6c6f2516870e318e3c0119881: Status 404 returned error can't find the container with id 9ce672f77ae2aa731b4dc664008e85d1b5fc4fc6c6f2516870e318e3c0119881
Jul 08 02:50:57.940534 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.940502    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9"]
Jul 08 02:50:57.942783 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:50:57.942656    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c0826a_e397_479a_9362_c3df88f85fc2.slice/crio-0c9f4fd6aa2c4290abd686fb3a3aa82f582c483d2175e9fcc0144874a6a8ddfe WatchSource:0}: Error finding container 0c9f4fd6aa2c4290abd686fb3a3aa82f582c483d2175e9fcc0144874a6a8ddfe: Status 404 returned error can't find the container with id 0c9f4fd6aa2c4290abd686fb3a3aa82f582c483d2175e9fcc0144874a6a8ddfe
Jul 08 02:50:57.943589 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:57.943564    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"]
Jul 08 02:50:57.945897 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:50:57.945874    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e8def7e_b3a3_4b17_8505_7920ab31389f.slice/crio-75cae06e3810845fc84d9015aa8dcbc6ea97a21ffbf70c625afc043e09ef5307 WatchSource:0}: Error finding container 75cae06e3810845fc84d9015aa8dcbc6ea97a21ffbf70c625afc043e09ef5307: Status 404 returned error can't find the container with id 75cae06e3810845fc84d9015aa8dcbc6ea97a21ffbf70c625afc043e09ef5307
Jul 08 02:50:58.383189 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.383156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p" event={"ID":"9e8def7e-b3a3-4b17-8505-7920ab31389f","Type":"ContainerStarted","Data":"3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df"}
Jul 08 02:50:58.383363 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.383215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p" event={"ID":"9e8def7e-b3a3-4b17-8505-7920ab31389f","Type":"ContainerStarted","Data":"75cae06e3810845fc84d9015aa8dcbc6ea97a21ffbf70c625afc043e09ef5307"}
Jul 08 02:50:58.383363 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.383271    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"
Jul 08 02:50:58.384871 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.384847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5" event={"ID":"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168","Type":"ContainerStarted","Data":"c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8"}
Jul 08 02:50:58.385002 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.384883    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5" event={"ID":"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168","Type":"ContainerStarted","Data":"9ce672f77ae2aa731b4dc664008e85d1b5fc4fc6c6f2516870e318e3c0119881"}
Jul 08 02:50:58.385002 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.384930    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"
Jul 08 02:50:58.385574 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:58.385546    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:58.386171 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.386158    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:58.386171 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.386171    2580 scope.go:117] "RemoveContainer" containerID="b8bdd5f43045c759e643cfec9afdc72014d665103c9b4a66532fb5e03f4043cc"
Jul 08 02:50:58.387575 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:58.387548    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:58.387858 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.387843    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:58.389617 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.389595    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9" event={"ID":"42c0826a-e397-479a-9362-c3df88f85fc2","Type":"ContainerStarted","Data":"150aa8e8d2c3e21ad7010cf3e0ade0c212a1d0713f34d9eba1b7731418642dd8"}
Jul 08 02:50:58.389730 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.389639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9" event={"ID":"42c0826a-e397-479a-9362-c3df88f85fc2","Type":"ContainerStarted","Data":"0c9f4fd6aa2c4290abd686fb3a3aa82f582c483d2175e9fcc0144874a6a8ddfe"}
Jul 08 02:50:58.389730 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.389670    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9"
Jul 08 02:50:58.391629 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.391602    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" containerName="manager" containerID="cri-o://83615a440fd053519c392c6820990d78ab0f2ca542de976836568e253d492abd" gracePeriod=2
Jul 08 02:50:58.401778 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.401760    2580 scope.go:117] "RemoveContainer" containerID="8b3f76a3b16bca1be48c1130465a862d223fa54ab19d1956036b4b5f1c96b226"
Jul 08 02:50:58.413817 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:58.413767    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6qr6w\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:58.414447 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.414407    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p" podStartSLOduration=1.414394353 podStartE2EDuration="1.414394353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:50:58.411657661 +0000 UTC m=+660.140916539" watchObservedRunningTime="2026-07-08 02:50:58.414394353 +0000 UTC m=+660.143653210"
Jul 08 02:50:58.418385 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:58.418356    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:58.442377 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:58.442353    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6qr6w\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:58.442903 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.442871    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5" podStartSLOduration=1.442859709 podStartE2EDuration="1.442859709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:50:58.440611426 +0000 UTC m=+660.169870295" watchObservedRunningTime="2026-07-08 02:50:58.442859709 +0000 UTC m=+660.172118567"
Jul 08 02:50:58.469386 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:58.469363    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:58.469634 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.469603    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9" podStartSLOduration=1.469591811 podStartE2EDuration="1.469591811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:50:58.467508652 +0000 UTC m=+660.196767550" watchObservedRunningTime="2026-07-08 02:50:58.469591811 +0000 UTC m=+660.198850669"
Jul 08 02:50:58.636030 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.635974    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:58.638208 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:58.638185    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:58.640084 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:58.640060    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:58.641778 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:58.641756    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6qr6w\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:58.724304 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:58.724263    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-v9rbc\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v9rbc"
Jul 08 02:50:58.726998 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.726975    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f9cbde2-295e-44c7-9168-34caceebb156" path="/var/lib/kubelet/pods/3f9cbde2-295e-44c7-9168-34caceebb156/volumes"
Jul 08 02:50:58.727286 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.727275    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" path="/var/lib/kubelet/pods/a86a7560-8e0b-4c99-88d0-fb10f9fbc220/volumes"
Jul 08 02:50:58.730189 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:58.730167    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:58.732055 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:58.732031    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6qr6w\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="a86a7560-8e0b-4c99-88d0-fb10f9fbc220" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6qr6w"
Jul 08 02:50:58.742633 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.742612    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ctzd\" (UniqueName: \"kubernetes.io/projected/c7dbc526-6317-475d-aabb-5576afcaf48a-kube-api-access-9ctzd\") pod \"c7dbc526-6317-475d-aabb-5576afcaf48a\" (UID: \"c7dbc526-6317-475d-aabb-5576afcaf48a\") "
Jul 08 02:50:58.742733 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.742714    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7dbc526-6317-475d-aabb-5576afcaf48a-extensions-socket-volume\") pod \"c7dbc526-6317-475d-aabb-5576afcaf48a\" (UID: \"c7dbc526-6317-475d-aabb-5576afcaf48a\") "
Jul 08 02:50:58.742997 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.742975    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7dbc526-6317-475d-aabb-5576afcaf48a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c7dbc526-6317-475d-aabb-5576afcaf48a" (UID: "c7dbc526-6317-475d-aabb-5576afcaf48a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:50:58.744700 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.744682    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7dbc526-6317-475d-aabb-5576afcaf48a-kube-api-access-9ctzd" (OuterVolumeSpecName: "kube-api-access-9ctzd") pod "c7dbc526-6317-475d-aabb-5576afcaf48a" (UID: "c7dbc526-6317-475d-aabb-5576afcaf48a"). InnerVolumeSpecName "kube-api-access-9ctzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:50:58.843439 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.843409    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7dbc526-6317-475d-aabb-5576afcaf48a-extensions-socket-volume\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:50:58.843439 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:58.843432    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ctzd\" (UniqueName: \"kubernetes.io/projected/c7dbc526-6317-475d-aabb-5576afcaf48a-kube-api-access-9ctzd\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:50:59.399098 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:59.399065    2580 generic.go:356] "Generic (PLEG): container finished" podID="c7dbc526-6317-475d-aabb-5576afcaf48a" containerID="83615a440fd053519c392c6820990d78ab0f2ca542de976836568e253d492abd" exitCode=2
Jul 08 02:50:59.399272 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:59.399123    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:59.399272 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:59.399180    2580 scope.go:117] "RemoveContainer" containerID="83615a440fd053519c392c6820990d78ab0f2ca542de976836568e253d492abd"
Jul 08 02:50:59.408858 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:59.408787    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6gtgh\" is forbidden: User \"system:node:ip-10-0-132-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-232.ec2.internal' and this object" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6gtgh"
Jul 08 02:50:59.411392 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:59.411375    2580 scope.go:117] "RemoveContainer" containerID="83615a440fd053519c392c6820990d78ab0f2ca542de976836568e253d492abd"
Jul 08 02:50:59.411643 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:50:59.411621    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83615a440fd053519c392c6820990d78ab0f2ca542de976836568e253d492abd\": container with ID starting with 83615a440fd053519c392c6820990d78ab0f2ca542de976836568e253d492abd not found: ID does not exist" containerID="83615a440fd053519c392c6820990d78ab0f2ca542de976836568e253d492abd"
Jul 08 02:50:59.411704 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:50:59.411653    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83615a440fd053519c392c6820990d78ab0f2ca542de976836568e253d492abd"} err="failed to get container status \"83615a440fd053519c392c6820990d78ab0f2ca542de976836568e253d492abd\": rpc error: code = NotFound desc = could not find container \"83615a440fd053519c392c6820990d78ab0f2ca542de976836568e253d492abd\": container with ID starting with 83615a440fd053519c392c6820990d78ab0f2ca542de976836568e253d492abd not found: ID does not exist"
Jul 08 02:51:00.726875 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:00.726837    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7dbc526-6317-475d-aabb-5576afcaf48a" path="/var/lib/kubelet/pods/c7dbc526-6317-475d-aabb-5576afcaf48a/volumes"
Jul 08 02:51:09.401227 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.401201    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"
Jul 08 02:51:09.401666 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.401411    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"
Jul 08 02:51:09.401666 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.401463    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f6qm9"
Jul 08 02:51:09.478838 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.478789    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"]
Jul 08 02:51:09.479045 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.479002    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p" podUID="9e8def7e-b3a3-4b17-8505-7920ab31389f" containerName="manager" containerID="cri-o://3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df" gracePeriod=10
Jul 08 02:51:09.693046 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.692974    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"]
Jul 08 02:51:09.695789 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.695774    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"
Jul 08 02:51:09.715009 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.714983    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"]
Jul 08 02:51:09.738009 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.737984    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"
Jul 08 02:51:09.836339 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.836308    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e8def7e-b3a3-4b17-8505-7920ab31389f-extensions-socket-volume\") pod \"9e8def7e-b3a3-4b17-8505-7920ab31389f\" (UID: \"9e8def7e-b3a3-4b17-8505-7920ab31389f\") "
Jul 08 02:51:09.836513 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.836383    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbrrk\" (UniqueName: \"kubernetes.io/projected/9e8def7e-b3a3-4b17-8505-7920ab31389f-kube-api-access-gbrrk\") pod \"9e8def7e-b3a3-4b17-8505-7920ab31389f\" (UID: \"9e8def7e-b3a3-4b17-8505-7920ab31389f\") "
Jul 08 02:51:09.836578 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.836551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9ad42b6-271b-4971-89b9-02279fe15544-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tlcq6\" (UID: \"d9ad42b6-271b-4971-89b9-02279fe15544\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"
Jul 08 02:51:09.836656 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.836639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq956\" (UniqueName: \"kubernetes.io/projected/d9ad42b6-271b-4971-89b9-02279fe15544-kube-api-access-qq956\") pod \"kuadrant-operator-controller-manager-86878c769f-tlcq6\" (UID: \"d9ad42b6-271b-4971-89b9-02279fe15544\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"
Jul 08 02:51:09.836739 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.836717    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e8def7e-b3a3-4b17-8505-7920ab31389f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9e8def7e-b3a3-4b17-8505-7920ab31389f" (UID: "9e8def7e-b3a3-4b17-8505-7920ab31389f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:51:09.837094 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.836996    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e8def7e-b3a3-4b17-8505-7920ab31389f-extensions-socket-volume\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:51:09.838480 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.838460    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e8def7e-b3a3-4b17-8505-7920ab31389f-kube-api-access-gbrrk" (OuterVolumeSpecName: "kube-api-access-gbrrk") pod "9e8def7e-b3a3-4b17-8505-7920ab31389f" (UID: "9e8def7e-b3a3-4b17-8505-7920ab31389f"). InnerVolumeSpecName "kube-api-access-gbrrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:51:09.937735 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.937694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq956\" (UniqueName: \"kubernetes.io/projected/d9ad42b6-271b-4971-89b9-02279fe15544-kube-api-access-qq956\") pod \"kuadrant-operator-controller-manager-86878c769f-tlcq6\" (UID: \"d9ad42b6-271b-4971-89b9-02279fe15544\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"
Jul 08 02:51:09.937904 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.937819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9ad42b6-271b-4971-89b9-02279fe15544-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tlcq6\" (UID: \"d9ad42b6-271b-4971-89b9-02279fe15544\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"
Jul 08 02:51:09.937904 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.937856    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbrrk\" (UniqueName: \"kubernetes.io/projected/9e8def7e-b3a3-4b17-8505-7920ab31389f-kube-api-access-gbrrk\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:51:09.938154 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.938139    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9ad42b6-271b-4971-89b9-02279fe15544-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tlcq6\" (UID: \"d9ad42b6-271b-4971-89b9-02279fe15544\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"
Jul 08 02:51:09.956675 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:09.956610    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq956\" (UniqueName: \"kubernetes.io/projected/d9ad42b6-271b-4971-89b9-02279fe15544-kube-api-access-qq956\") pod \"kuadrant-operator-controller-manager-86878c769f-tlcq6\" (UID: \"d9ad42b6-271b-4971-89b9-02279fe15544\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"
Jul 08 02:51:10.006312 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.006283    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"
Jul 08 02:51:10.156552 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.156518    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"]
Jul 08 02:51:10.161370 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:51:10.161345    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ad42b6_271b_4971_89b9_02279fe15544.slice/crio-dab7772fc4bc3f1cb15cf25063ee337114bf9458c7a542194f901f2649fadf31 WatchSource:0}: Error finding container dab7772fc4bc3f1cb15cf25063ee337114bf9458c7a542194f901f2649fadf31: Status 404 returned error can't find the container with id dab7772fc4bc3f1cb15cf25063ee337114bf9458c7a542194f901f2649fadf31
Jul 08 02:51:10.461969 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.461884    2580 generic.go:356] "Generic (PLEG): container finished" podID="9e8def7e-b3a3-4b17-8505-7920ab31389f" containerID="3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df" exitCode=0
Jul 08 02:51:10.461969 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.461932    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"
Jul 08 02:51:10.462443 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.461978    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p" event={"ID":"9e8def7e-b3a3-4b17-8505-7920ab31389f","Type":"ContainerDied","Data":"3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df"}
Jul 08 02:51:10.462443 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.462044    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p" event={"ID":"9e8def7e-b3a3-4b17-8505-7920ab31389f","Type":"ContainerDied","Data":"75cae06e3810845fc84d9015aa8dcbc6ea97a21ffbf70c625afc043e09ef5307"}
Jul 08 02:51:10.462443 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.462078    2580 scope.go:117] "RemoveContainer" containerID="3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df"
Jul 08 02:51:10.463856 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.463830    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6" event={"ID":"d9ad42b6-271b-4971-89b9-02279fe15544","Type":"ContainerStarted","Data":"011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd"}
Jul 08 02:51:10.463973 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.463880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6" event={"ID":"d9ad42b6-271b-4971-89b9-02279fe15544","Type":"ContainerStarted","Data":"dab7772fc4bc3f1cb15cf25063ee337114bf9458c7a542194f901f2649fadf31"}
Jul 08 02:51:10.463973 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.463954    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"
Jul 08 02:51:10.472008 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.471984    2580 scope.go:117] "RemoveContainer" containerID="3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df"
Jul 08 02:51:10.472336 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:51:10.472316    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df\": container with ID starting with 3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df not found: ID does not exist" containerID="3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df"
Jul 08 02:51:10.472441 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.472342    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df"} err="failed to get container status \"3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df\": rpc error: code = NotFound desc = could not find container \"3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df\": container with ID starting with 3ac0021b28b28ae6acfbfe39d4cf64a7a3ef2fa579213fe547838f460971f2df not found: ID does not exist"
Jul 08 02:51:10.491229 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.491178    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6" podStartSLOduration=1.491163232 podStartE2EDuration="1.491163232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:51:10.489265462 +0000 UTC m=+672.218524331" watchObservedRunningTime="2026-07-08 02:51:10.491163232 +0000 UTC m=+672.220422155"
Jul 08 02:51:10.509788 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.509755    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"]
Jul 08 02:51:10.520595 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.520569    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s994p"]
Jul 08 02:51:10.726433 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:10.726345    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e8def7e-b3a3-4b17-8505-7920ab31389f" path="/var/lib/kubelet/pods/9e8def7e-b3a3-4b17-8505-7920ab31389f/volumes"
Jul 08 02:51:21.472389 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:21.472361    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"
Jul 08 02:51:21.521274 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:21.521248    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"]
Jul 08 02:51:21.521506 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:21.521478    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5" podUID="46c3ed4c-3d35-4441-9c79-dd1ab8e6e168" containerName="manager" containerID="cri-o://c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8" gracePeriod=10
Jul 08 02:51:21.785061 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:21.785038    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"
Jul 08 02:51:21.844402 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:21.844378    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168-extensions-socket-volume\") pod \"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168\" (UID: \"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168\") "
Jul 08 02:51:21.844551 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:21.844436    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8mh7\" (UniqueName: \"kubernetes.io/projected/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168-kube-api-access-q8mh7\") pod \"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168\" (UID: \"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168\") "
Jul 08 02:51:21.844807 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:21.844773    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "46c3ed4c-3d35-4441-9c79-dd1ab8e6e168" (UID: "46c3ed4c-3d35-4441-9c79-dd1ab8e6e168"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:51:21.846520 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:21.846496    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168-kube-api-access-q8mh7" (OuterVolumeSpecName: "kube-api-access-q8mh7") pod "46c3ed4c-3d35-4441-9c79-dd1ab8e6e168" (UID: "46c3ed4c-3d35-4441-9c79-dd1ab8e6e168"). InnerVolumeSpecName "kube-api-access-q8mh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:51:21.945659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:21.945636    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168-extensions-socket-volume\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:51:21.945659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:21.945657    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8mh7\" (UniqueName: \"kubernetes.io/projected/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168-kube-api-access-q8mh7\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:51:22.527867 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:22.527834    2580 generic.go:356] "Generic (PLEG): container finished" podID="46c3ed4c-3d35-4441-9c79-dd1ab8e6e168" containerID="c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8" exitCode=0
Jul 08 02:51:22.528228 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:22.527943    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"
Jul 08 02:51:22.528228 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:22.527974    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5" event={"ID":"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168","Type":"ContainerDied","Data":"c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8"}
Jul 08 02:51:22.528228 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:22.528027    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5" event={"ID":"46c3ed4c-3d35-4441-9c79-dd1ab8e6e168","Type":"ContainerDied","Data":"9ce672f77ae2aa731b4dc664008e85d1b5fc4fc6c6f2516870e318e3c0119881"}
Jul 08 02:51:22.528228 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:22.528050    2580 scope.go:117] "RemoveContainer" containerID="c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8"
Jul 08 02:51:22.537001 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:22.536987    2580 scope.go:117] "RemoveContainer" containerID="c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8"
Jul 08 02:51:22.537248 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:51:22.537222    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8\": container with ID starting with c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8 not found: ID does not exist" containerID="c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8"
Jul 08 02:51:22.537302 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:22.537249    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8"} err="failed to get container status \"c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8\": rpc error: code = NotFound desc = could not find container \"c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8\": container with ID starting with c599bd2b608a301897e69db974d8004d2d37d2c12d1f8dbfb34951bb190122d8 not found: ID does not exist"
Jul 08 02:51:22.548992 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:22.548970    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"]
Jul 08 02:51:22.556201 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:22.556179    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kpbq5"]
Jul 08 02:51:22.725507 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:22.725487    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46c3ed4c-3d35-4441-9c79-dd1ab8e6e168" path="/var/lib/kubelet/pods/46c3ed4c-3d35-4441-9c79-dd1ab8e6e168/volumes"
Jul 08 02:51:25.847747 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.847715    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"]
Jul 08 02:51:25.848222 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.848139    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e8def7e-b3a3-4b17-8505-7920ab31389f" containerName="manager"
Jul 08 02:51:25.848222 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.848151    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e8def7e-b3a3-4b17-8505-7920ab31389f" containerName="manager"
Jul 08 02:51:25.848222 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.848168    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46c3ed4c-3d35-4441-9c79-dd1ab8e6e168" containerName="manager"
Jul 08 02:51:25.848222 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.848176    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="46c3ed4c-3d35-4441-9c79-dd1ab8e6e168" containerName="manager"
Jul 08 02:51:25.848449 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.848299    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e8def7e-b3a3-4b17-8505-7920ab31389f" containerName="manager"
Jul 08 02:51:25.848449 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.848318    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="46c3ed4c-3d35-4441-9c79-dd1ab8e6e168" containerName="manager"
Jul 08 02:51:25.852641 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.852618    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.855127 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.855102    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-22465\""
Jul 08 02:51:25.855246 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.855132    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 02:51:25.863187 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.863157    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"]
Jul 08 02:51:25.876833 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.876791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8856c157-da16-42ba-98e3-31fc199bcb0e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.876947 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.876855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nljkx\" (UniqueName: \"kubernetes.io/projected/8856c157-da16-42ba-98e3-31fc199bcb0e-kube-api-access-nljkx\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.876947 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.876902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.876947 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.876924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8856c157-da16-42ba-98e3-31fc199bcb0e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.876947 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.876940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8856c157-da16-42ba-98e3-31fc199bcb0e-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.877095 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.876958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.877095 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.876994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.877095 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.877067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.877095 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.877090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.978062 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nljkx\" (UniqueName: \"kubernetes.io/projected/8856c157-da16-42ba-98e3-31fc199bcb0e-kube-api-access-nljkx\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.978247 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.978247 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8856c157-da16-42ba-98e3-31fc199bcb0e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.978247 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8856c157-da16-42ba-98e3-31fc199bcb0e-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.978247 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.978247 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978168    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.978247 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.978247 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.978659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8856c157-da16-42ba-98e3-31fc199bcb0e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.978711 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978651    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.978762 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978719    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.978762 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978730    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.979077 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978791    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.979077 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.978965    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8856c157-da16-42ba-98e3-31fc199bcb0e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.980617 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.980592    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8856c157-da16-42ba-98e3-31fc199bcb0e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.981028 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.981009    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8856c157-da16-42ba-98e3-31fc199bcb0e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.985436 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.985414    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8856c157-da16-42ba-98e3-31fc199bcb0e-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:25.985726 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:25.985708    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nljkx\" (UniqueName: \"kubernetes.io/projected/8856c157-da16-42ba-98e3-31fc199bcb0e-kube-api-access-nljkx\") pod \"maas-default-gateway-openshift-default-5896d4dd49-v6b4m\" (UID: \"8856c157-da16-42ba-98e3-31fc199bcb0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:26.163927 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:26.163856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:26.311968 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:26.311944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"]
Jul 08 02:51:26.313717 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:51:26.313688    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8856c157_da16_42ba_98e3_31fc199bcb0e.slice/crio-e2869f52fda530d4831d98c0fcb5a14b0db8f41d8f80705cdbbeb4759fdc3034 WatchSource:0}: Error finding container e2869f52fda530d4831d98c0fcb5a14b0db8f41d8f80705cdbbeb4759fdc3034: Status 404 returned error can't find the container with id e2869f52fda530d4831d98c0fcb5a14b0db8f41d8f80705cdbbeb4759fdc3034
Jul 08 02:51:26.550984 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:26.550951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m" event={"ID":"8856c157-da16-42ba-98e3-31fc199bcb0e","Type":"ContainerStarted","Data":"e2869f52fda530d4831d98c0fcb5a14b0db8f41d8f80705cdbbeb4759fdc3034"}
Jul 08 02:51:29.636981 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:29.636946    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 02:51:29.637339 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:29.637032    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 02:51:29.637339 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:29.637077    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 02:51:30.573970 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:30.573932    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m" event={"ID":"8856c157-da16-42ba-98e3-31fc199bcb0e","Type":"ContainerStarted","Data":"7a697e9e240509a64eeee7aa36c622977afe9d0cb0ef0735414ff7575ffc701d"}
Jul 08 02:51:30.595639 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:30.595598    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m" podStartSLOduration=2.274583019 podStartE2EDuration="5.595584069s" totalImagesPullingTime="3.32100105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:51:30.594065372 +0000 UTC m=+692.323324252" watchObservedRunningTime="2026-07-08 02:51:30.595584069 +0000 UTC m=+692.324842927"
Jul 08 02:51:31.164564 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:31.164532    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:31.169096 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:31.169075    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:31.579666 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:31.579638    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:31.580400 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:31.580384    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:51:38.309155 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.309120    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-br66t"]
Jul 08 02:51:38.313196 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.313173    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t"
Jul 08 02:51:38.315670 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.315648    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 02:51:38.315819 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.315676    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vrdv4\""
Jul 08 02:51:38.323374 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.323348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-br66t"]
Jul 08 02:51:38.396346 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.396313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z6fz\" (UniqueName: \"kubernetes.io/projected/cd9054b1-44a1-446f-8f28-0d2607d59f73-kube-api-access-9z6fz\") pod \"limitador-limitador-64c94fd64f-br66t\" (UID: \"cd9054b1-44a1-446f-8f28-0d2607d59f73\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t"
Jul 08 02:51:38.396514 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.396464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cd9054b1-44a1-446f-8f28-0d2607d59f73-config-file\") pod \"limitador-limitador-64c94fd64f-br66t\" (UID: \"cd9054b1-44a1-446f-8f28-0d2607d59f73\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t"
Jul 08 02:51:38.413976 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.413946    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-br66t"]
Jul 08 02:51:38.496985 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.496959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cd9054b1-44a1-446f-8f28-0d2607d59f73-config-file\") pod \"limitador-limitador-64c94fd64f-br66t\" (UID: \"cd9054b1-44a1-446f-8f28-0d2607d59f73\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t"
Jul 08 02:51:38.497111 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.497038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z6fz\" (UniqueName: \"kubernetes.io/projected/cd9054b1-44a1-446f-8f28-0d2607d59f73-kube-api-access-9z6fz\") pod \"limitador-limitador-64c94fd64f-br66t\" (UID: \"cd9054b1-44a1-446f-8f28-0d2607d59f73\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t"
Jul 08 02:51:38.497646 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.497627    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cd9054b1-44a1-446f-8f28-0d2607d59f73-config-file\") pod \"limitador-limitador-64c94fd64f-br66t\" (UID: \"cd9054b1-44a1-446f-8f28-0d2607d59f73\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t"
Jul 08 02:51:38.505559 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.505535    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z6fz\" (UniqueName: \"kubernetes.io/projected/cd9054b1-44a1-446f-8f28-0d2607d59f73-kube-api-access-9z6fz\") pod \"limitador-limitador-64c94fd64f-br66t\" (UID: \"cd9054b1-44a1-446f-8f28-0d2607d59f73\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t"
Jul 08 02:51:38.625432 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.625360    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t"
Jul 08 02:51:38.729194 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.729165    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:51:38.733722 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.733700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"
Jul 08 02:51:38.746074 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.746026    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:51:38.783993 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.783972    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-br66t"]
Jul 08 02:51:38.786654 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:51:38.786619    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd9054b1_44a1_446f_8f28_0d2607d59f73.slice/crio-131ca96cd65df34b63fb731adec676fa7b01fb070fbed426b754a72bec3170e3 WatchSource:0}: Error finding container 131ca96cd65df34b63fb731adec676fa7b01fb070fbed426b754a72bec3170e3: Status 404 returned error can't find the container with id 131ca96cd65df34b63fb731adec676fa7b01fb070fbed426b754a72bec3170e3
Jul 08 02:51:38.798276 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.798255    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:51:38.799413 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.799318    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdpcv\" (UniqueName: \"kubernetes.io/projected/8eefb65a-6cfe-4612-b28d-f99f9c8e75b0-kube-api-access-vdpcv\") pod \"limitador-limitador-54d6d988d5-qgj9l\" (UID: \"8eefb65a-6cfe-4612-b28d-f99f9c8e75b0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"
Jul 08 02:51:38.799509 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.799467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8eefb65a-6cfe-4612-b28d-f99f9c8e75b0-config-file\") pod \"limitador-limitador-54d6d988d5-qgj9l\" (UID: \"8eefb65a-6cfe-4612-b28d-f99f9c8e75b0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"
Jul 08 02:51:38.900031 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.899977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdpcv\" (UniqueName: \"kubernetes.io/projected/8eefb65a-6cfe-4612-b28d-f99f9c8e75b0-kube-api-access-vdpcv\") pod \"limitador-limitador-54d6d988d5-qgj9l\" (UID: \"8eefb65a-6cfe-4612-b28d-f99f9c8e75b0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"
Jul 08 02:51:38.900031 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.900009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8eefb65a-6cfe-4612-b28d-f99f9c8e75b0-config-file\") pod \"limitador-limitador-54d6d988d5-qgj9l\" (UID: \"8eefb65a-6cfe-4612-b28d-f99f9c8e75b0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"
Jul 08 02:51:38.900543 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.900525    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8eefb65a-6cfe-4612-b28d-f99f9c8e75b0-config-file\") pod \"limitador-limitador-54d6d988d5-qgj9l\" (UID: \"8eefb65a-6cfe-4612-b28d-f99f9c8e75b0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"
Jul 08 02:51:38.908123 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:38.908103    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdpcv\" (UniqueName: \"kubernetes.io/projected/8eefb65a-6cfe-4612-b28d-f99f9c8e75b0-kube-api-access-vdpcv\") pod \"limitador-limitador-54d6d988d5-qgj9l\" (UID: \"8eefb65a-6cfe-4612-b28d-f99f9c8e75b0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"
Jul 08 02:51:39.047885 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:39.047862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"
Jul 08 02:51:39.203816 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:39.203751    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:51:39.205863 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:51:39.205840    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eefb65a_6cfe_4612_b28d_f99f9c8e75b0.slice/crio-6adab8c98a1258d71aaf2231dcf81921ffa6f77adb3235bcaca66a7aa662fd09 WatchSource:0}: Error finding container 6adab8c98a1258d71aaf2231dcf81921ffa6f77adb3235bcaca66a7aa662fd09: Status 404 returned error can't find the container with id 6adab8c98a1258d71aaf2231dcf81921ffa6f77adb3235bcaca66a7aa662fd09
Jul 08 02:51:39.628024 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:39.627983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t" event={"ID":"cd9054b1-44a1-446f-8f28-0d2607d59f73","Type":"ContainerStarted","Data":"131ca96cd65df34b63fb731adec676fa7b01fb070fbed426b754a72bec3170e3"}
Jul 08 02:51:39.629920 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:39.629891    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l" event={"ID":"8eefb65a-6cfe-4612-b28d-f99f9c8e75b0","Type":"ContainerStarted","Data":"6adab8c98a1258d71aaf2231dcf81921ffa6f77adb3235bcaca66a7aa662fd09"}
Jul 08 02:51:42.653820 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:42.653757    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t" event={"ID":"cd9054b1-44a1-446f-8f28-0d2607d59f73","Type":"ContainerStarted","Data":"3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55"}
Jul 08 02:51:42.654274 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:42.653855    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t"
Jul 08 02:51:42.655434 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:42.655410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l" event={"ID":"8eefb65a-6cfe-4612-b28d-f99f9c8e75b0","Type":"ContainerStarted","Data":"34136fad4880d4d0131c87ab91e8922235e11de1e261fcb35c3b7426b105b6ab"}
Jul 08 02:51:42.655538 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:42.655472    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"
Jul 08 02:51:42.671878 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:42.671831    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t" podStartSLOduration=1.673750945 podStartE2EDuration="4.671817738s" totalImagesPullingTime="2.998066793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:51:42.669934302 +0000 UTC m=+704.399193160" watchObservedRunningTime="2026-07-08 02:51:42.671817738 +0000 UTC m=+704.401076592"
Jul 08 02:51:42.686783 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:42.686742    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l" podStartSLOduration=2.101369857 podStartE2EDuration="4.686730373s" totalImagesPullingTime="2.585360516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:51:42.684554465 +0000 UTC m=+704.413813324" watchObservedRunningTime="2026-07-08 02:51:42.686730373 +0000 UTC m=+704.415989291"
Jul 08 02:51:53.662681 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:53.662651    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t"
Jul 08 02:51:53.663151 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:53.662725    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"
Jul 08 02:51:53.773101 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:53.769255    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-br66t"]
Jul 08 02:51:53.773101 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:53.769528    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t" podUID="cd9054b1-44a1-446f-8f28-0d2607d59f73" containerName="limitador" containerID="cri-o://3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55" gracePeriod=30
Jul 08 02:51:54.325209 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.325187    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t"
Jul 08 02:51:54.446637 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.446556    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z6fz\" (UniqueName: \"kubernetes.io/projected/cd9054b1-44a1-446f-8f28-0d2607d59f73-kube-api-access-9z6fz\") pod \"cd9054b1-44a1-446f-8f28-0d2607d59f73\" (UID: \"cd9054b1-44a1-446f-8f28-0d2607d59f73\") "
Jul 08 02:51:54.446777 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.446661    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cd9054b1-44a1-446f-8f28-0d2607d59f73-config-file\") pod \"cd9054b1-44a1-446f-8f28-0d2607d59f73\" (UID: \"cd9054b1-44a1-446f-8f28-0d2607d59f73\") "
Jul 08 02:51:54.447028 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.447008    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd9054b1-44a1-446f-8f28-0d2607d59f73-config-file" (OuterVolumeSpecName: "config-file") pod "cd9054b1-44a1-446f-8f28-0d2607d59f73" (UID: "cd9054b1-44a1-446f-8f28-0d2607d59f73"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:51:54.448747 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.448715    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd9054b1-44a1-446f-8f28-0d2607d59f73-kube-api-access-9z6fz" (OuterVolumeSpecName: "kube-api-access-9z6fz") pod "cd9054b1-44a1-446f-8f28-0d2607d59f73" (UID: "cd9054b1-44a1-446f-8f28-0d2607d59f73"). InnerVolumeSpecName "kube-api-access-9z6fz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:51:54.547424 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.547389    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cd9054b1-44a1-446f-8f28-0d2607d59f73-config-file\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:51:54.547424 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.547421    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z6fz\" (UniqueName: \"kubernetes.io/projected/cd9054b1-44a1-446f-8f28-0d2607d59f73-kube-api-access-9z6fz\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 02:51:54.728372 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.728300    2580 generic.go:356] "Generic (PLEG): container finished" podID="cd9054b1-44a1-446f-8f28-0d2607d59f73" containerID="3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55" exitCode=0
Jul 08 02:51:54.728372 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.728340    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t"
Jul 08 02:51:54.728825 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.728391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t" event={"ID":"cd9054b1-44a1-446f-8f28-0d2607d59f73","Type":"ContainerDied","Data":"3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55"}
Jul 08 02:51:54.728825 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.728450    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-br66t" event={"ID":"cd9054b1-44a1-446f-8f28-0d2607d59f73","Type":"ContainerDied","Data":"131ca96cd65df34b63fb731adec676fa7b01fb070fbed426b754a72bec3170e3"}
Jul 08 02:51:54.728825 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.728484    2580 scope.go:117] "RemoveContainer" containerID="3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55"
Jul 08 02:51:54.737613 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.737598    2580 scope.go:117] "RemoveContainer" containerID="3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55"
Jul 08 02:51:54.737903 ip-10-0-132-232 kubenswrapper[2580]: E0708 02:51:54.737880    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55\": container with ID starting with 3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55 not found: ID does not exist" containerID="3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55"
Jul 08 02:51:54.737973 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.737913    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55"} err="failed to get container status \"3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55\": rpc error: code = NotFound desc = could not find container \"3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55\": container with ID starting with 3f3cbab1f63ca3a7f1eb3fa7567e61c5d759249c96c8ad2811209163fa7f8f55 not found: ID does not exist"
Jul 08 02:51:54.752962 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.752939    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-br66t"]
Jul 08 02:51:54.763125 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:54.763107    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-br66t"]
Jul 08 02:51:56.728353 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:51:56.728324    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd9054b1-44a1-446f-8f28-0d2607d59f73" path="/var/lib/kubelet/pods/cd9054b1-44a1-446f-8f28-0d2607d59f73/volumes"
Jul 08 02:52:51.942758 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:51.942714    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2h8n5"]
Jul 08 02:52:51.943385 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:51.943362    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd9054b1-44a1-446f-8f28-0d2607d59f73" containerName="limitador"
Jul 08 02:52:51.943464 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:51.943389    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd9054b1-44a1-446f-8f28-0d2607d59f73" containerName="limitador"
Jul 08 02:52:51.943535 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:51.943522    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd9054b1-44a1-446f-8f28-0d2607d59f73" containerName="limitador"
Jul 08 02:52:51.946969 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:51.946945    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5"
Jul 08 02:52:51.949309 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:51.949289    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 02:52:51.957915 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:51.957885    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2h8n5"]
Jul 08 02:52:51.987889 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:51.987852    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-vkp9t"]
Jul 08 02:52:51.991517 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:51.991498    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-vkp9t"
Jul 08 02:52:51.994201 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:51.994183    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rpt5t\""
Jul 08 02:52:52.003677 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.003653    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-vkp9t"]
Jul 08 02:52:52.039206 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.039178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:52:52.120791 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.120755    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9d50934-5131-4a8c-9228-0bd186d4fe32-plugins-config-volume\") pod \"payload-processing-58f86c7798-vkp9t\" (UID: \"e9d50934-5131-4a8c-9228-0bd186d4fe32\") " pod="openshift-ingress/payload-processing-58f86c7798-vkp9t"
Jul 08 02:52:52.120968 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.120825    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b7ccbf6-f838-41a1-b4e1-c75253f741f2-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2h8n5\" (UID: \"1b7ccbf6-f838-41a1-b4e1-c75253f741f2\") " pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5"
Jul 08 02:52:52.120968 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.120961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dswbg\" (UniqueName: \"kubernetes.io/projected/1b7ccbf6-f838-41a1-b4e1-c75253f741f2-kube-api-access-dswbg\") pod \"payload-pre-processing-7964457696-2h8n5\" (UID: \"1b7ccbf6-f838-41a1-b4e1-c75253f741f2\") " pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5"
Jul 08 02:52:52.121045 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.121004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjpwv\" (UniqueName: \"kubernetes.io/projected/e9d50934-5131-4a8c-9228-0bd186d4fe32-kube-api-access-rjpwv\") pod \"payload-processing-58f86c7798-vkp9t\" (UID: \"e9d50934-5131-4a8c-9228-0bd186d4fe32\") " pod="openshift-ingress/payload-processing-58f86c7798-vkp9t"
Jul 08 02:52:52.222504 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.222418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dswbg\" (UniqueName: \"kubernetes.io/projected/1b7ccbf6-f838-41a1-b4e1-c75253f741f2-kube-api-access-dswbg\") pod \"payload-pre-processing-7964457696-2h8n5\" (UID: \"1b7ccbf6-f838-41a1-b4e1-c75253f741f2\") " pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5"
Jul 08 02:52:52.222504 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.222459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjpwv\" (UniqueName: \"kubernetes.io/projected/e9d50934-5131-4a8c-9228-0bd186d4fe32-kube-api-access-rjpwv\") pod \"payload-processing-58f86c7798-vkp9t\" (UID: \"e9d50934-5131-4a8c-9228-0bd186d4fe32\") " pod="openshift-ingress/payload-processing-58f86c7798-vkp9t"
Jul 08 02:52:52.222734 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.222511    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9d50934-5131-4a8c-9228-0bd186d4fe32-plugins-config-volume\") pod \"payload-processing-58f86c7798-vkp9t\" (UID: \"e9d50934-5131-4a8c-9228-0bd186d4fe32\") " pod="openshift-ingress/payload-processing-58f86c7798-vkp9t"
Jul 08 02:52:52.222734 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.222530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b7ccbf6-f838-41a1-b4e1-c75253f741f2-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2h8n5\" (UID: \"1b7ccbf6-f838-41a1-b4e1-c75253f741f2\") " pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5"
Jul 08 02:52:52.223484 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.223460    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9d50934-5131-4a8c-9228-0bd186d4fe32-plugins-config-volume\") pod \"payload-processing-58f86c7798-vkp9t\" (UID: \"e9d50934-5131-4a8c-9228-0bd186d4fe32\") " pod="openshift-ingress/payload-processing-58f86c7798-vkp9t"
Jul 08 02:52:52.223525 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.223460    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b7ccbf6-f838-41a1-b4e1-c75253f741f2-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2h8n5\" (UID: \"1b7ccbf6-f838-41a1-b4e1-c75253f741f2\") " pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5"
Jul 08 02:52:52.230438 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.230411    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjpwv\" (UniqueName: \"kubernetes.io/projected/e9d50934-5131-4a8c-9228-0bd186d4fe32-kube-api-access-rjpwv\") pod \"payload-processing-58f86c7798-vkp9t\" (UID: \"e9d50934-5131-4a8c-9228-0bd186d4fe32\") " pod="openshift-ingress/payload-processing-58f86c7798-vkp9t"
Jul 08 02:52:52.230541 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.230490    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dswbg\" (UniqueName: \"kubernetes.io/projected/1b7ccbf6-f838-41a1-b4e1-c75253f741f2-kube-api-access-dswbg\") pod \"payload-pre-processing-7964457696-2h8n5\" (UID: \"1b7ccbf6-f838-41a1-b4e1-c75253f741f2\") " pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5"
Jul 08 02:52:52.258928 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.258902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5"
Jul 08 02:52:52.304164 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.304136    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-vkp9t"
Jul 08 02:52:52.423207 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.423176    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2h8n5"]
Jul 08 02:52:52.426085 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:52:52.425984    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b7ccbf6_f838_41a1_b4e1_c75253f741f2.slice/crio-f85d153f4ab9895e3d8b06fd64037ed8c0aeff7235e56f9f00572f5ed20011ff WatchSource:0}: Error finding container f85d153f4ab9895e3d8b06fd64037ed8c0aeff7235e56f9f00572f5ed20011ff: Status 404 returned error can't find the container with id f85d153f4ab9895e3d8b06fd64037ed8c0aeff7235e56f9f00572f5ed20011ff
Jul 08 02:52:52.472113 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:52.472086    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-vkp9t"]
Jul 08 02:52:52.473922 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:52:52.473856    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d50934_5131_4a8c_9228_0bd186d4fe32.slice/crio-363bd7e4d2a0e3314801dd701c83dbaa98e2b1f8d05b9822901ff9ec3806a250 WatchSource:0}: Error finding container 363bd7e4d2a0e3314801dd701c83dbaa98e2b1f8d05b9822901ff9ec3806a250: Status 404 returned error can't find the container with id 363bd7e4d2a0e3314801dd701c83dbaa98e2b1f8d05b9822901ff9ec3806a250
Jul 08 02:52:53.030245 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:53.030199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-vkp9t" event={"ID":"e9d50934-5131-4a8c-9228-0bd186d4fe32","Type":"ContainerStarted","Data":"363bd7e4d2a0e3314801dd701c83dbaa98e2b1f8d05b9822901ff9ec3806a250"}
Jul 08 02:52:53.031392 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:53.031368    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5" event={"ID":"1b7ccbf6-f838-41a1-b4e1-c75253f741f2","Type":"ContainerStarted","Data":"f85d153f4ab9895e3d8b06fd64037ed8c0aeff7235e56f9f00572f5ed20011ff"}
Jul 08 02:52:55.042725 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:55.042689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-vkp9t" event={"ID":"e9d50934-5131-4a8c-9228-0bd186d4fe32","Type":"ContainerStarted","Data":"6fa9efd8b9f8ec95ce93ee4b2893b622e47c8e581144f9d9e224c785415a229f"}
Jul 08 02:52:55.043191 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:55.042757    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-vkp9t"
Jul 08 02:52:55.044241 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:55.044217    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5" event={"ID":"1b7ccbf6-f838-41a1-b4e1-c75253f741f2","Type":"ContainerStarted","Data":"ec7c8bf8941b344842df55c3788a30ae8b8ba5926f9394ff2d85edbce29cec5b"}
Jul 08 02:52:55.044360 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:55.044261    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5"
Jul 08 02:52:55.065010 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:55.064971    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-vkp9t" podStartSLOduration=2.494090957 podStartE2EDuration="4.064957835s" totalImagesPullingTime="1.570866878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:52:55.0631741 +0000 UTC m=+776.792432957" watchObservedRunningTime="2026-07-08 02:52:55.064957835 +0000 UTC m=+776.794216693"
Jul 08 02:52:55.087492 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:52:55.087448    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5" podStartSLOduration=2.466438892 podStartE2EDuration="4.087435532s" totalImagesPullingTime="1.62099664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:52:55.087296882 +0000 UTC m=+776.816555752" watchObservedRunningTime="2026-07-08 02:52:55.087435532 +0000 UTC m=+776.816694389"
Jul 08 02:53:00.072907 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:00.072871    2580 generic.go:356] "Generic (PLEG): container finished" podID="8856c157-da16-42ba-98e3-31fc199bcb0e" containerID="7a697e9e240509a64eeee7aa36c622977afe9d0cb0ef0735414ff7575ffc701d" exitCode=0
Jul 08 02:53:00.073409 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:00.072952    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m" event={"ID":"8856c157-da16-42ba-98e3-31fc199bcb0e","Type":"ContainerDied","Data":"7a697e9e240509a64eeee7aa36c622977afe9d0cb0ef0735414ff7575ffc701d"}
Jul 08 02:53:00.073529 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:00.073512    2580 scope.go:117] "RemoveContainer" containerID="7a697e9e240509a64eeee7aa36c622977afe9d0cb0ef0735414ff7575ffc701d"
Jul 08 02:53:00.074549 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:00.074526    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 02:53:00.074603 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:00.074592    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 02:53:00.074635 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:00.074624    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 02:53:01.080601 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:01.080564    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m" event={"ID":"8856c157-da16-42ba-98e3-31fc199bcb0e","Type":"ContainerStarted","Data":"fa6e289425ef456e90cdbc70ad68f9a048c6e9fc17c401d318e1785da02eee18"}
Jul 08 02:53:01.164486 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:01.164451    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:53:01.165419 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:01.165390    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-v6b4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 08 02:53:01.165522 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:01.165445    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m" podUID="8856c157-da16-42ba-98e3-31fc199bcb0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 08 02:53:01.580154 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:01.580123    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:53:02.164688 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:02.164653    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-v6b4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 08 02:53:02.165085 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:02.164708    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m" podUID="8856c157-da16-42ba-98e3-31fc199bcb0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 08 02:53:03.164501 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:03.164469    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-v6b4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 08 02:53:03.164672 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:03.164538    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m" podUID="8856c157-da16-42ba-98e3-31fc199bcb0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 08 02:53:04.164732 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:04.164692    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-v6b4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 08 02:53:04.165153 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:04.164765    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m" podUID="8856c157-da16-42ba-98e3-31fc199bcb0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 08 02:53:05.168765 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:05.168735    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:53:05.169878 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:05.169861    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-v6b4m"
Jul 08 02:53:06.051272 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:06.051244    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-vkp9t"
Jul 08 02:53:06.051634 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:06.051618    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-2h8n5"
Jul 08 02:53:07.991297 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:07.991267    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:53:38.681349 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.681271    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"]
Jul 08 02:53:38.685302 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.685281    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.691247 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.691224    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 02:53:38.692059 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.692034    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 08 02:53:38.692182 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.692087    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 02:53:38.692182 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.692104    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4sql4\""
Jul 08 02:53:38.708223 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.708198    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"]
Jul 08 02:53:38.837102 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.837070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f586049-142c-4b87-ba46-f3e2169ab23c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.837288 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.837149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f586049-142c-4b87-ba46-f3e2169ab23c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.837288 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.837234    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f586049-142c-4b87-ba46-f3e2169ab23c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.837288 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.837285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f586049-142c-4b87-ba46-f3e2169ab23c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.837495 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.837323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qqk7\" (UniqueName: \"kubernetes.io/projected/5f586049-142c-4b87-ba46-f3e2169ab23c-kube-api-access-7qqk7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.837495 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.837353    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f586049-142c-4b87-ba46-f3e2169ab23c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.938206 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.938121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f586049-142c-4b87-ba46-f3e2169ab23c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.938206 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.938164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qqk7\" (UniqueName: \"kubernetes.io/projected/5f586049-142c-4b87-ba46-f3e2169ab23c-kube-api-access-7qqk7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.938206 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.938182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f586049-142c-4b87-ba46-f3e2169ab23c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.938485 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.938230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f586049-142c-4b87-ba46-f3e2169ab23c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.938485 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.938252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f586049-142c-4b87-ba46-f3e2169ab23c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.938485 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.938306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f586049-142c-4b87-ba46-f3e2169ab23c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.938638 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.938613    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f586049-142c-4b87-ba46-f3e2169ab23c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.938712 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.938684    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f586049-142c-4b87-ba46-f3e2169ab23c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.938758 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.938711    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f586049-142c-4b87-ba46-f3e2169ab23c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.940679 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.940650    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f586049-142c-4b87-ba46-f3e2169ab23c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.940907 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.940891    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f586049-142c-4b87-ba46-f3e2169ab23c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.949529 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.949498    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qqk7\" (UniqueName: \"kubernetes.io/projected/5f586049-142c-4b87-ba46-f3e2169ab23c-kube-api-access-7qqk7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjvmb\" (UID: \"5f586049-142c-4b87-ba46-f3e2169ab23c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:38.997175 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:38.997142    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:39.149849 ip-10-0-132-232 kubenswrapper[2580]: W0708 02:53:39.149792    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f586049_142c_4b87_ba46_f3e2169ab23c.slice/crio-71a9168d10bf95f3aacf186d950c2232cfb832ac5ce4435ef488424917e1e7d9 WatchSource:0}: Error finding container 71a9168d10bf95f3aacf186d950c2232cfb832ac5ce4435ef488424917e1e7d9: Status 404 returned error can't find the container with id 71a9168d10bf95f3aacf186d950c2232cfb832ac5ce4435ef488424917e1e7d9
Jul 08 02:53:39.150995 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:39.150969    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"]
Jul 08 02:53:39.287657 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:39.287623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb" event={"ID":"5f586049-142c-4b87-ba46-f3e2169ab23c","Type":"ContainerStarted","Data":"71a9168d10bf95f3aacf186d950c2232cfb832ac5ce4435ef488424917e1e7d9"}
Jul 08 02:53:39.779771 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:39.779734    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:53:40.296062 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:40.296025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb" event={"ID":"5f586049-142c-4b87-ba46-f3e2169ab23c","Type":"ContainerStarted","Data":"d42207826491795b84429dd2c2b498d212e0eccd4456f4a0e63bba2e79609be0"}
Jul 08 02:53:40.347832 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:40.347762    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb" podStartSLOduration=1.302414031 podStartE2EDuration="2.347745544s" totalImagesPullingTime="1.045331513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:53:40.345637488 +0000 UTC m=+822.074896345" watchObservedRunningTime="2026-07-08 02:53:40.347745544 +0000 UTC m=+822.077004448"
Jul 08 02:53:48.997366 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:48.997323    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:48.997859 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:48.997406    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:49.009851 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:49.009824    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:53:49.356605 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:53:49.356579    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjvmb"
Jul 08 02:54:11.655107 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:54:11.655073    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:54:26.158546 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:54:26.158512    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:54:48.950719 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:54:48.950691    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:54:57.154995 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:54:57.154961    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:55:01.204216 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:55:01.204183    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 02:55:01.206697 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:55:01.206678    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 02:56:12.447659 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:56:12.447630    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:56:24.158564 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:56:24.158489    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:56:31.857991 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:56:31.857951    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:56:42.547507 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:56:42.547469    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:56:54.246724 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:56:54.246688    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:57:02.967256 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:57:02.967222    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:57:27.157547 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:57:27.157511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:57:38.760815 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:57:38.760763    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:58:13.551079 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:58:13.551047    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:58:22.845105 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:58:22.845072    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:58:33.252674 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:58:33.252638    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:58:38.845076 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:58:38.845036    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:58:48.851098 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:58:48.851059    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:58:59.651789 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:58:59.651756    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:59:10.655944 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:59:10.655909    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:59:20.555633 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:59:20.555548    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:59:42.781294 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:59:42.781260    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 02:59:55.358960 ip-10-0-132-232 kubenswrapper[2580]: I0708 02:59:55.358924    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:00:00.148002 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:00.147967    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"]
Jul 08 03:00:00.151906 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:00.151880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"
Jul 08 03:00:00.154392 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:00.154370    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 03:00:00.154493 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:00.154370    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 03:00:00.155061 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:00.155041    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h8t2l\""
Jul 08 03:00:00.166470 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:00.166451    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"]
Jul 08 03:00:00.248775 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:00.248745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgkpd\" (UniqueName: \"kubernetes.io/projected/1613205b-0be0-4bba-a037-dbfd56dbe846-kube-api-access-tgkpd\") pod \"maas-api-key-cleanup-29724660-mgw28\" (UID: \"1613205b-0be0-4bba-a037-dbfd56dbe846\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"
Jul 08 03:00:00.349935 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:00.349904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgkpd\" (UniqueName: \"kubernetes.io/projected/1613205b-0be0-4bba-a037-dbfd56dbe846-kube-api-access-tgkpd\") pod \"maas-api-key-cleanup-29724660-mgw28\" (UID: \"1613205b-0be0-4bba-a037-dbfd56dbe846\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"
Jul 08 03:00:00.359370 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:00.359343    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgkpd\" (UniqueName: \"kubernetes.io/projected/1613205b-0be0-4bba-a037-dbfd56dbe846-kube-api-access-tgkpd\") pod \"maas-api-key-cleanup-29724660-mgw28\" (UID: \"1613205b-0be0-4bba-a037-dbfd56dbe846\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"
Jul 08 03:00:00.462455 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:00.462373    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"
Jul 08 03:00:00.607416 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:00.607391    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"]
Jul 08 03:00:00.609422 ip-10-0-132-232 kubenswrapper[2580]: W0708 03:00:00.609398    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1613205b_0be0_4bba_a037_dbfd56dbe846.slice/crio-d973f11653be0a541d1dfbe53aa760224c37abf1a6722f6e328b9a5363cca277 WatchSource:0}: Error finding container d973f11653be0a541d1dfbe53aa760224c37abf1a6722f6e328b9a5363cca277: Status 404 returned error can't find the container with id d973f11653be0a541d1dfbe53aa760224c37abf1a6722f6e328b9a5363cca277
Jul 08 03:00:00.611366 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:00.611351    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 03:00:01.237164 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:01.237138    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 03:00:01.240949 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:01.240931    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 03:00:01.328851 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:01.328810    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28" event={"ID":"1613205b-0be0-4bba-a037-dbfd56dbe846","Type":"ContainerStarted","Data":"d973f11653be0a541d1dfbe53aa760224c37abf1a6722f6e328b9a5363cca277"}
Jul 08 03:00:08.371080 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:08.371042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28" event={"ID":"1613205b-0be0-4bba-a037-dbfd56dbe846","Type":"ContainerStarted","Data":"7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380"}
Jul 08 03:00:08.388551 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:08.388501    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28" podStartSLOduration=1.658512758 podStartE2EDuration="8.388484841s" totalImagesPullingTime="6.729972083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:00:08.387509347 +0000 UTC m=+1210.116768206" watchObservedRunningTime="2026-07-08 03:00:08.388484841 +0000 UTC m=+1210.117743699"
Jul 08 03:00:17.857389 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:17.857349    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:00:27.688346 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:27.688308    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:00:43.554942 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:43.554908    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:00:54.160814 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:00:54.160774    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:01:00.010190 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:00.010159    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"]
Jul 08 03:01:00.010577 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:00.010362    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28" podUID="1613205b-0be0-4bba-a037-dbfd56dbe846" containerName="cleanup" containerID="cri-o://7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380" gracePeriod=30
Jul 08 03:01:03.863146 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:03.863105    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:01:13.452125 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:13.452093    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:01:23.260415 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:23.260380    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:01:30.199183 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.199146    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"
Jul 08 03:01:30.228845 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.228818    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgkpd\" (UniqueName: \"kubernetes.io/projected/1613205b-0be0-4bba-a037-dbfd56dbe846-kube-api-access-tgkpd\") pod \"1613205b-0be0-4bba-a037-dbfd56dbe846\" (UID: \"1613205b-0be0-4bba-a037-dbfd56dbe846\") "
Jul 08 03:01:30.231121 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.231089    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1613205b-0be0-4bba-a037-dbfd56dbe846-kube-api-access-tgkpd" (OuterVolumeSpecName: "kube-api-access-tgkpd") pod "1613205b-0be0-4bba-a037-dbfd56dbe846" (UID: "1613205b-0be0-4bba-a037-dbfd56dbe846"). InnerVolumeSpecName "kube-api-access-tgkpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:01:30.330126 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.330041    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgkpd\" (UniqueName: \"kubernetes.io/projected/1613205b-0be0-4bba-a037-dbfd56dbe846-kube-api-access-tgkpd\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:01:30.825344 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.825303    2580 generic.go:356] "Generic (PLEG): container finished" podID="1613205b-0be0-4bba-a037-dbfd56dbe846" containerID="7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380" exitCode=137
Jul 08 03:01:30.825485 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.825348    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"
Jul 08 03:01:30.825485 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.825353    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28" event={"ID":"1613205b-0be0-4bba-a037-dbfd56dbe846","Type":"ContainerDied","Data":"7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380"}
Jul 08 03:01:30.825485 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.825395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28" event={"ID":"1613205b-0be0-4bba-a037-dbfd56dbe846","Type":"ContainerDied","Data":"d973f11653be0a541d1dfbe53aa760224c37abf1a6722f6e328b9a5363cca277"}
Jul 08 03:01:30.825485 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.825416    2580 scope.go:117] "RemoveContainer" containerID="7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380"
Jul 08 03:01:30.834133 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.834112    2580 scope.go:117] "RemoveContainer" containerID="7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380"
Jul 08 03:01:30.834422 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:01:30.834402    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380\": container with ID starting with 7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380 not found: ID does not exist" containerID="7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380"
Jul 08 03:01:30.834506 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.834428    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380"} err="failed to get container status \"7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380\": rpc error: code = NotFound desc = could not find container \"7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380\": container with ID starting with 7c09bd1659752494d177040156cbc4132ce5146946ce3ba3ef9c4a61b037b380 not found: ID does not exist"
Jul 08 03:01:30.843335 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.843316    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"]
Jul 08 03:01:30.849892 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:30.849872    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724660-mgw28"]
Jul 08 03:01:32.726219 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:32.726183    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1613205b-0be0-4bba-a037-dbfd56dbe846" path="/var/lib/kubelet/pods/1613205b-0be0-4bba-a037-dbfd56dbe846/volumes"
Jul 08 03:01:48.637057 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:48.637004    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"]
Jul 08 03:01:48.637522 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:48.637356    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6" podUID="d9ad42b6-271b-4971-89b9-02279fe15544" containerName="manager" containerID="cri-o://011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd" gracePeriod=10
Jul 08 03:01:51.908231 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:51.908204    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"
Jul 08 03:01:51.943700 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:51.943672    2580 generic.go:356] "Generic (PLEG): container finished" podID="d9ad42b6-271b-4971-89b9-02279fe15544" containerID="011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd" exitCode=0
Jul 08 03:01:51.943883 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:51.943719    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"
Jul 08 03:01:51.943883 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:51.943729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6" event={"ID":"d9ad42b6-271b-4971-89b9-02279fe15544","Type":"ContainerDied","Data":"011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd"}
Jul 08 03:01:51.943883 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:51.943780    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6" event={"ID":"d9ad42b6-271b-4971-89b9-02279fe15544","Type":"ContainerDied","Data":"dab7772fc4bc3f1cb15cf25063ee337114bf9458c7a542194f901f2649fadf31"}
Jul 08 03:01:51.943883 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:51.943841    2580 scope.go:117] "RemoveContainer" containerID="011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd"
Jul 08 03:01:51.961080 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:51.961060    2580 scope.go:117] "RemoveContainer" containerID="011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd"
Jul 08 03:01:51.961378 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:01:51.961359    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd\": container with ID starting with 011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd not found: ID does not exist" containerID="011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd"
Jul 08 03:01:51.961440 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:51.961387    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd"} err="failed to get container status \"011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd\": rpc error: code = NotFound desc = could not find container \"011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd\": container with ID starting with 011ba42e5888b2243610312bcdcd1b889a4762562124bba6dfe7dedb1ca874bd not found: ID does not exist"
Jul 08 03:01:52.026596 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:52.026570    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq956\" (UniqueName: \"kubernetes.io/projected/d9ad42b6-271b-4971-89b9-02279fe15544-kube-api-access-qq956\") pod \"d9ad42b6-271b-4971-89b9-02279fe15544\" (UID: \"d9ad42b6-271b-4971-89b9-02279fe15544\") "
Jul 08 03:01:52.026747 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:52.026604    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9ad42b6-271b-4971-89b9-02279fe15544-extensions-socket-volume\") pod \"d9ad42b6-271b-4971-89b9-02279fe15544\" (UID: \"d9ad42b6-271b-4971-89b9-02279fe15544\") "
Jul 08 03:01:52.027054 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:52.027035    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ad42b6-271b-4971-89b9-02279fe15544-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d9ad42b6-271b-4971-89b9-02279fe15544" (UID: "d9ad42b6-271b-4971-89b9-02279fe15544"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:01:52.028806 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:52.028771    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9ad42b6-271b-4971-89b9-02279fe15544-kube-api-access-qq956" (OuterVolumeSpecName: "kube-api-access-qq956") pod "d9ad42b6-271b-4971-89b9-02279fe15544" (UID: "d9ad42b6-271b-4971-89b9-02279fe15544"). InnerVolumeSpecName "kube-api-access-qq956". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:01:52.128048 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:52.128015    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq956\" (UniqueName: \"kubernetes.io/projected/d9ad42b6-271b-4971-89b9-02279fe15544-kube-api-access-qq956\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:01:52.128048 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:52.128042    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9ad42b6-271b-4971-89b9-02279fe15544-extensions-socket-volume\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:01:52.264883 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:52.264855    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"]
Jul 08 03:01:52.269334 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:52.269310    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tlcq6"]
Jul 08 03:01:52.725878 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:01:52.725845    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9ad42b6-271b-4971-89b9-02279fe15544" path="/var/lib/kubelet/pods/d9ad42b6-271b-4971-89b9-02279fe15544/volumes"
Jul 08 03:02:49.774203 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.774171    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"]
Jul 08 03:02:49.774664 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.774650    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ad42b6-271b-4971-89b9-02279fe15544" containerName="manager"
Jul 08 03:02:49.774708 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.774665    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ad42b6-271b-4971-89b9-02279fe15544" containerName="manager"
Jul 08 03:02:49.774708 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.774692    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1613205b-0be0-4bba-a037-dbfd56dbe846" containerName="cleanup"
Jul 08 03:02:49.774708 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.774697    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1613205b-0be0-4bba-a037-dbfd56dbe846" containerName="cleanup"
Jul 08 03:02:49.774821 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.774765    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ad42b6-271b-4971-89b9-02279fe15544" containerName="manager"
Jul 08 03:02:49.774821 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.774775    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1613205b-0be0-4bba-a037-dbfd56dbe846" containerName="cleanup"
Jul 08 03:02:49.778058 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.778042    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"
Jul 08 03:02:49.780925 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.780901    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2d4q9\""
Jul 08 03:02:49.790522 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.790502    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"]
Jul 08 03:02:49.837613 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.837574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b9tld\" (UID: \"8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"
Jul 08 03:02:49.837787 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.837651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddb8j\" (UniqueName: \"kubernetes.io/projected/8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469-kube-api-access-ddb8j\") pod \"kuadrant-operator-controller-manager-86878c769f-b9tld\" (UID: \"8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"
Jul 08 03:02:49.938567 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.938528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b9tld\" (UID: \"8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"
Jul 08 03:02:49.938731 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.938582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddb8j\" (UniqueName: \"kubernetes.io/projected/8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469-kube-api-access-ddb8j\") pod \"kuadrant-operator-controller-manager-86878c769f-b9tld\" (UID: \"8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"
Jul 08 03:02:49.938924 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.938906    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b9tld\" (UID: \"8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"
Jul 08 03:02:49.950635 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:49.950605    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddb8j\" (UniqueName: \"kubernetes.io/projected/8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469-kube-api-access-ddb8j\") pod \"kuadrant-operator-controller-manager-86878c769f-b9tld\" (UID: \"8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"
Jul 08 03:02:50.088090 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:50.088013    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"
Jul 08 03:02:50.237265 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:50.237242    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"]
Jul 08 03:02:50.238996 ip-10-0-132-232 kubenswrapper[2580]: W0708 03:02:50.238972    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1b9aba_8494_4eb0_bdc2_5f92a4f1a469.slice/crio-da1c44e69fbf8d2b1e7b88e280f98da9e5bada3b7f4178d7d4f9530ceceb62be WatchSource:0}: Error finding container da1c44e69fbf8d2b1e7b88e280f98da9e5bada3b7f4178d7d4f9530ceceb62be: Status 404 returned error can't find the container with id da1c44e69fbf8d2b1e7b88e280f98da9e5bada3b7f4178d7d4f9530ceceb62be
Jul 08 03:02:50.253362 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:50.253333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld" event={"ID":"8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469","Type":"ContainerStarted","Data":"da1c44e69fbf8d2b1e7b88e280f98da9e5bada3b7f4178d7d4f9530ceceb62be"}
Jul 08 03:02:51.260292 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:51.260257    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld" event={"ID":"8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469","Type":"ContainerStarted","Data":"2dfaf7a4656124bc91371eb7e43a896b4c58e13fb7995266241e57ed1811f0d7"}
Jul 08 03:02:51.260740 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:51.260328    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"
Jul 08 03:02:51.281199 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:02:51.281152    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld" podStartSLOduration=2.28113894 podStartE2EDuration="2.28113894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:02:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:02:51.279391917 +0000 UTC m=+1373.008650777" watchObservedRunningTime="2026-07-08 03:02:51.28113894 +0000 UTC m=+1373.010397797"
Jul 08 03:03:02.267341 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:03:02.267312    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b9tld"
Jul 08 03:03:10.155699 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:03:10.155664    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:03:21.056382 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:03:21.056348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:03:31.465257 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:03:31.465216    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:03:42.152021 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:03:42.151987    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:03:54.255216 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:03:54.255175    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:04:05.159700 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:04:05.159656    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:04:12.858566 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:04:12.858530    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:04:23.972933 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:04:23.972888    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:04:35.154232 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:04:35.154192    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:04:44.559703 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:04:44.559666    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:04:54.453383 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:04:54.453347    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:05:01.274500 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:05:01.274472    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 03:05:01.277003 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:05:01.276985    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 03:05:20.856652 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:05:20.856561    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:05:28.456331 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:05:28.456297    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:05:40.457702 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:05:40.457666    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:05:52.052013 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:05:52.051978    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:06:07.951428 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:06:07.951392    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:06:17.756530 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:06:17.756491    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:06:27.241917 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:06:27.241882    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:06:37.253358 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:06:37.253325    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:06:46.959766 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:06:46.959723    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:06:56.151983 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:06:56.151952    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:07:09.355319 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:07:09.355283    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:07:18.557738 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:07:18.557693    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:07:28.168773 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:07:28.168736    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:07:38.357708 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:07:38.357671    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:07:49.251004 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:07:49.250968    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:07:55.754520 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:07:55.754487    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:08:11.160957 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:08:11.160913    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:08:22.953197 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:08:22.953166    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:08:35.652911 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:08:35.652874    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:08:49.550222 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:08:49.550185    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:08:59.259776 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:08:59.259740    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:09:10.855851 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:09:10.855819    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:09:21.149956 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:09:21.149911    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:09:31.459812 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:09:31.459754    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:09:42.151970 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:09:42.151930    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:09:48.857609 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:09:48.857576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:10:01.313687 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:10:01.313658    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 03:10:01.317834 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:10:01.317812    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 03:10:07.255448 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:10:07.255411    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:10:17.851983 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:10:17.851948    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:12:02.364362 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:12:02.364328    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:12:11.648533 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:12:11.648494    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:13:29.958962 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:29.958926    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:13:38.848839 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.848790    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"]
Jul 08 03:13:38.852349 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.852330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:38.854619 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.854583    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-50f1f9f8-serving-cert\""
Jul 08 03:13:38.854745 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.854651    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 03:13:38.855456 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.855434    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h8t2l\""
Jul 08 03:13:38.855572 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.855479    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 03:13:38.856747 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.856723    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs7c2\" (UniqueName: \"kubernetes.io/projected/6cd31865-d753-4627-be37-9a7e519466f1-kube-api-access-gs7c2\") pod \"maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:38.856858 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.856762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cd31865-d753-4627-be37-9a7e519466f1-maas-api-tls\") pod \"maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:38.856858 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.856782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd31865-d753-4627-be37-9a7e519466f1-openshift-service-ca\") pod \"maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:38.862626 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.862603    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"]
Jul 08 03:13:38.957724 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.957694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs7c2\" (UniqueName: \"kubernetes.io/projected/6cd31865-d753-4627-be37-9a7e519466f1-kube-api-access-gs7c2\") pod \"maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:38.958175 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.957733    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cd31865-d753-4627-be37-9a7e519466f1-maas-api-tls\") pod \"maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:38.958175 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.957758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd31865-d753-4627-be37-9a7e519466f1-openshift-service-ca\") pod \"maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:38.958175 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:13:38.957913    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-serving-cert: secret "maas-api-e2e-mt-50f1f9f8-serving-cert" not found
Jul 08 03:13:38.958175 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:13:38.958004    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd31865-d753-4627-be37-9a7e519466f1-maas-api-tls podName:6cd31865-d753-4627-be37-9a7e519466f1 nodeName:}" failed. No retries permitted until 2026-07-08 03:13:39.457979416 +0000 UTC m=+2021.187238258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6cd31865-d753-4627-be37-9a7e519466f1-maas-api-tls") pod "maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz" (UID: "6cd31865-d753-4627-be37-9a7e519466f1") : secret "maas-api-e2e-mt-50f1f9f8-serving-cert" not found
Jul 08 03:13:38.958440 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.958421    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd31865-d753-4627-be37-9a7e519466f1-openshift-service-ca\") pod \"maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:38.966642 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:38.966622    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs7c2\" (UniqueName: \"kubernetes.io/projected/6cd31865-d753-4627-be37-9a7e519466f1-kube-api-access-gs7c2\") pod \"maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:39.461895 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:39.461859    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cd31865-d753-4627-be37-9a7e519466f1-maas-api-tls\") pod \"maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:39.464439 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:39.464417    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cd31865-d753-4627-be37-9a7e519466f1-maas-api-tls\") pod \"maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:39.764331 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:39.764296    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:39.902938 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:39.902871    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"]
Jul 08 03:13:39.904844 ip-10-0-132-232 kubenswrapper[2580]: W0708 03:13:39.904780    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd31865_d753_4627_be37_9a7e519466f1.slice/crio-83331cb53e5d0238e6a2bf39eb30f86308db598311027392426f4771e5b42290 WatchSource:0}: Error finding container 83331cb53e5d0238e6a2bf39eb30f86308db598311027392426f4771e5b42290: Status 404 returned error can't find the container with id 83331cb53e5d0238e6a2bf39eb30f86308db598311027392426f4771e5b42290
Jul 08 03:13:39.906138 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:39.906123    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 03:13:40.814288 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:40.814249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz" event={"ID":"6cd31865-d753-4627-be37-9a7e519466f1","Type":"ContainerStarted","Data":"83331cb53e5d0238e6a2bf39eb30f86308db598311027392426f4771e5b42290"}
Jul 08 03:13:42.826321 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:42.826285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz" event={"ID":"6cd31865-d753-4627-be37-9a7e519466f1","Type":"ContainerStarted","Data":"c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1"}
Jul 08 03:13:42.826702 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:42.826415    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:42.842965 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:42.842907    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz" podStartSLOduration=2.952342473 podStartE2EDuration="4.842888359s" totalImagesPullingTime="1.890545886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:13:42.841916454 +0000 UTC m=+2024.571175326" watchObservedRunningTime="2026-07-08 03:13:42.842888359 +0000 UTC m=+2024.572147221"
Jul 08 03:13:44.753114 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:44.753071    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:13:48.837163 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:48.837135    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:51.416542 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.416506    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"]
Jul 08 03:13:51.417028 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.416893    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz" podUID="6cd31865-d753-4627-be37-9a7e519466f1" containerName="maas-api" containerID="cri-o://c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1" gracePeriod=30
Jul 08 03:13:51.667556 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.667497    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:51.769785 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.769753    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs7c2\" (UniqueName: \"kubernetes.io/projected/6cd31865-d753-4627-be37-9a7e519466f1-kube-api-access-gs7c2\") pod \"6cd31865-d753-4627-be37-9a7e519466f1\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") "
Jul 08 03:13:51.769947 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.769842    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cd31865-d753-4627-be37-9a7e519466f1-maas-api-tls\") pod \"6cd31865-d753-4627-be37-9a7e519466f1\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") "
Jul 08 03:13:51.769947 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.769884    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd31865-d753-4627-be37-9a7e519466f1-openshift-service-ca\") pod \"6cd31865-d753-4627-be37-9a7e519466f1\" (UID: \"6cd31865-d753-4627-be37-9a7e519466f1\") "
Jul 08 03:13:51.770270 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.770240    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cd31865-d753-4627-be37-9a7e519466f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6cd31865-d753-4627-be37-9a7e519466f1" (UID: "6cd31865-d753-4627-be37-9a7e519466f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:13:51.772084 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.772054    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd31865-d753-4627-be37-9a7e519466f1-kube-api-access-gs7c2" (OuterVolumeSpecName: "kube-api-access-gs7c2") pod "6cd31865-d753-4627-be37-9a7e519466f1" (UID: "6cd31865-d753-4627-be37-9a7e519466f1"). InnerVolumeSpecName "kube-api-access-gs7c2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:13:51.772084 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.772077    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cd31865-d753-4627-be37-9a7e519466f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6cd31865-d753-4627-be37-9a7e519466f1" (UID: "6cd31865-d753-4627-be37-9a7e519466f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:13:51.870700 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.870668    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd31865-d753-4627-be37-9a7e519466f1-openshift-service-ca\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:13:51.870700 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.870700    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs7c2\" (UniqueName: \"kubernetes.io/projected/6cd31865-d753-4627-be37-9a7e519466f1-kube-api-access-gs7c2\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:13:51.870908 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.870714    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cd31865-d753-4627-be37-9a7e519466f1-maas-api-tls\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:13:51.876370 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.876345    2580 generic.go:356] "Generic (PLEG): container finished" podID="6cd31865-d753-4627-be37-9a7e519466f1" containerID="c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1" exitCode=0
Jul 08 03:13:51.876487 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.876398    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"
Jul 08 03:13:51.876487 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.876429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz" event={"ID":"6cd31865-d753-4627-be37-9a7e519466f1","Type":"ContainerDied","Data":"c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1"}
Jul 08 03:13:51.876487 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.876480    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz" event={"ID":"6cd31865-d753-4627-be37-9a7e519466f1","Type":"ContainerDied","Data":"83331cb53e5d0238e6a2bf39eb30f86308db598311027392426f4771e5b42290"}
Jul 08 03:13:51.876650 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.876503    2580 scope.go:117] "RemoveContainer" containerID="c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1"
Jul 08 03:13:51.885936 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.885917    2580 scope.go:117] "RemoveContainer" containerID="c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1"
Jul 08 03:13:51.886236 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:13:51.886219    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1\": container with ID starting with c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1 not found: ID does not exist" containerID="c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1"
Jul 08 03:13:51.886286 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.886246    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1"} err="failed to get container status \"c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1\": rpc error: code = NotFound desc = could not find container \"c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1\": container with ID starting with c8cb4c0af377b7f3ffaf5c8127a04e3fdc3842806d9175113026a9130ab131f1 not found: ID does not exist"
Jul 08 03:13:51.897183 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.897158    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"]
Jul 08 03:13:51.903098 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:51.903079    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-50f1f9f8-6db9f7f686-99cbz"]
Jul 08 03:13:52.725888 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:52.725858    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cd31865-d753-4627-be37-9a7e519466f1" path="/var/lib/kubelet/pods/6cd31865-d753-4627-be37-9a7e519466f1/volumes"
Jul 08 03:13:56.251841 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:13:56.251781    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:14:18.972563 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:18.972515    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"]
Jul 08 03:14:18.973146 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:18.973128    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd31865-d753-4627-be37-9a7e519466f1" containerName="maas-api"
Jul 08 03:14:18.973202 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:18.973149    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd31865-d753-4627-be37-9a7e519466f1" containerName="maas-api"
Jul 08 03:14:18.973272 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:18.973261    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd31865-d753-4627-be37-9a7e519466f1" containerName="maas-api"
Jul 08 03:14:18.975568 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:18.975551    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:18.978201 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:18.978176    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 03:14:18.978201 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:18.978209    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 03:14:18.978408 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:18.978176    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c99a305e-serving-cert\""
Jul 08 03:14:18.979073 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:18.979058    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h8t2l\""
Jul 08 03:14:18.986455 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:18.986431    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"]
Jul 08 03:14:19.125265 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:19.125226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c674aa-8f74-497a-ac83-f0ad533e511d-openshift-service-ca\") pod \"maas-api-e2e-mt-c99a305e-54b848c84b-k42tz\" (UID: \"67c674aa-8f74-497a-ac83-f0ad533e511d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:19.125433 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:19.125343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96fdl\" (UniqueName: \"kubernetes.io/projected/67c674aa-8f74-497a-ac83-f0ad533e511d-kube-api-access-96fdl\") pod \"maas-api-e2e-mt-c99a305e-54b848c84b-k42tz\" (UID: \"67c674aa-8f74-497a-ac83-f0ad533e511d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:19.125433 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:19.125406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c674aa-8f74-497a-ac83-f0ad533e511d-maas-api-tls\") pod \"maas-api-e2e-mt-c99a305e-54b848c84b-k42tz\" (UID: \"67c674aa-8f74-497a-ac83-f0ad533e511d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:19.226719 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:19.226621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c674aa-8f74-497a-ac83-f0ad533e511d-openshift-service-ca\") pod \"maas-api-e2e-mt-c99a305e-54b848c84b-k42tz\" (UID: \"67c674aa-8f74-497a-ac83-f0ad533e511d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:19.226719 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:19.226699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96fdl\" (UniqueName: \"kubernetes.io/projected/67c674aa-8f74-497a-ac83-f0ad533e511d-kube-api-access-96fdl\") pod \"maas-api-e2e-mt-c99a305e-54b848c84b-k42tz\" (UID: \"67c674aa-8f74-497a-ac83-f0ad533e511d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:19.226946 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:19.226743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c674aa-8f74-497a-ac83-f0ad533e511d-maas-api-tls\") pod \"maas-api-e2e-mt-c99a305e-54b848c84b-k42tz\" (UID: \"67c674aa-8f74-497a-ac83-f0ad533e511d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:19.227367 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:19.227344    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c674aa-8f74-497a-ac83-f0ad533e511d-openshift-service-ca\") pod \"maas-api-e2e-mt-c99a305e-54b848c84b-k42tz\" (UID: \"67c674aa-8f74-497a-ac83-f0ad533e511d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:19.229245 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:19.229217    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c674aa-8f74-497a-ac83-f0ad533e511d-maas-api-tls\") pod \"maas-api-e2e-mt-c99a305e-54b848c84b-k42tz\" (UID: \"67c674aa-8f74-497a-ac83-f0ad533e511d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:19.235026 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:19.235005    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96fdl\" (UniqueName: \"kubernetes.io/projected/67c674aa-8f74-497a-ac83-f0ad533e511d-kube-api-access-96fdl\") pod \"maas-api-e2e-mt-c99a305e-54b848c84b-k42tz\" (UID: \"67c674aa-8f74-497a-ac83-f0ad533e511d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:19.286535 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:19.286514    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:19.426668 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:19.426646    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"]
Jul 08 03:14:19.428727 ip-10-0-132-232 kubenswrapper[2580]: W0708 03:14:19.428702    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c674aa_8f74_497a_ac83_f0ad533e511d.slice/crio-175f2277c3baa631db2a5d48707910006d12e1907fae29798a87fb0b512ec1f7 WatchSource:0}: Error finding container 175f2277c3baa631db2a5d48707910006d12e1907fae29798a87fb0b512ec1f7: Status 404 returned error can't find the container with id 175f2277c3baa631db2a5d48707910006d12e1907fae29798a87fb0b512ec1f7
Jul 08 03:14:20.035028 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:20.034993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz" event={"ID":"67c674aa-8f74-497a-ac83-f0ad533e511d","Type":"ContainerStarted","Data":"cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a"}
Jul 08 03:14:20.035414 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:20.035044    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz" event={"ID":"67c674aa-8f74-497a-ac83-f0ad533e511d","Type":"ContainerStarted","Data":"175f2277c3baa631db2a5d48707910006d12e1907fae29798a87fb0b512ec1f7"}
Jul 08 03:14:20.035414 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:20.035106    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:20.052665 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:20.052622    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz" podStartSLOduration=1.5558127750000001 podStartE2EDuration="2.052607468s" totalImagesPullingTime="496.794693ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:14:20.051333298 +0000 UTC m=+2061.780592156" watchObservedRunningTime="2026-07-08 03:14:20.052607468 +0000 UTC m=+2061.781866330"
Jul 08 03:14:25.352551 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:25.352515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:14:26.045874 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:26.045846    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:14:41.650839 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:14:41.650788    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:15:01.351782 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:01.351754    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 03:15:01.357151 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:01.357131    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 03:15:06.246186 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:06.246148    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:15:11.478312 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:11.478271    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"]
Jul 08 03:15:11.478759 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:11.478541    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz" podUID="67c674aa-8f74-497a-ac83-f0ad533e511d" containerName="maas-api" containerID="cri-o://cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a" gracePeriod=30
Jul 08 03:15:11.740445 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:11.740386    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:15:11.922021 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:11.921988    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c674aa-8f74-497a-ac83-f0ad533e511d-maas-api-tls\") pod \"67c674aa-8f74-497a-ac83-f0ad533e511d\" (UID: \"67c674aa-8f74-497a-ac83-f0ad533e511d\") "
Jul 08 03:15:11.922182 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:11.922061    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c674aa-8f74-497a-ac83-f0ad533e511d-openshift-service-ca\") pod \"67c674aa-8f74-497a-ac83-f0ad533e511d\" (UID: \"67c674aa-8f74-497a-ac83-f0ad533e511d\") "
Jul 08 03:15:11.922182 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:11.922095    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96fdl\" (UniqueName: \"kubernetes.io/projected/67c674aa-8f74-497a-ac83-f0ad533e511d-kube-api-access-96fdl\") pod \"67c674aa-8f74-497a-ac83-f0ad533e511d\" (UID: \"67c674aa-8f74-497a-ac83-f0ad533e511d\") "
Jul 08 03:15:11.922389 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:11.922367    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67c674aa-8f74-497a-ac83-f0ad533e511d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "67c674aa-8f74-497a-ac83-f0ad533e511d" (UID: "67c674aa-8f74-497a-ac83-f0ad533e511d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:15:11.924269 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:11.924233    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67c674aa-8f74-497a-ac83-f0ad533e511d-kube-api-access-96fdl" (OuterVolumeSpecName: "kube-api-access-96fdl") pod "67c674aa-8f74-497a-ac83-f0ad533e511d" (UID: "67c674aa-8f74-497a-ac83-f0ad533e511d"). InnerVolumeSpecName "kube-api-access-96fdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:15:11.924373 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:11.924310    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c674aa-8f74-497a-ac83-f0ad533e511d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "67c674aa-8f74-497a-ac83-f0ad533e511d" (UID: "67c674aa-8f74-497a-ac83-f0ad533e511d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:15:12.023029 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.022996    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c674aa-8f74-497a-ac83-f0ad533e511d-openshift-service-ca\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:15:12.023029 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.023028    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96fdl\" (UniqueName: \"kubernetes.io/projected/67c674aa-8f74-497a-ac83-f0ad533e511d-kube-api-access-96fdl\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:15:12.023229 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.023042    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c674aa-8f74-497a-ac83-f0ad533e511d-maas-api-tls\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:15:12.312169 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.312075    2580 generic.go:356] "Generic (PLEG): container finished" podID="67c674aa-8f74-497a-ac83-f0ad533e511d" containerID="cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a" exitCode=0
Jul 08 03:15:12.312169 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.312130    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"
Jul 08 03:15:12.312169 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.312159    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz" event={"ID":"67c674aa-8f74-497a-ac83-f0ad533e511d","Type":"ContainerDied","Data":"cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a"}
Jul 08 03:15:12.312431 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.312210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz" event={"ID":"67c674aa-8f74-497a-ac83-f0ad533e511d","Type":"ContainerDied","Data":"175f2277c3baa631db2a5d48707910006d12e1907fae29798a87fb0b512ec1f7"}
Jul 08 03:15:12.312431 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.312234    2580 scope.go:117] "RemoveContainer" containerID="cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a"
Jul 08 03:15:12.321933 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.321909    2580 scope.go:117] "RemoveContainer" containerID="cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a"
Jul 08 03:15:12.322194 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:15:12.322175    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a\": container with ID starting with cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a not found: ID does not exist" containerID="cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a"
Jul 08 03:15:12.322244 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.322203    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a"} err="failed to get container status \"cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a\": rpc error: code = NotFound desc = could not find container \"cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a\": container with ID starting with cc60638d48de37f84cac188198873f50634aea744748275c03d2063c3f3ad86a not found: ID does not exist"
Jul 08 03:15:12.336849 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.336825    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"]
Jul 08 03:15:12.340615 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.340590    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c99a305e-54b848c84b-k42tz"]
Jul 08 03:15:12.732121 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:12.732046    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67c674aa-8f74-497a-ac83-f0ad533e511d" path="/var/lib/kubelet/pods/67c674aa-8f74-497a-ac83-f0ad533e511d/volumes"
Jul 08 03:15:17.056220 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:17.056185    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:15:26.545884 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:15:26.545853    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:16:02.246304 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:16:02.246272    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:16:18.250404 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:16:18.250353    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:16:27.751953 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:16:27.751917    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:17:39.863261 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:17:39.863188    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:18:26.650574 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:26.650483    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:18:27.101914 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.101877    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"]
Jul 08 03:18:27.102343 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.102328    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67c674aa-8f74-497a-ac83-f0ad533e511d" containerName="maas-api"
Jul 08 03:18:27.102343 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.102344    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="67c674aa-8f74-497a-ac83-f0ad533e511d" containerName="maas-api"
Jul 08 03:18:27.102510 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.102439    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="67c674aa-8f74-497a-ac83-f0ad533e511d" containerName="maas-api"
Jul 08 03:18:27.106072 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.106046    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:27.108847 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.108791    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-a6e00a-serving-cert\""
Jul 08 03:18:27.109196 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.108999    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 03:18:27.109196 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.108895    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h8t2l\""
Jul 08 03:18:27.109196 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.108957    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 03:18:27.118337 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.118312    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"]
Jul 08 03:18:27.202573 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.202533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp\" (UID: \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:27.202573 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.202576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-maas-api-tls\") pod \"maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp\" (UID: \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:27.202875 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.202608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nntbl\" (UniqueName: \"kubernetes.io/projected/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-kube-api-access-nntbl\") pod \"maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp\" (UID: \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:27.303261 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.303225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp\" (UID: \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:27.303261 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.303261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-maas-api-tls\") pod \"maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp\" (UID: \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:27.303502 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.303287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nntbl\" (UniqueName: \"kubernetes.io/projected/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-kube-api-access-nntbl\") pod \"maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp\" (UID: \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:27.304080 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.304053    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp\" (UID: \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:27.305952 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.305931    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-maas-api-tls\") pod \"maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp\" (UID: \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:27.333019 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.332990    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nntbl\" (UniqueName: \"kubernetes.io/projected/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-kube-api-access-nntbl\") pod \"maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp\" (UID: \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:27.419571 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.419464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:27.567374 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:27.567345    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"]
Jul 08 03:18:27.569322 ip-10-0-132-232 kubenswrapper[2580]: W0708 03:18:27.569291    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f63565_7493_4d95_a1d2_acc4d7a14ddb.slice/crio-35c5acefc4b045e469c6c75de435f5ae048d97489164b72ed778b58183aa61ca WatchSource:0}: Error finding container 35c5acefc4b045e469c6c75de435f5ae048d97489164b72ed778b58183aa61ca: Status 404 returned error can't find the container with id 35c5acefc4b045e469c6c75de435f5ae048d97489164b72ed778b58183aa61ca
Jul 08 03:18:28.354511 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:28.354471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp" event={"ID":"b7f63565-7493-4d95-a1d2-acc4d7a14ddb","Type":"ContainerStarted","Data":"378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461"}
Jul 08 03:18:28.354946 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:28.354529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp" event={"ID":"b7f63565-7493-4d95-a1d2-acc4d7a14ddb","Type":"ContainerStarted","Data":"35c5acefc4b045e469c6c75de435f5ae048d97489164b72ed778b58183aa61ca"}
Jul 08 03:18:28.354946 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:28.354582    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:28.370264 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:28.370217    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp" podStartSLOduration=0.978400753 podStartE2EDuration="1.370200519s" totalImagesPullingTime="391.799766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:18:28.369505913 +0000 UTC m=+2310.098764771" watchObservedRunningTime="2026-07-08 03:18:28.370200519 +0000 UTC m=+2310.099459378"
Jul 08 03:18:34.365322 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:34.365294    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:18:37.950565 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:37.950534    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:18:38.032708 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.032680    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"]
Jul 08 03:18:38.036326 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.036300    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.039550 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.039525    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-91d71d\"/\"openshift-service-ca.crt\""
Jul 08 03:18:38.039699 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.039553    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-91d71d\"/\"default-dockercfg-sbphs\""
Jul 08 03:18:38.039699 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.039525    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-91d71d\"/\"test-model-91d71d-kserve-self-signed-certs\""
Jul 08 03:18:38.039699 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.039559    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-91d71d\"/\"kube-root-ca.crt\""
Jul 08 03:18:38.044613 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.044591    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"]
Jul 08 03:18:38.109469 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.109440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-model-cache\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.109617 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.109480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-tmp-dir\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.109617 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.109505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-home\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.109617 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.109594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-dshm\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.109727 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.109624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b154a417-410c-433f-94dc-09476b5474a0-tls-certs\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.109727 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.109646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxn8h\" (UniqueName: \"kubernetes.io/projected/b154a417-410c-433f-94dc-09476b5474a0-kube-api-access-vxn8h\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.210847 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.210753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-dshm\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.210847 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.210787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b154a417-410c-433f-94dc-09476b5474a0-tls-certs\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.211064 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.210848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxn8h\" (UniqueName: \"kubernetes.io/projected/b154a417-410c-433f-94dc-09476b5474a0-kube-api-access-vxn8h\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.211064 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.210951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-model-cache\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.211175 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.211103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-tmp-dir\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.211175 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.211158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-home\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.211318 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.211300    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-model-cache\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.211498 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.211475    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-tmp-dir\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.211541 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.211502    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-home\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.213080 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.213060    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-dshm\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.213374 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.213356    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b154a417-410c-433f-94dc-09476b5474a0-tls-certs\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.218842 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.218791    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxn8h\" (UniqueName: \"kubernetes.io/projected/b154a417-410c-433f-94dc-09476b5474a0-kube-api-access-vxn8h\") pod \"test-model-91d71d-kserve-9588f99f7-pgfjp\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") " pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.347505 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.347469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:38.489780 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:38.489755    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"]
Jul 08 03:18:38.493139 ip-10-0-132-232 kubenswrapper[2580]: W0708 03:18:38.493109    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb154a417_410c_433f_94dc_09476b5474a0.slice/crio-f7d79dd785471e9b6882ad5e86e0274ac1f26b0d732671d2986036296704cb19 WatchSource:0}: Error finding container f7d79dd785471e9b6882ad5e86e0274ac1f26b0d732671d2986036296704cb19: Status 404 returned error can't find the container with id f7d79dd785471e9b6882ad5e86e0274ac1f26b0d732671d2986036296704cb19
Jul 08 03:18:39.418496 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:39.418459    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp" event={"ID":"b154a417-410c-433f-94dc-09476b5474a0","Type":"ContainerStarted","Data":"dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc"}
Jul 08 03:18:39.418496 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:39.418503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp" event={"ID":"b154a417-410c-433f-94dc-09476b5474a0","Type":"ContainerStarted","Data":"f7d79dd785471e9b6882ad5e86e0274ac1f26b0d732671d2986036296704cb19"}
Jul 08 03:18:39.435022 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:39.434967    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp" podStartSLOduration=1.434950178 podStartE2EDuration="1.434950178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:18:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:18:39.433414056 +0000 UTC m=+2321.162672938" watchObservedRunningTime="2026-07-08 03:18:39.434950178 +0000 UTC m=+2321.164209036"
Jul 08 03:18:48.348234 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:48.348198    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:48.348708 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:48.348252    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:48.353506 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:48.353475    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:18:48.361476 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:48.361453    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:18:48.487050 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:18:48.487025    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:19:19.651779 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:19.651742    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:19:33.750663 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:33.750627    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:19:38.545761 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:38.545723    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"]
Jul 08 03:19:38.549931 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:38.549910    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:38.552263 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:38.552240    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-reuse-57a7d5-serving-cert\""
Jul 08 03:19:38.559597 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:38.559560    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"]
Jul 08 03:19:38.583323 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:38.583297    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e090d82e-568c-4f09-baeb-629b35c8760f-maas-api-tls\") pod \"maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:38.583441 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:38.583337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e090d82e-568c-4f09-baeb-629b35c8760f-openshift-service-ca\") pod \"maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:38.583441 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:38.583355    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h7ps\" (UniqueName: \"kubernetes.io/projected/e090d82e-568c-4f09-baeb-629b35c8760f-kube-api-access-6h7ps\") pod \"maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:38.683960 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:38.683930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e090d82e-568c-4f09-baeb-629b35c8760f-maas-api-tls\") pod \"maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:38.684122 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:38.683989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e090d82e-568c-4f09-baeb-629b35c8760f-openshift-service-ca\") pod \"maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:38.684122 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:38.684019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h7ps\" (UniqueName: \"kubernetes.io/projected/e090d82e-568c-4f09-baeb-629b35c8760f-kube-api-access-6h7ps\") pod \"maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:38.684122 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:19:38.684077    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-serving-cert: secret "maas-api-e2e-reuse-57a7d5-serving-cert" not found
Jul 08 03:19:38.684266 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:19:38.684157    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e090d82e-568c-4f09-baeb-629b35c8760f-maas-api-tls podName:e090d82e-568c-4f09-baeb-629b35c8760f nodeName:}" failed. No retries permitted until 2026-07-08 03:19:39.184128662 +0000 UTC m=+2380.913387498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e090d82e-568c-4f09-baeb-629b35c8760f-maas-api-tls") pod "maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn" (UID: "e090d82e-568c-4f09-baeb-629b35c8760f") : secret "maas-api-e2e-reuse-57a7d5-serving-cert" not found
Jul 08 03:19:38.684697 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:38.684679    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e090d82e-568c-4f09-baeb-629b35c8760f-openshift-service-ca\") pod \"maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:38.695439 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:38.695412    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h7ps\" (UniqueName: \"kubernetes.io/projected/e090d82e-568c-4f09-baeb-629b35c8760f-kube-api-access-6h7ps\") pod \"maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:39.187177 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:39.187137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e090d82e-568c-4f09-baeb-629b35c8760f-maas-api-tls\") pod \"maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:39.190284 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:39.190255    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e090d82e-568c-4f09-baeb-629b35c8760f-maas-api-tls\") pod \"maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:39.461376 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:39.461290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:39.601382 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:39.601356    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"]
Jul 08 03:19:39.604225 ip-10-0-132-232 kubenswrapper[2580]: W0708 03:19:39.604186    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode090d82e_568c_4f09_baeb_629b35c8760f.slice/crio-465b38d848202ca21cff5f87b48e3caf9f87b3990f7c08655ec3c6aff9a2471c WatchSource:0}: Error finding container 465b38d848202ca21cff5f87b48e3caf9f87b3990f7c08655ec3c6aff9a2471c: Status 404 returned error can't find the container with id 465b38d848202ca21cff5f87b48e3caf9f87b3990f7c08655ec3c6aff9a2471c
Jul 08 03:19:39.605676 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:39.605657    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 03:19:39.754160 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:39.754080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn" event={"ID":"e090d82e-568c-4f09-baeb-629b35c8760f","Type":"ContainerStarted","Data":"465b38d848202ca21cff5f87b48e3caf9f87b3990f7c08655ec3c6aff9a2471c"}
Jul 08 03:19:40.760686 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:40.760654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn" event={"ID":"e090d82e-568c-4f09-baeb-629b35c8760f","Type":"ContainerStarted","Data":"70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99"}
Jul 08 03:19:40.761080 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:40.760755    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:40.778975 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:40.778927    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn" podStartSLOduration=2.4358737169999998 podStartE2EDuration="2.778912614s" totalImagesPullingTime="343.038897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:19:40.775901026 +0000 UTC m=+2382.505159903" watchObservedRunningTime="2026-07-08 03:19:40.778912614 +0000 UTC m=+2382.508171472"
Jul 08 03:19:46.772377 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:46.772347    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:19:56.545262 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:19:56.545228    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:20:01.387279 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:01.387248    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 03:20:01.392907 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:01.392881    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 03:20:04.249348 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.249316    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"]
Jul 08 03:20:04.253418 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.253399    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.255762 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.255736    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-57a7d5\"/\"kube-root-ca.crt\""
Jul 08 03:20:04.256698 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.256676    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-57a7d5\"/\"test-model-57a7d5-kserve-self-signed-certs\""
Jul 08 03:20:04.256825 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.256684    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-57a7d5\"/\"default-dockercfg-kmcc7\""
Jul 08 03:20:04.256825 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.256720    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-57a7d5\"/\"openshift-service-ca.crt\""
Jul 08 03:20:04.262969 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.262947    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"]
Jul 08 03:20:04.330749 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.330718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a30620b4-4bd5-4b3b-a0af-16aac683f434-tls-certs\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.330749 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.330754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp5x4\" (UniqueName: \"kubernetes.io/projected/a30620b4-4bd5-4b3b-a0af-16aac683f434-kube-api-access-zp5x4\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.331013 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.330788    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-home\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.331013 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.330859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-dshm\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.331013 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.330882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-tmp-dir\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.331013 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.330932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-model-cache\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.431455 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.431423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a30620b4-4bd5-4b3b-a0af-16aac683f434-tls-certs\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.431633 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.431461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp5x4\" (UniqueName: \"kubernetes.io/projected/a30620b4-4bd5-4b3b-a0af-16aac683f434-kube-api-access-zp5x4\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.431633 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.431596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-home\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.431762 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.431662    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-dshm\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.431762 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.431701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-tmp-dir\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.431909 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.431840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-model-cache\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.432039 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.432010    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-home\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.432121 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.432078    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-tmp-dir\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.432121 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.432115    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-model-cache\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.434134 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.434108    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-dshm\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.434261 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.434246    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a30620b4-4bd5-4b3b-a0af-16aac683f434-tls-certs\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.438934 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.438916    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp5x4\" (UniqueName: \"kubernetes.io/projected/a30620b4-4bd5-4b3b-a0af-16aac683f434-kube-api-access-zp5x4\") pod \"test-model-57a7d5-kserve-6df79fc9f9-s79b5\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") " pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.563644 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.563608    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:04.713563 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.713533    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"]
Jul 08 03:20:04.714520 ip-10-0-132-232 kubenswrapper[2580]: W0708 03:20:04.714494    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda30620b4_4bd5_4b3b_a0af_16aac683f434.slice/crio-6cd64e812e18bc0d9a5cd12d4ee204d34b6b68d8dd1de28575ebc25e65bff28a WatchSource:0}: Error finding container 6cd64e812e18bc0d9a5cd12d4ee204d34b6b68d8dd1de28575ebc25e65bff28a: Status 404 returned error can't find the container with id 6cd64e812e18bc0d9a5cd12d4ee204d34b6b68d8dd1de28575ebc25e65bff28a
Jul 08 03:20:04.892673 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.892576    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5" event={"ID":"a30620b4-4bd5-4b3b-a0af-16aac683f434","Type":"ContainerStarted","Data":"8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f"}
Jul 08 03:20:04.892673 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.892627    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5" event={"ID":"a30620b4-4bd5-4b3b-a0af-16aac683f434","Type":"ContainerStarted","Data":"6cd64e812e18bc0d9a5cd12d4ee204d34b6b68d8dd1de28575ebc25e65bff28a"}
Jul 08 03:20:04.912613 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:04.912564    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5" podStartSLOduration=0.912547464 podStartE2EDuration="912.547464ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:20:04.910252134 +0000 UTC m=+2406.639511014" watchObservedRunningTime="2026-07-08 03:20:04.912547464 +0000 UTC m=+2406.641806321"
Jul 08 03:20:11.148142 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:11.148108    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:20:14.564280 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:14.564241    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:14.564669 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:14.564298    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:14.576947 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:14.576917    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:14.965392 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:14.965304    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:20.413784 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.413700    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"]
Jul 08 03:20:20.414182 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.413966    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn" podUID="e090d82e-568c-4f09-baeb-629b35c8760f" containerName="maas-api" containerID="cri-o://70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99" gracePeriod=30
Jul 08 03:20:20.673690 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.673630    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:20:20.699789 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.699754    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e090d82e-568c-4f09-baeb-629b35c8760f-maas-api-tls\") pod \"e090d82e-568c-4f09-baeb-629b35c8760f\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") "
Jul 08 03:20:20.699951 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.699888    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h7ps\" (UniqueName: \"kubernetes.io/projected/e090d82e-568c-4f09-baeb-629b35c8760f-kube-api-access-6h7ps\") pod \"e090d82e-568c-4f09-baeb-629b35c8760f\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") "
Jul 08 03:20:20.699951 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.699915    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e090d82e-568c-4f09-baeb-629b35c8760f-openshift-service-ca\") pod \"e090d82e-568c-4f09-baeb-629b35c8760f\" (UID: \"e090d82e-568c-4f09-baeb-629b35c8760f\") "
Jul 08 03:20:20.700496 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.700466    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e090d82e-568c-4f09-baeb-629b35c8760f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e090d82e-568c-4f09-baeb-629b35c8760f" (UID: "e090d82e-568c-4f09-baeb-629b35c8760f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:20:20.702183 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.702157    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e090d82e-568c-4f09-baeb-629b35c8760f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e090d82e-568c-4f09-baeb-629b35c8760f" (UID: "e090d82e-568c-4f09-baeb-629b35c8760f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:20:20.702676 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.702656    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e090d82e-568c-4f09-baeb-629b35c8760f-kube-api-access-6h7ps" (OuterVolumeSpecName: "kube-api-access-6h7ps") pod "e090d82e-568c-4f09-baeb-629b35c8760f" (UID: "e090d82e-568c-4f09-baeb-629b35c8760f"). InnerVolumeSpecName "kube-api-access-6h7ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:20:20.801021 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.800974    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h7ps\" (UniqueName: \"kubernetes.io/projected/e090d82e-568c-4f09-baeb-629b35c8760f-kube-api-access-6h7ps\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:20:20.801021 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.801010    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e090d82e-568c-4f09-baeb-629b35c8760f-openshift-service-ca\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:20:20.801021 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.801020    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e090d82e-568c-4f09-baeb-629b35c8760f-maas-api-tls\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:20:20.996561 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.996463    2580 generic.go:356] "Generic (PLEG): container finished" podID="e090d82e-568c-4f09-baeb-629b35c8760f" containerID="70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99" exitCode=0
Jul 08 03:20:20.996561 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.996516    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"
Jul 08 03:20:20.996791 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.996551    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn" event={"ID":"e090d82e-568c-4f09-baeb-629b35c8760f","Type":"ContainerDied","Data":"70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99"}
Jul 08 03:20:20.996791 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.996610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn" event={"ID":"e090d82e-568c-4f09-baeb-629b35c8760f","Type":"ContainerDied","Data":"465b38d848202ca21cff5f87b48e3caf9f87b3990f7c08655ec3c6aff9a2471c"}
Jul 08 03:20:20.996791 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:20.996635    2580 scope.go:117] "RemoveContainer" containerID="70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99"
Jul 08 03:20:21.006158 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:21.006140    2580 scope.go:117] "RemoveContainer" containerID="70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99"
Jul 08 03:20:21.006408 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:20:21.006388    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99\": container with ID starting with 70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99 not found: ID does not exist" containerID="70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99"
Jul 08 03:20:21.006471 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:21.006423    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99"} err="failed to get container status \"70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99\": rpc error: code = NotFound desc = could not find container \"70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99\": container with ID starting with 70ef752bd44690ad0fa04a2cb17875259fe3b304c3314b6d5672ed0665a83f99 not found: ID does not exist"
Jul 08 03:20:21.018462 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:21.018440    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"]
Jul 08 03:20:21.022947 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:21.022927    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-57a7d5-67f6db5cc-28sxn"]
Jul 08 03:20:22.726678 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:22.726643    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e090d82e-568c-4f09-baeb-629b35c8760f" path="/var/lib/kubelet/pods/e090d82e-568c-4f09-baeb-629b35c8760f/volumes"
Jul 08 03:20:25.330402 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:25.330363    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"]
Jul 08 03:20:30.051843 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:30.051785    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:20:40.352892 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.352845    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5" podUID="a30620b4-4bd5-4b3b-a0af-16aac683f434" containerName="main" containerID="cri-o://8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f" gracePeriod=45
Jul 08 03:20:40.611864 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.611787    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:40.689499 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.689469    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-home\") pod \"a30620b4-4bd5-4b3b-a0af-16aac683f434\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") "
Jul 08 03:20:40.689644 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.689533    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-dshm\") pod \"a30620b4-4bd5-4b3b-a0af-16aac683f434\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") "
Jul 08 03:20:40.689644 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.689592    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a30620b4-4bd5-4b3b-a0af-16aac683f434-tls-certs\") pod \"a30620b4-4bd5-4b3b-a0af-16aac683f434\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") "
Jul 08 03:20:40.689644 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.689622    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-model-cache\") pod \"a30620b4-4bd5-4b3b-a0af-16aac683f434\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") "
Jul 08 03:20:40.689773 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.689663    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp5x4\" (UniqueName: \"kubernetes.io/projected/a30620b4-4bd5-4b3b-a0af-16aac683f434-kube-api-access-zp5x4\") pod \"a30620b4-4bd5-4b3b-a0af-16aac683f434\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") "
Jul 08 03:20:40.689773 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.689703    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-home" (OuterVolumeSpecName: "home") pod "a30620b4-4bd5-4b3b-a0af-16aac683f434" (UID: "a30620b4-4bd5-4b3b-a0af-16aac683f434"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:20:40.689773 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.689731    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-tmp-dir\") pod \"a30620b4-4bd5-4b3b-a0af-16aac683f434\" (UID: \"a30620b4-4bd5-4b3b-a0af-16aac683f434\") "
Jul 08 03:20:40.689995 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.689875    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-model-cache" (OuterVolumeSpecName: "model-cache") pod "a30620b4-4bd5-4b3b-a0af-16aac683f434" (UID: "a30620b4-4bd5-4b3b-a0af-16aac683f434"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:20:40.690054 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.690005    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a30620b4-4bd5-4b3b-a0af-16aac683f434" (UID: "a30620b4-4bd5-4b3b-a0af-16aac683f434"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:20:40.690126 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.690104    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-tmp-dir\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:20:40.690179 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.690132    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-home\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:20:40.690179 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.690146    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-model-cache\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:20:40.691972 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.691942    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a30620b4-4bd5-4b3b-a0af-16aac683f434-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a30620b4-4bd5-4b3b-a0af-16aac683f434" (UID: "a30620b4-4bd5-4b3b-a0af-16aac683f434"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:20:40.691972 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.691948    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-dshm" (OuterVolumeSpecName: "dshm") pod "a30620b4-4bd5-4b3b-a0af-16aac683f434" (UID: "a30620b4-4bd5-4b3b-a0af-16aac683f434"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:20:40.692131 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.692049    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a30620b4-4bd5-4b3b-a0af-16aac683f434-kube-api-access-zp5x4" (OuterVolumeSpecName: "kube-api-access-zp5x4") pod "a30620b4-4bd5-4b3b-a0af-16aac683f434" (UID: "a30620b4-4bd5-4b3b-a0af-16aac683f434"). InnerVolumeSpecName "kube-api-access-zp5x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:20:40.791097 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.791076    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a30620b4-4bd5-4b3b-a0af-16aac683f434-dshm\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:20:40.791097 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.791098    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a30620b4-4bd5-4b3b-a0af-16aac683f434-tls-certs\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:20:40.791236 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:40.791107    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp5x4\" (UniqueName: \"kubernetes.io/projected/a30620b4-4bd5-4b3b-a0af-16aac683f434-kube-api-access-zp5x4\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:20:41.111723 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:41.111689    2580 generic.go:356] "Generic (PLEG): container finished" podID="a30620b4-4bd5-4b3b-a0af-16aac683f434" containerID="8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f" exitCode=0
Jul 08 03:20:41.111936 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:41.111730    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"
Jul 08 03:20:41.111936 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:41.111747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5" event={"ID":"a30620b4-4bd5-4b3b-a0af-16aac683f434","Type":"ContainerDied","Data":"8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f"}
Jul 08 03:20:41.111936 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:41.111784    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5" event={"ID":"a30620b4-4bd5-4b3b-a0af-16aac683f434","Type":"ContainerDied","Data":"6cd64e812e18bc0d9a5cd12d4ee204d34b6b68d8dd1de28575ebc25e65bff28a"}
Jul 08 03:20:41.111936 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:41.111828    2580 scope.go:117] "RemoveContainer" containerID="8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f"
Jul 08 03:20:41.121020 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:41.121001    2580 scope.go:117] "RemoveContainer" containerID="8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f"
Jul 08 03:20:41.121290 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:20:41.121274    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f\": container with ID starting with 8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f not found: ID does not exist" containerID="8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f"
Jul 08 03:20:41.121338 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:41.121298    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f"} err="failed to get container status \"8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f\": rpc error: code = NotFound desc = could not find container \"8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f\": container with ID starting with 8d59f4566010581da3a40a8f1b447143a5983175f046f88e1d16f36d0b9baf4f not found: ID does not exist"
Jul 08 03:20:41.128981 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:41.128960    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"]
Jul 08 03:20:41.131956 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:41.131932    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-57a7d5/test-model-57a7d5-kserve-6df79fc9f9-s79b5"]
Jul 08 03:20:42.726919 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:20:42.726884    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a30620b4-4bd5-4b3b-a0af-16aac683f434" path="/var/lib/kubelet/pods/a30620b4-4bd5-4b3b-a0af-16aac683f434/volumes"
Jul 08 03:21:07.051941 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:07.051905    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:21:09.442615 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:09.442584    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"]
Jul 08 03:21:23.144784 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:23.144745    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:21:24.464629 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.464587    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp" podUID="b154a417-410c-433f-94dc-09476b5474a0" containerName="main" containerID="cri-o://dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc" gracePeriod=45
Jul 08 03:21:24.739356 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.739325    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:21:24.808077 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.808044    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxn8h\" (UniqueName: \"kubernetes.io/projected/b154a417-410c-433f-94dc-09476b5474a0-kube-api-access-vxn8h\") pod \"b154a417-410c-433f-94dc-09476b5474a0\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") "
Jul 08 03:21:24.808290 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.808100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-model-cache\") pod \"b154a417-410c-433f-94dc-09476b5474a0\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") "
Jul 08 03:21:24.808290 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.808155    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-tmp-dir\") pod \"b154a417-410c-433f-94dc-09476b5474a0\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") "
Jul 08 03:21:24.808290 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.808174    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-home\") pod \"b154a417-410c-433f-94dc-09476b5474a0\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") "
Jul 08 03:21:24.808290 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.808227    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b154a417-410c-433f-94dc-09476b5474a0-tls-certs\") pod \"b154a417-410c-433f-94dc-09476b5474a0\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") "
Jul 08 03:21:24.808290 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.808282    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-dshm\") pod \"b154a417-410c-433f-94dc-09476b5474a0\" (UID: \"b154a417-410c-433f-94dc-09476b5474a0\") "
Jul 08 03:21:24.808570 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.808445    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b154a417-410c-433f-94dc-09476b5474a0" (UID: "b154a417-410c-433f-94dc-09476b5474a0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:21:24.808570 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.808462    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-home" (OuterVolumeSpecName: "home") pod "b154a417-410c-433f-94dc-09476b5474a0" (UID: "b154a417-410c-433f-94dc-09476b5474a0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:21:24.808570 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.808476    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-model-cache" (OuterVolumeSpecName: "model-cache") pod "b154a417-410c-433f-94dc-09476b5474a0" (UID: "b154a417-410c-433f-94dc-09476b5474a0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:21:24.808848 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.808779    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-model-cache\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:21:24.808848 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.808840    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-tmp-dir\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:21:24.809049 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.808937    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-home\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:21:24.810685 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.810654    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-dshm" (OuterVolumeSpecName: "dshm") pod "b154a417-410c-433f-94dc-09476b5474a0" (UID: "b154a417-410c-433f-94dc-09476b5474a0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:21:24.810775 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.810700    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b154a417-410c-433f-94dc-09476b5474a0-kube-api-access-vxn8h" (OuterVolumeSpecName: "kube-api-access-vxn8h") pod "b154a417-410c-433f-94dc-09476b5474a0" (UID: "b154a417-410c-433f-94dc-09476b5474a0"). InnerVolumeSpecName "kube-api-access-vxn8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:21:24.810775 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.810753    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b154a417-410c-433f-94dc-09476b5474a0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b154a417-410c-433f-94dc-09476b5474a0" (UID: "b154a417-410c-433f-94dc-09476b5474a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:21:24.910080 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.910043    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b154a417-410c-433f-94dc-09476b5474a0-tls-certs\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:21:24.910080 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.910075    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b154a417-410c-433f-94dc-09476b5474a0-dshm\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:21:24.910080 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:24.910084    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxn8h\" (UniqueName: \"kubernetes.io/projected/b154a417-410c-433f-94dc-09476b5474a0-kube-api-access-vxn8h\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:21:25.363427 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:25.363397    2580 generic.go:356] "Generic (PLEG): container finished" podID="b154a417-410c-433f-94dc-09476b5474a0" containerID="dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc" exitCode=0
Jul 08 03:21:25.363606 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:25.363440    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"
Jul 08 03:21:25.363606 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:25.363489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp" event={"ID":"b154a417-410c-433f-94dc-09476b5474a0","Type":"ContainerDied","Data":"dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc"}
Jul 08 03:21:25.363606 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:25.363535    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp" event={"ID":"b154a417-410c-433f-94dc-09476b5474a0","Type":"ContainerDied","Data":"f7d79dd785471e9b6882ad5e86e0274ac1f26b0d732671d2986036296704cb19"}
Jul 08 03:21:25.363606 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:25.363554    2580 scope.go:117] "RemoveContainer" containerID="dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc"
Jul 08 03:21:25.373751 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:25.373717    2580 scope.go:117] "RemoveContainer" containerID="dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc"
Jul 08 03:21:25.374092 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:21:25.374073    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc\": container with ID starting with dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc not found: ID does not exist" containerID="dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc"
Jul 08 03:21:25.374164 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:25.374104    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc"} err="failed to get container status \"dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc\": rpc error: code = NotFound desc = could not find container \"dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc\": container with ID starting with dab8ba347eb89413e29a0258569bb05b3ef65e3a7778d5056dd209fb56309cdc not found: ID does not exist"
Jul 08 03:21:25.384240 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:25.384200    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"]
Jul 08 03:21:25.386091 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:25.386072    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-91d71d/test-model-91d71d-kserve-9588f99f7-pgfjp"]
Jul 08 03:21:26.726400 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:26.726308    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b154a417-410c-433f-94dc-09476b5474a0" path="/var/lib/kubelet/pods/b154a417-410c-433f-94dc-09476b5474a0/volumes"
Jul 08 03:21:54.485366 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:54.485328    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"]
Jul 08 03:21:54.486028 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:54.485669    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp" podUID="b7f63565-7493-4d95-a1d2-acc4d7a14ddb" containerName="maas-api" containerID="cri-o://378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461" gracePeriod=30
Jul 08 03:21:54.743316 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:54.743260    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:21:54.778023 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:54.777991    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-openshift-service-ca\") pod \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\" (UID: \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\") "
Jul 08 03:21:54.778154 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:54.778047    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-maas-api-tls\") pod \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\" (UID: \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\") "
Jul 08 03:21:54.778154 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:54.778065    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nntbl\" (UniqueName: \"kubernetes.io/projected/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-kube-api-access-nntbl\") pod \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\" (UID: \"b7f63565-7493-4d95-a1d2-acc4d7a14ddb\") "
Jul 08 03:21:54.778347 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:54.778323    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b7f63565-7493-4d95-a1d2-acc4d7a14ddb" (UID: "b7f63565-7493-4d95-a1d2-acc4d7a14ddb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:21:54.780382 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:54.780349    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-kube-api-access-nntbl" (OuterVolumeSpecName: "kube-api-access-nntbl") pod "b7f63565-7493-4d95-a1d2-acc4d7a14ddb" (UID: "b7f63565-7493-4d95-a1d2-acc4d7a14ddb"). InnerVolumeSpecName "kube-api-access-nntbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:21:54.780477 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:54.780380    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b7f63565-7493-4d95-a1d2-acc4d7a14ddb" (UID: "b7f63565-7493-4d95-a1d2-acc4d7a14ddb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:21:54.878688 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:54.878663    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-maas-api-tls\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:21:54.878688 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:54.878688    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nntbl\" (UniqueName: \"kubernetes.io/projected/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-kube-api-access-nntbl\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:21:54.878899 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:54.878699    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f63565-7493-4d95-a1d2-acc4d7a14ddb-openshift-service-ca\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:21:55.536034 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:55.536003    2580 generic.go:356] "Generic (PLEG): container finished" podID="b7f63565-7493-4d95-a1d2-acc4d7a14ddb" containerID="378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461" exitCode=0
Jul 08 03:21:55.536596 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:55.536053    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"
Jul 08 03:21:55.536596 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:55.536093    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp" event={"ID":"b7f63565-7493-4d95-a1d2-acc4d7a14ddb","Type":"ContainerDied","Data":"378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461"}
Jul 08 03:21:55.536596 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:55.536153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp" event={"ID":"b7f63565-7493-4d95-a1d2-acc4d7a14ddb","Type":"ContainerDied","Data":"35c5acefc4b045e469c6c75de435f5ae048d97489164b72ed778b58183aa61ca"}
Jul 08 03:21:55.536596 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:55.536188    2580 scope.go:117] "RemoveContainer" containerID="378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461"
Jul 08 03:21:55.545871 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:55.545845    2580 scope.go:117] "RemoveContainer" containerID="378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461"
Jul 08 03:21:55.546201 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:21:55.546176    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461\": container with ID starting with 378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461 not found: ID does not exist" containerID="378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461"
Jul 08 03:21:55.546278 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:55.546209    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461"} err="failed to get container status \"378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461\": rpc error: code = NotFound desc = could not find container \"378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461\": container with ID starting with 378d80b064c868f1454bd940515fe80ce7a1b8d92b56ca59159e0b6ea34bd461 not found: ID does not exist"
Jul 08 03:21:55.557358 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:55.557327    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"]
Jul 08 03:21:55.560972 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:55.560949    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a6e00a-5ff446695f-fmwbp"]
Jul 08 03:21:56.727182 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:56.727153    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7f63565-7493-4d95-a1d2-acc4d7a14ddb" path="/var/lib/kubelet/pods/b7f63565-7493-4d95-a1d2-acc4d7a14ddb/volumes"
Jul 08 03:21:57.345518 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:21:57.345487    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:22:12.056888 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.056849    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:22:12.168701 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.168669    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"]
Jul 08 03:22:12.169190 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.169176    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a30620b4-4bd5-4b3b-a0af-16aac683f434" containerName="main"
Jul 08 03:22:12.169237 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.169196    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a30620b4-4bd5-4b3b-a0af-16aac683f434" containerName="main"
Jul 08 03:22:12.169237 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.169214    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7f63565-7493-4d95-a1d2-acc4d7a14ddb" containerName="maas-api"
Jul 08 03:22:12.169237 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.169220    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7f63565-7493-4d95-a1d2-acc4d7a14ddb" containerName="maas-api"
Jul 08 03:22:12.169237 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.169226    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b154a417-410c-433f-94dc-09476b5474a0" containerName="main"
Jul 08 03:22:12.169237 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.169231    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b154a417-410c-433f-94dc-09476b5474a0" containerName="main"
Jul 08 03:22:12.169403 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.169247    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e090d82e-568c-4f09-baeb-629b35c8760f" containerName="maas-api"
Jul 08 03:22:12.169403 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.169253    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e090d82e-568c-4f09-baeb-629b35c8760f" containerName="maas-api"
Jul 08 03:22:12.169403 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.169320    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e090d82e-568c-4f09-baeb-629b35c8760f" containerName="maas-api"
Jul 08 03:22:12.169403 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.169328    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7f63565-7493-4d95-a1d2-acc4d7a14ddb" containerName="maas-api"
Jul 08 03:22:12.169403 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.169335    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a30620b4-4bd5-4b3b-a0af-16aac683f434" containerName="main"
Jul 08 03:22:12.169403 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.169343    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b154a417-410c-433f-94dc-09476b5474a0" containerName="main"
Jul 08 03:22:12.172680 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.172662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:12.174967 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.174940    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a4e50e-serving-cert\""
Jul 08 03:22:12.175129 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.175086    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 03:22:12.175905 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.175882    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h8t2l\""
Jul 08 03:22:12.175905 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.175895    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 03:22:12.182380 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.182354    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"]
Jul 08 03:22:12.242459 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.242405    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53b96ebc-a50f-4f28-ba89-016832d44c33-maas-api-tls\") pod \"maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp\" (UID: \"53b96ebc-a50f-4f28-ba89-016832d44c33\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:12.242676 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.242470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlkkv\" (UniqueName: \"kubernetes.io/projected/53b96ebc-a50f-4f28-ba89-016832d44c33-kube-api-access-jlkkv\") pod \"maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp\" (UID: \"53b96ebc-a50f-4f28-ba89-016832d44c33\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:12.242676 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.242537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53b96ebc-a50f-4f28-ba89-016832d44c33-openshift-service-ca\") pod \"maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp\" (UID: \"53b96ebc-a50f-4f28-ba89-016832d44c33\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:12.344220 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.344125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlkkv\" (UniqueName: \"kubernetes.io/projected/53b96ebc-a50f-4f28-ba89-016832d44c33-kube-api-access-jlkkv\") pod \"maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp\" (UID: \"53b96ebc-a50f-4f28-ba89-016832d44c33\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:12.344220 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.344205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53b96ebc-a50f-4f28-ba89-016832d44c33-openshift-service-ca\") pod \"maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp\" (UID: \"53b96ebc-a50f-4f28-ba89-016832d44c33\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:12.344467 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.344283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53b96ebc-a50f-4f28-ba89-016832d44c33-maas-api-tls\") pod \"maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp\" (UID: \"53b96ebc-a50f-4f28-ba89-016832d44c33\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:12.344942 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.344916    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53b96ebc-a50f-4f28-ba89-016832d44c33-openshift-service-ca\") pod \"maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp\" (UID: \"53b96ebc-a50f-4f28-ba89-016832d44c33\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:12.346787 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.346765    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53b96ebc-a50f-4f28-ba89-016832d44c33-maas-api-tls\") pod \"maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp\" (UID: \"53b96ebc-a50f-4f28-ba89-016832d44c33\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:12.353015 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.352985    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlkkv\" (UniqueName: \"kubernetes.io/projected/53b96ebc-a50f-4f28-ba89-016832d44c33-kube-api-access-jlkkv\") pod \"maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp\" (UID: \"53b96ebc-a50f-4f28-ba89-016832d44c33\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:12.485971 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.485935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:12.638779 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:12.638753    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"]
Jul 08 03:22:12.641012 ip-10-0-132-232 kubenswrapper[2580]: W0708 03:22:12.640980    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b96ebc_a50f_4f28_ba89_016832d44c33.slice/crio-6551f689390e7d5898b8488b3adc3bc6ea05b6ea4e8fae514c75fe3c846cf0e0 WatchSource:0}: Error finding container 6551f689390e7d5898b8488b3adc3bc6ea05b6ea4e8fae514c75fe3c846cf0e0: Status 404 returned error can't find the container with id 6551f689390e7d5898b8488b3adc3bc6ea05b6ea4e8fae514c75fe3c846cf0e0
Jul 08 03:22:13.637894 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:13.637854    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp" event={"ID":"53b96ebc-a50f-4f28-ba89-016832d44c33","Type":"ContainerStarted","Data":"def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b"}
Jul 08 03:22:13.638287 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:13.637936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp" event={"ID":"53b96ebc-a50f-4f28-ba89-016832d44c33","Type":"ContainerStarted","Data":"6551f689390e7d5898b8488b3adc3bc6ea05b6ea4e8fae514c75fe3c846cf0e0"}
Jul 08 03:22:13.638287 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:13.638087    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:13.657352 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:13.657300    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp" podStartSLOduration=1.364169193 podStartE2EDuration="1.657281879s" totalImagesPullingTime="293.112686ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:22:13.655427217 +0000 UTC m=+2535.384686104" watchObservedRunningTime="2026-07-08 03:22:13.657281879 +0000 UTC m=+2535.386540738"
Jul 08 03:22:19.648761 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:19.648730    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:26.944809 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:26.944766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:22:32.297035 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.296185    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"]
Jul 08 03:22:32.297035 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.296471    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp" podUID="53b96ebc-a50f-4f28-ba89-016832d44c33" containerName="maas-api" containerID="cri-o://def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b" gracePeriod=30
Jul 08 03:22:32.563442 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.563379    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:32.739742 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.739706    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlkkv\" (UniqueName: \"kubernetes.io/projected/53b96ebc-a50f-4f28-ba89-016832d44c33-kube-api-access-jlkkv\") pod \"53b96ebc-a50f-4f28-ba89-016832d44c33\" (UID: \"53b96ebc-a50f-4f28-ba89-016832d44c33\") "
Jul 08 03:22:32.739944 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.739757    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53b96ebc-a50f-4f28-ba89-016832d44c33-maas-api-tls\") pod \"53b96ebc-a50f-4f28-ba89-016832d44c33\" (UID: \"53b96ebc-a50f-4f28-ba89-016832d44c33\") "
Jul 08 03:22:32.739944 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.739889    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53b96ebc-a50f-4f28-ba89-016832d44c33-openshift-service-ca\") pod \"53b96ebc-a50f-4f28-ba89-016832d44c33\" (UID: \"53b96ebc-a50f-4f28-ba89-016832d44c33\") "
Jul 08 03:22:32.740268 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.740228    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b96ebc-a50f-4f28-ba89-016832d44c33-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "53b96ebc-a50f-4f28-ba89-016832d44c33" (UID: "53b96ebc-a50f-4f28-ba89-016832d44c33"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:22:32.742087 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.742063    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b96ebc-a50f-4f28-ba89-016832d44c33-kube-api-access-jlkkv" (OuterVolumeSpecName: "kube-api-access-jlkkv") pod "53b96ebc-a50f-4f28-ba89-016832d44c33" (UID: "53b96ebc-a50f-4f28-ba89-016832d44c33"). InnerVolumeSpecName "kube-api-access-jlkkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:22:32.742347 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.742319    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53b96ebc-a50f-4f28-ba89-016832d44c33-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "53b96ebc-a50f-4f28-ba89-016832d44c33" (UID: "53b96ebc-a50f-4f28-ba89-016832d44c33"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:22:32.747242 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.747215    2580 generic.go:356] "Generic (PLEG): container finished" podID="53b96ebc-a50f-4f28-ba89-016832d44c33" containerID="def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b" exitCode=0
Jul 08 03:22:32.747368 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.747272    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"
Jul 08 03:22:32.747368 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.747268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp" event={"ID":"53b96ebc-a50f-4f28-ba89-016832d44c33","Type":"ContainerDied","Data":"def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b"}
Jul 08 03:22:32.747484 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.747404    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp" event={"ID":"53b96ebc-a50f-4f28-ba89-016832d44c33","Type":"ContainerDied","Data":"6551f689390e7d5898b8488b3adc3bc6ea05b6ea4e8fae514c75fe3c846cf0e0"}
Jul 08 03:22:32.747484 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.747443    2580 scope.go:117] "RemoveContainer" containerID="def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b"
Jul 08 03:22:32.762970 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.762949    2580 scope.go:117] "RemoveContainer" containerID="def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b"
Jul 08 03:22:32.763268 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:22:32.763248    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b\": container with ID starting with def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b not found: ID does not exist" containerID="def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b"
Jul 08 03:22:32.763348 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.763280    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b"} err="failed to get container status \"def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b\": rpc error: code = NotFound desc = could not find container \"def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b\": container with ID starting with def687549ce87e8e9195f7fd5efffa796ed011682a4f89df3e789c1aa83e0f6b not found: ID does not exist"
Jul 08 03:22:32.773467 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.773437    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"]
Jul 08 03:22:32.776864 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.776835    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a4e50e-787b94776c-lqxqp"]
Jul 08 03:22:32.840775 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.840680    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlkkv\" (UniqueName: \"kubernetes.io/projected/53b96ebc-a50f-4f28-ba89-016832d44c33-kube-api-access-jlkkv\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:22:32.840775 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.840712    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53b96ebc-a50f-4f28-ba89-016832d44c33-maas-api-tls\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:22:32.840775 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:32.840727    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53b96ebc-a50f-4f28-ba89-016832d44c33-openshift-service-ca\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:22:34.726661 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:34.726625    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53b96ebc-a50f-4f28-ba89-016832d44c33" path="/var/lib/kubelet/pods/53b96ebc-a50f-4f28-ba89-016832d44c33/volumes"
Jul 08 03:22:37.051166 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:37.051121    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:22:41.450291 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.450249    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"]
Jul 08 03:22:41.450981 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.450959    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b96ebc-a50f-4f28-ba89-016832d44c33" containerName="maas-api"
Jul 08 03:22:41.450981 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.450983    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b96ebc-a50f-4f28-ba89-016832d44c33" containerName="maas-api"
Jul 08 03:22:41.451143 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.451102    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b96ebc-a50f-4f28-ba89-016832d44c33" containerName="maas-api"
Jul 08 03:22:41.454377 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.454352    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:41.456771 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.456745    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-34dd30-serving-cert\""
Jul 08 03:22:41.456956 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.456851    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 03:22:41.456956 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.456856    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 03:22:41.457596 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.457580    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h8t2l\""
Jul 08 03:22:41.466698 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.466671    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"]
Jul 08 03:22:41.519716 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.519677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36381e8a-c033-4bc5-9c26-17c28a1116ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:41.519957 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.519727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk425\" (UniqueName: \"kubernetes.io/projected/36381e8a-c033-4bc5-9c26-17c28a1116ca-kube-api-access-kk425\") pod \"maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:41.519957 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.519760    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36381e8a-c033-4bc5-9c26-17c28a1116ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:41.621021 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.620977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36381e8a-c033-4bc5-9c26-17c28a1116ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:41.621245 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.621036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk425\" (UniqueName: \"kubernetes.io/projected/36381e8a-c033-4bc5-9c26-17c28a1116ca-kube-api-access-kk425\") pod \"maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:41.621245 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.621083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36381e8a-c033-4bc5-9c26-17c28a1116ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:41.621245 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:22:41.621206    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-serving-cert: secret "maas-api-e2e-shared-a-34dd30-serving-cert" not found
Jul 08 03:22:41.621434 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:22:41.621322    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36381e8a-c033-4bc5-9c26-17c28a1116ca-maas-api-tls podName:36381e8a-c033-4bc5-9c26-17c28a1116ca nodeName:}" failed. No retries permitted until 2026-07-08 03:22:42.121298845 +0000 UTC m=+2563.850557684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/36381e8a-c033-4bc5-9c26-17c28a1116ca-maas-api-tls") pod "maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb" (UID: "36381e8a-c033-4bc5-9c26-17c28a1116ca") : secret "maas-api-e2e-shared-a-34dd30-serving-cert" not found
Jul 08 03:22:41.621674 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.621651    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36381e8a-c033-4bc5-9c26-17c28a1116ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:41.632154 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:41.632126    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk425\" (UniqueName: \"kubernetes.io/projected/36381e8a-c033-4bc5-9c26-17c28a1116ca-kube-api-access-kk425\") pod \"maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:42.125980 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:42.125930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36381e8a-c033-4bc5-9c26-17c28a1116ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:42.128634 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:42.128607    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36381e8a-c033-4bc5-9c26-17c28a1116ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:42.365950 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:42.365914    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:42.512860 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:42.512831    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"]
Jul 08 03:22:42.515089 ip-10-0-132-232 kubenswrapper[2580]: W0708 03:22:42.515052    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36381e8a_c033_4bc5_9c26_17c28a1116ca.slice/crio-090e76b09cbd80454f246b610b5af1caf08ab45ef74b2141f379be43165c447c WatchSource:0}: Error finding container 090e76b09cbd80454f246b610b5af1caf08ab45ef74b2141f379be43165c447c: Status 404 returned error can't find the container with id 090e76b09cbd80454f246b610b5af1caf08ab45ef74b2141f379be43165c447c
Jul 08 03:22:42.806948 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:42.806909    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb" event={"ID":"36381e8a-c033-4bc5-9c26-17c28a1116ca","Type":"ContainerStarted","Data":"090e76b09cbd80454f246b610b5af1caf08ab45ef74b2141f379be43165c447c"}
Jul 08 03:22:43.813735 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:43.813699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb" event={"ID":"36381e8a-c033-4bc5-9c26-17c28a1116ca","Type":"ContainerStarted","Data":"28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f"}
Jul 08 03:22:43.814203 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:43.813791    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:22:43.831664 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:43.831604    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb" podStartSLOduration=2.008933718 podStartE2EDuration="2.831587622s" totalImagesPullingTime="822.653904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:22:43.828888006 +0000 UTC m=+2565.558146882" watchObservedRunningTime="2026-07-08 03:22:43.831587622 +0000 UTC m=+2565.560846481"
Jul 08 03:22:49.373395 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:49.373362    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:22:49.825076 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:22:49.825046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:23:00.853030 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:23:00.852989    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:25:01.422404 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:01.422361    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 03:25:01.431010 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:01.430988    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5wkfl_0459a02d-aa66-4d52-a7f4-f7291092440b/ovn-acl-logging/0.log"
Jul 08 03:25:59.375571 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.375533    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"]
Jul 08 03:25:59.376174 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.375766    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb" podUID="36381e8a-c033-4bc5-9c26-17c28a1116ca" containerName="maas-api" containerID="cri-o://28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f" gracePeriod=30
Jul 08 03:25:59.641056 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.641001    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:25:59.745268 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.745233    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36381e8a-c033-4bc5-9c26-17c28a1116ca-openshift-service-ca\") pod \"36381e8a-c033-4bc5-9c26-17c28a1116ca\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") "
Jul 08 03:25:59.745439 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.745281    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36381e8a-c033-4bc5-9c26-17c28a1116ca-maas-api-tls\") pod \"36381e8a-c033-4bc5-9c26-17c28a1116ca\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") "
Jul 08 03:25:59.745439 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.745397    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk425\" (UniqueName: \"kubernetes.io/projected/36381e8a-c033-4bc5-9c26-17c28a1116ca-kube-api-access-kk425\") pod \"36381e8a-c033-4bc5-9c26-17c28a1116ca\" (UID: \"36381e8a-c033-4bc5-9c26-17c28a1116ca\") "
Jul 08 03:25:59.745615 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.745593    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36381e8a-c033-4bc5-9c26-17c28a1116ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "36381e8a-c033-4bc5-9c26-17c28a1116ca" (UID: "36381e8a-c033-4bc5-9c26-17c28a1116ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:25:59.747623 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.747591    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36381e8a-c033-4bc5-9c26-17c28a1116ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "36381e8a-c033-4bc5-9c26-17c28a1116ca" (UID: "36381e8a-c033-4bc5-9c26-17c28a1116ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:25:59.747623 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.747612    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36381e8a-c033-4bc5-9c26-17c28a1116ca-kube-api-access-kk425" (OuterVolumeSpecName: "kube-api-access-kk425") pod "36381e8a-c033-4bc5-9c26-17c28a1116ca" (UID: "36381e8a-c033-4bc5-9c26-17c28a1116ca"). InnerVolumeSpecName "kube-api-access-kk425". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:25:59.846536 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.846498    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk425\" (UniqueName: \"kubernetes.io/projected/36381e8a-c033-4bc5-9c26-17c28a1116ca-kube-api-access-kk425\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:25:59.846536 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.846532    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36381e8a-c033-4bc5-9c26-17c28a1116ca-openshift-service-ca\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:25:59.846536 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.846546    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36381e8a-c033-4bc5-9c26-17c28a1116ca-maas-api-tls\") on node \"ip-10-0-132-232.ec2.internal\" DevicePath \"\""
Jul 08 03:25:59.894247 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.894157    2580 generic.go:356] "Generic (PLEG): container finished" podID="36381e8a-c033-4bc5-9c26-17c28a1116ca" containerID="28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f" exitCode=0
Jul 08 03:25:59.894247 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.894222    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"
Jul 08 03:25:59.894474 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.894243    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb" event={"ID":"36381e8a-c033-4bc5-9c26-17c28a1116ca","Type":"ContainerDied","Data":"28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f"}
Jul 08 03:25:59.894474 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.894299    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb" event={"ID":"36381e8a-c033-4bc5-9c26-17c28a1116ca","Type":"ContainerDied","Data":"090e76b09cbd80454f246b610b5af1caf08ab45ef74b2141f379be43165c447c"}
Jul 08 03:25:59.894474 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.894322    2580 scope.go:117] "RemoveContainer" containerID="28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f"
Jul 08 03:25:59.904864 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.904842    2580 scope.go:117] "RemoveContainer" containerID="28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f"
Jul 08 03:25:59.905145 ip-10-0-132-232 kubenswrapper[2580]: E0708 03:25:59.905126    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f\": container with ID starting with 28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f not found: ID does not exist" containerID="28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f"
Jul 08 03:25:59.905215 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.905156    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f"} err="failed to get container status \"28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f\": rpc error: code = NotFound desc = could not find container \"28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f\": container with ID starting with 28caf7c3512a8e35c9d585e13aa43302cb40295b0ebbdfdf14035abb3bb8a57f not found: ID does not exist"
Jul 08 03:25:59.917479 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.917454    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"]
Jul 08 03:25:59.919449 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:25:59.919429    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-34dd30-5d4794565-kzsdb"]
Jul 08 03:26:00.725765 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:00.725722    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36381e8a-c033-4bc5-9c26-17c28a1116ca" path="/var/lib/kubelet/pods/36381e8a-c033-4bc5-9c26-17c28a1116ca/volumes"
Jul 08 03:26:02.259531 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:02.259490    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:26:14.755298 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:14.755257    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qgj9l"]
Jul 08 03:26:17.418090 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:17.418056    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pkgfr_2390c03b-1799-43df-9555-f68ce908a6ee/manager/0.log"
Jul 08 03:26:17.533545 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:17.533511    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mjt8z_d6c01a05-8d71-495d-99d2-993b68bd1d37/manager/0.log"
Jul 08 03:26:17.768873 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:17.768845    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7f2jr_85118aa3-85be-4698-9658-9ec36dc21ead/server/0.log"
Jul 08 03:26:17.888037 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:17.888011    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-k6mzm_7493c91c-9317-467f-b410-5b78ceb71f3f/manager/0.log"
Jul 08 03:26:18.135872 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:18.135774    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv_508a2757-010f-4f93-b010-a18a04ea842f/copy-manifests/0.log"
Jul 08 03:26:18.142648 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:18.142618    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv_508a2757-010f-4f93-b010-a18a04ea842f/manager/0.log"
Jul 08 03:26:19.661643 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:19.661561    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2kzl4_dae62038-c44f-403a-813f-e4bb9d4a251f/manager/0.log"
Jul 08 03:26:19.772039 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:19.772011    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jgb6v_27f0b9dd-6603-44f5-8e65-c323104fccfc/manager/0.log"
Jul 08 03:26:20.007309 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:20.007237    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pzvtq_9c579ccf-893d-4805-87ca-e777b995cad1/registry-server/0.log"
Jul 08 03:26:20.129951 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:20.129912    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-b9tld_8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469/manager/0.log"
Jul 08 03:26:20.254735 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:20.254705    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qgj9l_8eefb65a-6cfe-4612-b28d-f99f9c8e75b0/limitador/0.log"
Jul 08 03:26:20.371193 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:20.371164    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f6qm9_42c0826a-e397-479a-9362-c3df88f85fc2/manager/0.log"
Jul 08 03:26:21.085083 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:21.085059    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dcfc578f7-rzm6r_025a3e0f-b41a-4edf-a8f8-325ba09d1bd6/kube-auth-proxy/0.log"
Jul 08 03:26:21.204719 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:21.204689    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-v6b4m_8856c157-da16-42ba-98e3-31fc199bcb0e/istio-proxy/1.log"
Jul 08 03:26:21.320563 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:21.320532    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2h8n5_1b7ccbf6-f838-41a1-b4e1-c75253f741f2/payload-pre-processing/0.log"
Jul 08 03:26:21.438603 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:21.438529    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-vkp9t_e9d50934-5131-4a8c-9228-0bd186d4fe32/payload-processing/0.log"
Jul 08 03:26:22.019992 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:22.019959    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hjvmb_5f586049-142c-4b87-ba46-f3e2169ab23c/main/0.log"
Jul 08 03:26:26.667307 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.667220    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wbm7l/must-gather-tqz6l"]
Jul 08 03:26:26.667661 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.667640    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36381e8a-c033-4bc5-9c26-17c28a1116ca" containerName="maas-api"
Jul 08 03:26:26.667661 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.667651    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="36381e8a-c033-4bc5-9c26-17c28a1116ca" containerName="maas-api"
Jul 08 03:26:26.667758 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.667747    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="36381e8a-c033-4bc5-9c26-17c28a1116ca" containerName="maas-api"
Jul 08 03:26:26.669994 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.669977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wbm7l/must-gather-tqz6l"
Jul 08 03:26:26.674214 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.674192    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wbm7l\"/\"kube-root-ca.crt\""
Jul 08 03:26:26.674357 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.674224    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wbm7l\"/\"default-dockercfg-q7m95\""
Jul 08 03:26:26.674991 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.674969    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wbm7l\"/\"openshift-service-ca.crt\""
Jul 08 03:26:26.693549 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.693516    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wbm7l/must-gather-tqz6l"]
Jul 08 03:26:26.792169 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.792123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwp9w\" (UniqueName: \"kubernetes.io/projected/295f5231-eb09-4cc9-ab6d-f1135417751f-kube-api-access-kwp9w\") pod \"must-gather-tqz6l\" (UID: \"295f5231-eb09-4cc9-ab6d-f1135417751f\") " pod="openshift-must-gather-wbm7l/must-gather-tqz6l"
Jul 08 03:26:26.792372 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.792295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/295f5231-eb09-4cc9-ab6d-f1135417751f-must-gather-output\") pod \"must-gather-tqz6l\" (UID: \"295f5231-eb09-4cc9-ab6d-f1135417751f\") " pod="openshift-must-gather-wbm7l/must-gather-tqz6l"
Jul 08 03:26:26.893745 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.893702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/295f5231-eb09-4cc9-ab6d-f1135417751f-must-gather-output\") pod \"must-gather-tqz6l\" (UID: \"295f5231-eb09-4cc9-ab6d-f1135417751f\") " pod="openshift-must-gather-wbm7l/must-gather-tqz6l"
Jul 08 03:26:26.893972 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.893768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwp9w\" (UniqueName: \"kubernetes.io/projected/295f5231-eb09-4cc9-ab6d-f1135417751f-kube-api-access-kwp9w\") pod \"must-gather-tqz6l\" (UID: \"295f5231-eb09-4cc9-ab6d-f1135417751f\") " pod="openshift-must-gather-wbm7l/must-gather-tqz6l"
Jul 08 03:26:26.894101 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.894080    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/295f5231-eb09-4cc9-ab6d-f1135417751f-must-gather-output\") pod \"must-gather-tqz6l\" (UID: \"295f5231-eb09-4cc9-ab6d-f1135417751f\") " pod="openshift-must-gather-wbm7l/must-gather-tqz6l"
Jul 08 03:26:26.902649 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.902624    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwp9w\" (UniqueName: \"kubernetes.io/projected/295f5231-eb09-4cc9-ab6d-f1135417751f-kube-api-access-kwp9w\") pod \"must-gather-tqz6l\" (UID: \"295f5231-eb09-4cc9-ab6d-f1135417751f\") " pod="openshift-must-gather-wbm7l/must-gather-tqz6l"
Jul 08 03:26:26.979470 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:26.979384    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wbm7l/must-gather-tqz6l"
Jul 08 03:26:27.125495 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:27.125472    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wbm7l/must-gather-tqz6l"]
Jul 08 03:26:27.127648 ip-10-0-132-232 kubenswrapper[2580]: W0708 03:26:27.127620    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod295f5231_eb09_4cc9_ab6d_f1135417751f.slice/crio-7241fedd4e8371c81e22df83b5b5a8d6056ba015d605b14227bc1b766358f672 WatchSource:0}: Error finding container 7241fedd4e8371c81e22df83b5b5a8d6056ba015d605b14227bc1b766358f672: Status 404 returned error can't find the container with id 7241fedd4e8371c81e22df83b5b5a8d6056ba015d605b14227bc1b766358f672
Jul 08 03:26:27.129917 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:27.129897    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 03:26:28.058758 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:28.058725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbm7l/must-gather-tqz6l" event={"ID":"295f5231-eb09-4cc9-ab6d-f1135417751f","Type":"ContainerStarted","Data":"7241fedd4e8371c81e22df83b5b5a8d6056ba015d605b14227bc1b766358f672"}
Jul 08 03:26:29.072023 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:29.071976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbm7l/must-gather-tqz6l" event={"ID":"295f5231-eb09-4cc9-ab6d-f1135417751f","Type":"ContainerStarted","Data":"accc48dba4c2096a9a523e6ba2e6c3dcffc9915307cb13a9d1862d6e1ae0a2ed"}
Jul 08 03:26:29.072493 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:29.072040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbm7l/must-gather-tqz6l" event={"ID":"295f5231-eb09-4cc9-ab6d-f1135417751f","Type":"ContainerStarted","Data":"d3b91c797ca0fd31c98595b1db44a2ce642ba242d44d0126b12de14cbf2b9e64"}
Jul 08 03:26:29.093118 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:29.093043    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wbm7l/must-gather-tqz6l" podStartSLOduration=2.05664569 podStartE2EDuration="3.093019466s" totalImagesPullingTime="1.036373776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:26:29.09007892 +0000 UTC m=+2790.819337772" watchObservedRunningTime="2026-07-08 03:26:29.093019466 +0000 UTC m=+2790.822278325"
Jul 08 03:26:29.952699 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:29.952670    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8mhpl_0a120d9d-d928-47cc-8200-7aad9d204593/global-pull-secret-syncer/0.log"
Jul 08 03:26:30.200059 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:30.200027    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sfjw8_9d241be7-d0de-4d31-aa8d-a68c3c0b3b7c/konnectivity-agent/0.log"
Jul 08 03:26:30.340740 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:30.340691    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-232.ec2.internal_1aa1d1c221de548ce4b6c3f565e081e3/haproxy/0.log"
Jul 08 03:26:35.142382 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:35.142354    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2kzl4_dae62038-c44f-403a-813f-e4bb9d4a251f/manager/0.log"
Jul 08 03:26:35.181208 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:35.181174    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jgb6v_27f0b9dd-6603-44f5-8e65-c323104fccfc/manager/0.log"
Jul 08 03:26:35.261900 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:35.261865    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pzvtq_9c579ccf-893d-4805-87ca-e777b995cad1/registry-server/0.log"
Jul 08 03:26:35.445322 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:35.445232    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-b9tld_8f1b9aba-8494-4eb0-bdc2-5f92a4f1a469/manager/0.log"
Jul 08 03:26:35.490739 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:35.490705    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qgj9l_8eefb65a-6cfe-4612-b28d-f99f9c8e75b0/limitador/0.log"
Jul 08 03:26:35.567245 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:35.567194    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f6qm9_42c0826a-e397-479a-9362-c3df88f85fc2/manager/0.log"
Jul 08 03:26:37.558822 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:37.558561    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-6n6lw_5216b4bf-66e1-45f5-94c2-dca791e67f14/cluster-monitoring-operator/0.log"
Jul 08 03:26:37.592915 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:37.592876    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jr7fs_8592922a-0e91-4403-9c68-1c3b09140821/kube-state-metrics/0.log"
Jul 08 03:26:37.617656 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:37.617625    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jr7fs_8592922a-0e91-4403-9c68-1c3b09140821/kube-rbac-proxy-main/0.log"
Jul 08 03:26:37.640981 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:37.640944    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jr7fs_8592922a-0e91-4403-9c68-1c3b09140821/kube-rbac-proxy-self/0.log"
Jul 08 03:26:37.674612 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:37.674584    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-696854596d-8bqln_db9d4c47-0567-4f76-a151-5126668662b3/metrics-server/0.log"
Jul 08 03:26:37.729701 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:37.729618    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-q6k4d_d29863d9-b0d2-4b5b-b974-38d866542673/monitoring-plugin/0.log"
Jul 08 03:26:37.860748 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:37.860707    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5pj9z_090865a2-15fb-4ccb-b0bb-fbe6f3442f43/node-exporter/0.log"
Jul 08 03:26:37.891925 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:37.891895    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5pj9z_090865a2-15fb-4ccb-b0bb-fbe6f3442f43/kube-rbac-proxy/0.log"
Jul 08 03:26:37.921296 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:37.921270    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5pj9z_090865a2-15fb-4ccb-b0bb-fbe6f3442f43/init-textfile/0.log"
Jul 08 03:26:38.161509 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.161408    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b5147928-0a76-40bb-b562-43dfd6a5aefc/prometheus/0.log"
Jul 08 03:26:38.203098 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.203068    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b5147928-0a76-40bb-b562-43dfd6a5aefc/config-reloader/0.log"
Jul 08 03:26:38.237646 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.237613    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b5147928-0a76-40bb-b562-43dfd6a5aefc/thanos-sidecar/0.log"
Jul 08 03:26:38.266046 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.266020    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b5147928-0a76-40bb-b562-43dfd6a5aefc/kube-rbac-proxy-web/0.log"
Jul 08 03:26:38.294896 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.294860    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b5147928-0a76-40bb-b562-43dfd6a5aefc/kube-rbac-proxy/0.log"
Jul 08 03:26:38.323598 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.323555    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b5147928-0a76-40bb-b562-43dfd6a5aefc/kube-rbac-proxy-thanos/0.log"
Jul 08 03:26:38.350636 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.350582    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b5147928-0a76-40bb-b562-43dfd6a5aefc/init-config-reloader/0.log"
Jul 08 03:26:38.385382 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.385350    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-fb22b_354fca5c-1821-4abf-a750-9f8575a494b2/prometheus-operator/0.log"
Jul 08 03:26:38.405891 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.405855    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-fb22b_354fca5c-1821-4abf-a750-9f8575a494b2/kube-rbac-proxy/0.log"
Jul 08 03:26:38.545734 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.545707    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f58668bbc-d42zs_366c44f6-fbd2-480c-9135-240198046c55/thanos-query/0.log"
Jul 08 03:26:38.571376 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.571350    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f58668bbc-d42zs_366c44f6-fbd2-480c-9135-240198046c55/kube-rbac-proxy-web/0.log"
Jul 08 03:26:38.599039 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.599002    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f58668bbc-d42zs_366c44f6-fbd2-480c-9135-240198046c55/kube-rbac-proxy/0.log"
Jul 08 03:26:38.624213 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.624183    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f58668bbc-d42zs_366c44f6-fbd2-480c-9135-240198046c55/prom-label-proxy/0.log"
Jul 08 03:26:38.649492 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.649449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f58668bbc-d42zs_366c44f6-fbd2-480c-9135-240198046c55/kube-rbac-proxy-rules/0.log"
Jul 08 03:26:38.677510 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:38.677479    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f58668bbc-d42zs_366c44f6-fbd2-480c-9135-240198046c55/kube-rbac-proxy-metrics/0.log"
Jul 08 03:26:39.886442 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:39.886407    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-42pzm_a3957494-6ce0-4487-89ff-b272483f09f8/networking-console-plugin/0.log"
Jul 08 03:26:39.962379 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:39.962340    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"]
Jul 08 03:26:39.967287 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:39.967257    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:39.975082 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:39.975056    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"]
Jul 08 03:26:40.045503 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.045461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-sys\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.045751 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.045731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbkml\" (UniqueName: \"kubernetes.io/projected/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-kube-api-access-sbkml\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.045970 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.045949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-lib-modules\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.046102 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.046085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-proc\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.046211 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.046198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-podres\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.147704 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.147614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-sys\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.147704 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.147656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbkml\" (UniqueName: \"kubernetes.io/projected/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-kube-api-access-sbkml\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.147969 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.147704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-lib-modules\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.147969 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.147728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-proc\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.147969 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.147752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-podres\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.147969 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.147784    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-sys\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.147969 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.147888    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-proc\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.147969 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.147900    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-lib-modules\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.147969 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.147899    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-podres\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.157777 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.157740    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbkml\" (UniqueName: \"kubernetes.io/projected/d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7-kube-api-access-sbkml\") pod \"perf-node-gather-daemonset-86gxz\" (UID: \"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7\") " pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.282482 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.282234    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:40.485832 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:40.485775    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"]
Jul 08 03:26:40.487861 ip-10-0-132-232 kubenswrapper[2580]: W0708 03:26:40.487828    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd895171d_5ac5_4b4d_bdee_bfd37e6c6ad7.slice/crio-239df4d2ffec7e95bed453f80a10bbf9f8db65eb7b7d0d65d45353a52e6124e6 WatchSource:0}: Error finding container 239df4d2ffec7e95bed453f80a10bbf9f8db65eb7b7d0d65d45353a52e6124e6: Status 404 returned error can't find the container with id 239df4d2ffec7e95bed453f80a10bbf9f8db65eb7b7d0d65d45353a52e6124e6
Jul 08 03:26:41.158842 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:41.158781    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-gkfc9_2eda82f4-339e-41c4-8b6e-bfa45619d281/download-server/0.log"
Jul 08 03:26:41.197608 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:41.197562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz" event={"ID":"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7","Type":"ContainerStarted","Data":"2c9b7be44404ea3c5a28fb98cc613da4d41d64847495a6037f2205bdae75a3fe"}
Jul 08 03:26:41.197828 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:41.197637    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz" event={"ID":"d895171d-5ac5-4b4d-bdee-bfd37e6c6ad7","Type":"ContainerStarted","Data":"239df4d2ffec7e95bed453f80a10bbf9f8db65eb7b7d0d65d45353a52e6124e6"}
Jul 08 03:26:41.198175 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:41.198146    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:41.217588 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:41.217519    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz" podStartSLOduration=2.217493776 podStartE2EDuration="2.217493776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:26:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:26:41.215443599 +0000 UTC m=+2802.944702479" watchObservedRunningTime="2026-07-08 03:26:41.217493776 +0000 UTC m=+2802.946752636"
Jul 08 03:26:41.773752 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:41.773727    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-j7pqc_3c7d85cc-d389-4e15-b7d9-7fdb4272671f/volume-data-source-validator/0.log"
Jul 08 03:26:42.949954 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:42.949916    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xdd7v_b3704874-db93-4dc6-aeab-b6ad43bd74e6/dns/0.log"
Jul 08 03:26:42.972105 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:42.972080    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xdd7v_b3704874-db93-4dc6-aeab-b6ad43bd74e6/kube-rbac-proxy/0.log"
Jul 08 03:26:43.048396 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:43.048369    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zv4zt_1c78c2e9-4d2c-4c57-8517-7e0da7dde3d1/dns-node-resolver/0.log"
Jul 08 03:26:43.666336 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:43.666311    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n9r7r_9d5fe15c-c8aa-408f-8b62-b5e06bbb578b/node-ca/0.log"
Jul 08 03:26:45.043945 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:45.043914    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dcfc578f7-rzm6r_025a3e0f-b41a-4edf-a8f8-325ba09d1bd6/kube-auth-proxy/0.log"
Jul 08 03:26:45.075274 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:45.075237    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-v6b4m_8856c157-da16-42ba-98e3-31fc199bcb0e/istio-proxy/0.log"
Jul 08 03:26:45.114539 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:45.114481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-v6b4m_8856c157-da16-42ba-98e3-31fc199bcb0e/istio-proxy/1.log"
Jul 08 03:26:45.159468 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:45.159438    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2h8n5_1b7ccbf6-f838-41a1-b4e1-c75253f741f2/payload-pre-processing/0.log"
Jul 08 03:26:45.216436 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:45.216408    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-vkp9t_e9d50934-5131-4a8c-9228-0bd186d4fe32/payload-processing/0.log"
Jul 08 03:26:45.975243 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:45.975209    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bkf6s_be2b357e-a17e-4689-843b-b519c8e5dc76/serve-healthcheck-canary/0.log"
Jul 08 03:26:46.519117 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:46.519059    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bjvpg_63c89d51-08c2-4cc4-9991-f88d4a9c6835/kube-rbac-proxy/0.log"
Jul 08 03:26:46.571087 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:46.571060    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bjvpg_63c89d51-08c2-4cc4-9991-f88d4a9c6835/exporter/0.log"
Jul 08 03:26:46.599371 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:46.599346    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bjvpg_63c89d51-08c2-4cc4-9991-f88d4a9c6835/extractor/0.log"
Jul 08 03:26:47.227607 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:47.227574    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wbm7l/perf-node-gather-daemonset-86gxz"
Jul 08 03:26:49.171058 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:49.171026    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pkgfr_2390c03b-1799-43df-9555-f68ce908a6ee/manager/0.log"
Jul 08 03:26:49.321668 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:49.321627    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mjt8z_d6c01a05-8d71-495d-99d2-993b68bd1d37/manager/0.log"
Jul 08 03:26:49.511987 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:49.511938    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7f2jr_85118aa3-85be-4698-9658-9ec36dc21ead/server/0.log"
Jul 08 03:26:49.611492 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:49.611442    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-k6mzm_7493c91c-9317-467f-b410-5b78ceb71f3f/manager/0.log"
Jul 08 03:26:49.779382 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:49.779351    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv_508a2757-010f-4f93-b010-a18a04ea842f/manager/0.log"
Jul 08 03:26:49.803241 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:49.803211    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fbb74d9dd-8w7bv_508a2757-010f-4f93-b010-a18a04ea842f/copy-manifests/0.log"
Jul 08 03:26:51.209241 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:51.209215    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-d97dg_eac7f9d8-a35d-49e1-b273-5623cc5f48c5/openshift-lws-operator/0.log"
Jul 08 03:26:51.426606 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:51.426580    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dcfc578f7-rzm6r_025a3e0f-b41a-4edf-a8f8-325ba09d1bd6/kube-auth-proxy/0.log"
Jul 08 03:26:51.447036 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:51.447004    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-v6b4m_8856c157-da16-42ba-98e3-31fc199bcb0e/istio-proxy/0.log"
Jul 08 03:26:51.486130 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:51.486042    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-v6b4m_8856c157-da16-42ba-98e3-31fc199bcb0e/istio-proxy/1.log"
Jul 08 03:26:51.525091 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:51.525054    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2h8n5_1b7ccbf6-f838-41a1-b4e1-c75253f741f2/payload-pre-processing/0.log"
Jul 08 03:26:51.573726 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:51.573693    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-vkp9t_e9d50934-5131-4a8c-9228-0bd186d4fe32/payload-processing/0.log"
Jul 08 03:26:53.025453 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:53.025415    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dcfc578f7-rzm6r_025a3e0f-b41a-4edf-a8f8-325ba09d1bd6/kube-auth-proxy/0.log"
Jul 08 03:26:53.047343 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:53.047318    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-v6b4m_8856c157-da16-42ba-98e3-31fc199bcb0e/istio-proxy/0.log"
Jul 08 03:26:53.081488 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:53.081454    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-v6b4m_8856c157-da16-42ba-98e3-31fc199bcb0e/istio-proxy/1.log"
Jul 08 03:26:53.124082 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:53.124038    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2h8n5_1b7ccbf6-f838-41a1-b4e1-c75253f741f2/payload-pre-processing/0.log"
Jul 08 03:26:53.178110 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:53.178044    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-vkp9t_e9d50934-5131-4a8c-9228-0bd186d4fe32/payload-processing/0.log"
Jul 08 03:26:56.462648 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:56.462623    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j2rhn_845016c5-20c2-4588-a668-d74ed9b8f215/migrator/0.log"
Jul 08 03:26:56.484088 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:56.484059    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j2rhn_845016c5-20c2-4588-a668-d74ed9b8f215/graceful-termination/0.log"
Jul 08 03:26:56.860338 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:56.860298    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-kgp2r_ebda22f1-b276-4316-a811-fffe735f5fd7/kube-storage-version-migrator-operator/1.log"
Jul 08 03:26:56.861282 ip-10-0-132-232 kubenswrapper[2580]: I0708 03:26:56.861252    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-kgp2r_ebda22f1-b276-4316-a811-fffe735f5fd7/kube-storage-version-migrator-operator/0.log"