Jul 01 16:38:38.527753 ip-10-0-130-152 systemd[1]: Starting Kubernetes Kubelet... Jul 01 16:38:38.852775 ip-10-0-130-152 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:38:38.852775 ip-10-0-130-152 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 16:38:38.852775 ip-10-0-130-152 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:38:38.852775 ip-10-0-130-152 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 16:38:38.852775 ip-10-0-130-152 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:38:38.854913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.854819 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 16:38:38.858256 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858237 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:38:38.858256 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858257 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858261 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858264 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858267 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858270 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858272 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858280 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858284 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858287 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858291 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858293 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858296 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858298 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858301 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858303 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858308 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858312 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858315 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858318 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:38:38.858326 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858321 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858323 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858326 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858329 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858332 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858337 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858340 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858343 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858346 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858348 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858351 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858353 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858356 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858359 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858362 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858366 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858368 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858370 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858373 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858376 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:38:38.858801 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858378 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858380 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858383 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858387 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858389 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858392 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858395 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858397 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858400 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858402 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858404 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858407 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858410 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858413 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858416 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858418 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858421 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858423 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858426 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858429 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:38:38.859316 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858431 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858433 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858450 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858453 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858456 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858458 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858461 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858463 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858466 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858469 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858472 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858474 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858476 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858479 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858481 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858484 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858487 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858490 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858492 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:38:38.859818 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858495 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858497 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858500 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858502 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858504 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858507 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858509 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858512 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858515 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858517 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858520 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858522 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858526 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858530 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858533 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858535 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858538 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858540 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858543 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.858545 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:38:38.860275 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859266 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859272 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859275 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859278 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859281 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859284 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859286 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859289 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859292 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859297 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859301 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859303 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859306 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859308 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859311 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859313 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859316 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859318 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859322 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859326 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:38:38.860785 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859329 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859331 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859334 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859337 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859340 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859343 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859345 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859348 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859350 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859352 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859355 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859357 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859360 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859362 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859365 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859367 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859371 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859375 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859378 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:38:38.861289 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859382 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859385 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859388 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859390 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859393 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859395 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859398 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859400 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859403 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859405 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859407 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859410 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859413 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859415 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859418 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859420 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859423 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859425 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859428 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859430 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:38:38.861763 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859433 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859435 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859454 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859458 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859461 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859464 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859466 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859469 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859471 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859474 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859477 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859480 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859482 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859485 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859488 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859490 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859495 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859499 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859502 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:38:38.862292 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859504 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859507 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859510 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859512 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859515 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859518 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859521 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859523 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859525 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859528 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859530 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859533 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859536 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859538 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859540 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859543 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859546 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859548 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859551 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859553 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:38:38.862782 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859556 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859938 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859943 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859954 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859957 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859960 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859963 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859966 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859969 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859971 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859975 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859977 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859980 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859982 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859985 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859988 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859990 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859993 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859995 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.859998 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:38:38.863277 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860000 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860003 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860005 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860008 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860010 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860012 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860015 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860017 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860020 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860022 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860025 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860027 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860030 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860032 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860034 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860037 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860040 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860042 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860045 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:38:38.863780 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860047 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860050 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860052 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860055 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860057 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860059 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860061 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860064 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860066 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860069 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860074 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860077 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860079 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860082 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860084 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860087 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860089 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860091 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860094 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:38:38.864237 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860096 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860099 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860102 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860105 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860108 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860110 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860113 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860115 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860117 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860120 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860123 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860126 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860129 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860131 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860133 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860136 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860138 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860140 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860143 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860146 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:38:38.864706 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860148 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860151 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860154 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860159 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860161 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860165 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860168 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860171 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860174 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860177 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860180 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860183 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860185 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860187 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860190 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860193 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860195 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860198 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860200 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860202 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:38:38.865278 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860205 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860207 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860293 2552 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860304 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860317 2552 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860323 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860329 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860332 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860336 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860341 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860344 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860347 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860350 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860353 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860356 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860360 2552 flags.go:64] FLAG: --cgroup-root="" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860363 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860366 2552 flags.go:64] FLAG: --client-ca-file="" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860369 2552 flags.go:64] FLAG: --cloud-provider="external" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860372 2552 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860377 2552 flags.go:64] FLAG: --cluster-domain="" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860381 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860384 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860387 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 16:38:38.865812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860390 2552 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860394 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860397 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860400 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860404 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860407 2552 flags.go:64] FLAG: --contention-profiling="false" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860410 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860413 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860416 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860418 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860422 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860425 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860428 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860435 2552 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860451 2552 flags.go:64] FLAG: --enable-server="true" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860454 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860460 2552 flags.go:64] FLAG: --event-burst="100" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860463 2552 flags.go:64] FLAG: --event-qps="50" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860465 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860468 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860471 2552 flags.go:64] FLAG: --eviction-hard="" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860475 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860478 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860482 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860485 2552 flags.go:64] FLAG: --eviction-soft="" Jul 01 16:38:38.866391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860488 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860491 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860494 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860497 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860500 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860502 2552 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860505 2552 flags.go:64] FLAG: --feature-gates="" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860509 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860511 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860515 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860518 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860521 2552 flags.go:64] FLAG: --healthz-port="10248" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860524 2552 flags.go:64] FLAG: --help="false" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860526 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-130-152.ec2.internal" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860529 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860532 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860535 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860538 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860541 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860544 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860547 2552 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860550 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860553 2552 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 16:38:38.867040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860556 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860559 2552 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860562 2552 flags.go:64] FLAG: --kube-reserved="" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860565 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860568 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860570 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860573 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860577 2552 flags.go:64] FLAG: --lock-file="" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860580 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860583 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860586 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860592 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860595 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860597 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860600 2552 flags.go:64] FLAG: --logging-format="text" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860603 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860606 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860609 2552 flags.go:64] FLAG: --manifest-url="" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860612 2552 flags.go:64] FLAG: --manifest-url-header="" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860616 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860619 2552 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860627 2552 flags.go:64] FLAG: --max-pods="110" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860630 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860633 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860635 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 16:38:38.867683 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860638 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860641 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860644 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860647 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860655 2552 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860658 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860662 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860664 2552 flags.go:64] FLAG: --pod-cidr="" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860667 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860673 2552 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860676 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860679 2552 flags.go:64] FLAG: --pods-per-core="0" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860682 2552 flags.go:64] FLAG: --port="10250" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860684 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860689 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06f2a44f0028398b0" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860693 2552 flags.go:64] FLAG: --qos-reserved="" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860696 2552 flags.go:64] FLAG: --read-only-port="10255" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860699 2552 flags.go:64] FLAG: --register-node="true" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860702 2552 flags.go:64] FLAG: --register-with-taints="" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860705 2552 flags.go:64] FLAG: --registry-burst="10" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860708 2552 flags.go:64] FLAG: --registry-qps="5" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860710 2552 flags.go:64] FLAG: --reserved-cpus="" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860713 2552 flags.go:64] FLAG: --reserved-memory="" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860717 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860720 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 16:38:38.868319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860723 2552 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860725 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860728 2552 flags.go:64] FLAG: --runonce="false" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860731 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860734 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860737 2552 flags.go:64] FLAG: --seccomp-default="false" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860739 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860742 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860745 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860748 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860751 2552 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860754 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860756 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860759 2552 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860762 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860765 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860768 2552 flags.go:64] FLAG: --system-cgroups="" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860770 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860775 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860778 2552 flags.go:64] FLAG: --tls-cert-file="" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860781 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860786 2552 flags.go:64] FLAG: --tls-min-version="" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860791 2552 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860794 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860797 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 16:38:38.868937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860800 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860803 2552 flags.go:64] FLAG: --v="2" Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860807 2552 flags.go:64] FLAG: --version="false" Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860811 2552 flags.go:64] FLAG: --vmodule="" Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860815 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.860818 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860950 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860954 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860957 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860959 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860962 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860965 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860969 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860972 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860975 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860978 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860981 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860983 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860986 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860988 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860991 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:38:38.869585 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860993 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860996 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.860999 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861001 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861003 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861006 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861008 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861012 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861015 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861018 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861020 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861023 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861025 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861028 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861031 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861033 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861036 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861038 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861041 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861043 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:38:38.870088 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861046 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861048 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861051 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861053 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861056 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861058 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861060 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861063 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861065 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861067 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861070 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861072 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861075 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861077 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861081 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861085 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861087 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861090 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861092 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861104 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:38:38.870672 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861109 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861113 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861116 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861119 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861122 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861124 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861127 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861129 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861132 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861135 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861137 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861140 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861142 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861145 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861147 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861150 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861152 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861155 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861157 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861160 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:38:38.871355 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861162 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861165 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861168 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861170 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861172 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861175 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861177 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861180 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861183 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861185 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861188 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861192 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861196 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861198 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861201 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861203 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861205 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861208 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861210 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:38:38.872148 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861213 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861215 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861218 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861220 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.861223 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.861689 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.869868 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.869887 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.869908 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.869917 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.869979 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.869984 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.869988 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.869991 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.869994 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:38:38.872652 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.869997 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870000 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870003 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870005 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870008 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870012 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870015 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870018 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870021 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870023 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870026 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870029 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870031 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870034 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870037 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870039 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870042 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870044 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870047 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870049 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:38:38.873027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870052 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870054 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870056 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870059 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870062 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870067 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870071 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870074 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870076 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870079 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870081 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870083 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870086 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870089 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870091 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870094 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870097 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870100 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870103 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870106 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:38:38.873546 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870108 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870111 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870113 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870116 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870118 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870120 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870123 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870125 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870128 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870130 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870133 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870135 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870137 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870142 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870146 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870149 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870153 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870156 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870158 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:38:38.874027 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870162 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870164 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870167 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870169 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870172 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870175 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870177 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870179 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870181 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870184 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870186 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870189 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870192 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870194 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870197 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870199 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870202 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870204 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870206 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:38:38.874622 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870209 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870213 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870216 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870218 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870221 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870223 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870226 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870229 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870231 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870234 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870238 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870241 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870243 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870246 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870248 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:38:38.875077 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870251 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.870256 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870380 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870385 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870388 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870391 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870393 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870396 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870399 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870402 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870404 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870408 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870412 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870415 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870418 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:38:38.875564 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870421 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870423 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870426 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870428 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870431 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870434 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870453 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870456 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870459 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870461 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870464 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870466 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870469 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870472 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870475 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870479 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870482 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870485 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870488 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:38:38.876016 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870491 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870494 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870496 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870499 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870502 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870505 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870507 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870510 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870512 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870515 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870517 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870520 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870522 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870524 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870527 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870529 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870532 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870534 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870536 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870539 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:38:38.876805 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870541 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870543 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870546 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870548 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870551 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870554 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870557 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870559 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870562 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870564 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870567 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870569 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870571 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870574 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870576 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870579 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870581 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870583 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870586 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870588 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:38:38.877554 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870591 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870593 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870595 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870598 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870601 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870603 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870606 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870608 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870610 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870613 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870615 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870617 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870619 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870622 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870624 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870627 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870629 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870632 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870635 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870637 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:38:38.878196 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870640 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870642 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870645 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870649 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870651 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870654 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:38.870657 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.870662 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.870920 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.874111 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.875259 2552 server.go:1019] "Starting client certificate rotation" Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.875376 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.875854 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:38:38.878857 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.877388 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:38:38.879189 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.878629 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:38:38.888050 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.888025 2552 log.go:25] "Validated CRI v1 runtime API" Jul 01 16:38:38.890390 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.890367 2552 log.go:25] "Validated CRI v1 image API" Jul 01 16:38:38.891883 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.891864 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 16:38:38.894193 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.894166 2552 fs.go:135] Filesystem UUIDs: map[00a1167f-3335-4068-97cb-441d1f10f040:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a33bf552-5278-4035-9002-d748c8fcef46:/dev/nvme0n1p3] Jul 01 16:38:38.894268 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.894192 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 16:38:38.899802 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.899677 2552 manager.go:216] Machine: {Timestamp:2026-07-01 16:38:38.898337441 +0000 UTC m=+0.271735618 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109948 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ecb94c0f3363c0acff1cec5ab295c SystemUUID:ec2ecb94-c0f3-363c-0acf-f1cec5ab295c BootID:051df208-869e-4386-ad65-d17e07e3801f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d4:dd:56:e7:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d4:dd:56:e7:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:98:b4:67:f3:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 16:38:38.899802 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.899794 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 16:38:38.899937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.899890 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 16:38:38.902405 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.902367 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 16:38:38.902564 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.902408 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-152.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 16:38:38.903584 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.903572 2552 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 16:38:38.903621 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.903587 2552 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 16:38:38.903621 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.903595 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:38:38.904137 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.904126 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:38:38.904910 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.904899 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 16:38:38.905478 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.905461 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:38:38.908523 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.908509 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:38:38.908661 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.908651 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 16:38:38.908698 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.908690 2552 kubelet.go:486] "Attempting to sync node with API server" Jul 01 16:38:38.908730 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.908701 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 16:38:38.908730 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.908720 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 16:38:38.908730 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.908730 2552 kubelet.go:398] "Adding apiserver pod source" Jul 01 16:38:38.908819 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.908749 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 16:38:38.909129 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.909116 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:38:38.909176 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.909135 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:38:38.912021 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.911998 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 16:38:38.913913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.913896 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 16:38:38.914016 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.913935 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 16:38:38.914553 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.914538 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 16:38:38.914651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.914559 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 16:38:38.914651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.914569 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 16:38:38.914651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.914577 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 16:38:38.914651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.914590 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 16:38:38.914651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.914598 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 16:38:38.914651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.914609 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 16:38:38.914651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.914617 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 16:38:38.914651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.914627 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 16:38:38.914651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.914635 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 16:38:38.914651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.914647 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 16:38:38.914651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.914655 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 16:38:38.915232 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.915222 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 16:38:38.915284 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.915234 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 16:38:38.917482 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.917436 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-152.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 16:38:38.918316 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:38.918265 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 16:38:38.918316 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:38.918298 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 16:38:38.918937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.918921 2552 server.go:1268] "Started kubelet" Jul 01 16:38:38.919049 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.919012 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 16:38:38.919098 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.919045 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 16:38:38.919098 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.919076 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 16:38:38.919973 ip-10-0-130-152 systemd[1]: Started Kubernetes Kubelet. Jul 01 16:38:38.920390 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.920240 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 16:38:38.921120 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.921090 2552 server.go:310] "Adding debug handlers to kubelet server" Jul 01 16:38:38.924262 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:38.924244 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 16:38:38.925951 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.925927 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 16:38:38.926063 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.925930 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 16:38:38.926206 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:38.926036 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 01 16:38:38.926549 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.926518 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 16:38:38.926549 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.926552 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 16:38:38.926668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.926518 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 16:38:38.926720 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.926680 2552 reconstruct.go:97] "Volume reconstruction finished" Jul 01 16:38:38.926720 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.926686 2552 reconciler.go:29] "Reconciler: start to sync state" Jul 01 16:38:38.927056 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.927036 2552 factory.go:153] Registering CRI-O factory Jul 01 16:38:38.927056 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.927057 2552 factory.go:223] Registration of the crio container factory successfully Jul 01 16:38:38.927223 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.927130 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 16:38:38.927223 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.927140 2552 factory.go:55] Registering systemd factory Jul 01 16:38:38.927223 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.927148 2552 factory.go:223] Registration of the systemd container factory successfully Jul 01 16:38:38.927223 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.927168 2552 factory.go:103] Registering Raw factory Jul 01 16:38:38.927223 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.927178 2552 manager.go:1196] Started watching for new ooms in manager Jul 01 16:38:38.927834 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.927812 2552 manager.go:349] Starting recovery of all containers Jul 01 16:38:38.928305 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:38.927108 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-152.ec2.internal.18be37dba0b52f3a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-152.ec2.internal,UID:ip-10-0-130-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-152.ec2.internal,},FirstTimestamp:2026-07-01 16:38:38.918889274 +0000 UTC m=+0.292287452,LastTimestamp:2026-07-01 16:38:38.918889274 +0000 UTC m=+0.292287452,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-152.ec2.internal,}" Jul 01 16:38:38.930419 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.930398 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ftl9t" Jul 01 16:38:38.934245 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:38.934211 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 16:38:38.934326 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:38.934310 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 16:38:38.938716 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.938579 2552 manager.go:354] Recovery completed Jul 01 16:38:38.940119 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.940095 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ftl9t" Jul 01 16:38:38.943804 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.943791 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:38.950958 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.950933 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:38.951065 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.950972 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:38.951065 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.950984 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:38.951553 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.951538 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 16:38:38.951553 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.951551 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 16:38:38.951726 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.951566 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:38:38.951726 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.951573 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:38.952715 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.952680 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:38.952797 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.952733 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:38.952797 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.952750 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:38.953024 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:38.952950 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-152.ec2.internal.18be37dba29e7cad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-152.ec2.internal,UID:ip-10-0-130-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-152.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-152.ec2.internal,},FirstTimestamp:2026-07-01 16:38:38.950956205 +0000 UTC m=+0.324354585,LastTimestamp:2026-07-01 16:38:38.950956205 +0000 UTC m=+0.324354585,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-152.ec2.internal,}" Jul 01 16:38:38.953710 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.953697 2552 policy_none.go:49] "None policy: Start" Jul 01 16:38:38.953771 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.953715 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 16:38:38.953771 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.953726 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 16:38:38.955734 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.955722 2552 policy_none.go:47] "Start" Jul 01 16:38:38.990171 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.990152 2552 manager.go:337] "Starting Device Plugin manager" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:38.990187 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.990199 2552 server.go:87] "Starting device plugin registration server" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.990527 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.990540 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.990629 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.990711 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.990720 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:38.991326 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:38.991370 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-152.ec2.internal\" not found" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.996263 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.997632 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.997669 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:38.997695 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:38.997729 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 16:38:39.010635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.001885 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:38:39.091301 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.091265 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:39.092729 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.092709 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:39.092830 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.092746 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:39.092830 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.092760 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:39.092830 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.092798 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.098723 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.098696 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal"] Jul 01 16:38:39.098779 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.098771 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:39.100676 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.100656 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:39.100763 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.100686 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:39.100763 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.100697 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:39.101949 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.101932 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.102006 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.101965 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-152.ec2.internal\": node \"ip-10-0-130-152.ec2.internal\" not found" Jul 01 16:38:39.103172 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.103133 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:39.103263 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.103244 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.103318 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.103294 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:39.104044 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.104026 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:39.104124 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.104054 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:39.104124 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.104063 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:39.104557 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.104542 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:39.104630 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.104569 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:39.104630 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.104590 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:39.106831 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.106812 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.106940 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.106855 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:38:39.109153 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.109134 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:38:39.109242 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.109165 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:38:39.109242 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.109181 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:38:39.125196 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.125167 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-152.ec2.internal\" not found" node="ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.125640 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.125622 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 01 16:38:39.127240 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.127221 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d771cc620217a361bf7ea5aeb21cad6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal\" (UID: \"1d771cc620217a361bf7ea5aeb21cad6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.127284 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.127255 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d771cc620217a361bf7ea5aeb21cad6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal\" (UID: \"1d771cc620217a361bf7ea5aeb21cad6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.127325 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.127280 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/057e5ae913964739cd5e8d17aa1ccb4e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-152.ec2.internal\" (UID: \"057e5ae913964739cd5e8d17aa1ccb4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.131073 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.131057 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-152.ec2.internal\" not found" node="ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.226006 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.225970 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 01 16:38:39.227625 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.227604 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d771cc620217a361bf7ea5aeb21cad6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal\" (UID: \"1d771cc620217a361bf7ea5aeb21cad6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.227735 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.227639 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d771cc620217a361bf7ea5aeb21cad6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal\" (UID: \"1d771cc620217a361bf7ea5aeb21cad6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.227735 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.227666 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/057e5ae913964739cd5e8d17aa1ccb4e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-152.ec2.internal\" (UID: \"057e5ae913964739cd5e8d17aa1ccb4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.227735 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.227691 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d771cc620217a361bf7ea5aeb21cad6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal\" (UID: \"1d771cc620217a361bf7ea5aeb21cad6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.227735 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.227707 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d771cc620217a361bf7ea5aeb21cad6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal\" (UID: \"1d771cc620217a361bf7ea5aeb21cad6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.227880 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.227741 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/057e5ae913964739cd5e8d17aa1ccb4e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-152.ec2.internal\" (UID: \"057e5ae913964739cd5e8d17aa1ccb4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.326902 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.326862 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 01 16:38:39.427611 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.427547 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 01 16:38:39.427611 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.427601 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.434534 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.434518 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.528054 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.528014 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 01 16:38:39.628535 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.628499 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 01 16:38:39.729044 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.728957 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 01 16:38:39.739769 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.739746 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:38:39.829958 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.829927 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 01 16:38:39.874673 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.874644 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 16:38:39.875249 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.874797 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 16:38:39.875249 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.874859 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 16:38:39.902178 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.902148 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:38:39.909932 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.909903 2552 apiserver.go:52] "Watching apiserver" Jul 01 16:38:39.922271 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.922242 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 16:38:39.922619 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.922597 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-zhm6n","openshift-image-registry/node-ca-26zzp","openshift-multus/multus-6v2mg","openshift-multus/network-metrics-daemon-rjtk4","openshift-network-diagnostics/network-check-target-p8bwh","openshift-network-operator/iptables-alerter-v6p4r","kube-system/konnectivity-agent-9qmt5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58","openshift-multus/multus-additional-cni-plugins-v667t","openshift-ovn-kubernetes/ovnkube-node-qnmvz","kube-system/global-pull-secret-syncer-z2z9q","openshift-cluster-node-tuning-operator/tuned-cs66v"] Jul 01 16:38:39.925331 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.925315 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhm6n" Jul 01 16:38:39.926351 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.926328 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.926351 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.926351 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 16:38:39.927579 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.927563 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-26zzp" Jul 01 16:38:39.929116 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.929098 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ns9zx\"" Jul 01 16:38:39.929605 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.929590 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.929918 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.929898 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6v2mg" Jul 01 16:38:39.931230 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.931208 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f95b035-879b-41d8-a6e6-b4767b52f3ca-hosts-file\") pod \"node-resolver-zhm6n\" (UID: \"8f95b035-879b-41d8-a6e6-b4767b52f3ca\") " pod="openshift-dns/node-resolver-zhm6n" Jul 01 16:38:39.931324 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.931237 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f95b035-879b-41d8-a6e6-b4767b52f3ca-tmp-dir\") pod \"node-resolver-zhm6n\" (UID: \"8f95b035-879b-41d8-a6e6-b4767b52f3ca\") " pod="openshift-dns/node-resolver-zhm6n" Jul 01 16:38:39.931324 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.931253 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65-host\") pod \"node-ca-26zzp\" (UID: \"ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65\") " pod="openshift-image-registry/node-ca-26zzp" Jul 01 16:38:39.931324 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.931270 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg4jw\" (UniqueName: \"kubernetes.io/projected/ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65-kube-api-access-hg4jw\") pod \"node-ca-26zzp\" (UID: \"ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65\") " pod="openshift-image-registry/node-ca-26zzp" Jul 01 16:38:39.931324 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.931296 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk9pm\" (UniqueName: \"kubernetes.io/projected/8f95b035-879b-41d8-a6e6-b4767b52f3ca-kube-api-access-mk9pm\") pod \"node-resolver-zhm6n\" (UID: \"8f95b035-879b-41d8-a6e6-b4767b52f3ca\") " pod="openshift-dns/node-resolver-zhm6n" Jul 01 16:38:39.931324 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.931320 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65-serviceca\") pod \"node-ca-26zzp\" (UID: \"ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65\") " pod="openshift-image-registry/node-ca-26zzp" Jul 01 16:38:39.931800 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.931781 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.932327 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.932309 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:39.932437 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.932392 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:38:39.934746 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.934727 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:39.934819 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.934800 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:38:39.936162 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.936142 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 16:38:39.936162 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.936154 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.936398 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.936366 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.936642 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.936629 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 16:38:39.936705 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.936645 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 16:38:39.936705 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.936631 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.936705 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.936680 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b6866\"" Jul 01 16:38:39.936852 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.936758 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.936908 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.936860 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4kx55\"" Jul 01 16:38:39.937145 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.937130 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v6p4r" Jul 01 16:38:39.939628 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.939609 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9qmt5" Jul 01 16:38:39.942037 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.942020 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:39.943742 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.943725 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.943905 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.943881 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7hx2k\"" Jul 01 16:38:39.944406 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.944392 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 16:38:39.944467 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.944396 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:39.944709 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.944693 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.945745 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.945719 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 16:33:39 +0000 UTC" deadline="2027-12-24 20:27:51.346251614 +0000 UTC" Jul 01 16:38:39.945745 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.945742 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12987h49m11.400512552s" Jul 01 16:38:39.946382 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.946216 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 16:38:39.946382 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.946237 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.946382 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.946265 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 16:38:39.946382 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.946274 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 16:38:39.946382 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.946278 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.947002 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.946984 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:39.947048 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.947010 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2ppc2\"" Jul 01 16:38:39.947408 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.947390 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ttrbl\"" Jul 01 16:38:39.947483 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.947438 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 16:38:39.947574 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.947526 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 16:38:39.947627 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.947578 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-28vs7\"" Jul 01 16:38:39.950343 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.950323 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:38:39.950459 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.950430 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" Jul 01 16:38:39.950529 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.950489 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 16:38:39.950529 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.950510 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:39.950607 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:39.950578 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:38:39.951522 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.951502 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kmpgg\"" Jul 01 16:38:39.951609 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.951539 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 16:38:39.951980 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.951963 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.952060 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.951986 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.953104 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.953083 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal"] Jul 01 16:38:39.953195 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.953176 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:39.954116 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.954100 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 16:38:39.964047 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.964003 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 16:38:39.964047 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.964023 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:38:39.967039 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.967015 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 16:38:39.967174 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.967048 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:38:39.972736 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.972712 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal"] Jul 01 16:38:39.973987 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.973965 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:38:39.975895 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.975876 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rw9v9\"" Jul 01 16:38:39.994435 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:39.994414 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d8lcd" Jul 01 16:38:40.005293 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.005261 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d8lcd" Jul 01 16:38:40.027990 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.027956 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 16:38:40.031504 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031477 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8309fc9c-cbda-4f78-bb35-de36683c741e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.031677 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031518 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-systemd-units\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.031677 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031555 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9pm\" (UniqueName: \"kubernetes.io/projected/8f95b035-879b-41d8-a6e6-b4767b52f3ca-kube-api-access-mk9pm\") pod \"node-resolver-zhm6n\" (UID: \"8f95b035-879b-41d8-a6e6-b4767b52f3ca\") " pod="openshift-dns/node-resolver-zhm6n" Jul 01 16:38:40.031677 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031611 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef6345ae-521a-4825-94f6-532cc09b5507-cni-binary-copy\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.031677 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031653 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-var-lib-cni-bin\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.031913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031694 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-var-lib-cni-multus\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.031913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031718 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-var-lib-kubelet\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.031913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031745 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-run-netns\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.031913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031770 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-kubernetes\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.031913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031787 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-sysctl-conf\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.031913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031803 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-run-multus-certs\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.031913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031830 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8309fc9c-cbda-4f78-bb35-de36683c741e-os-release\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.031913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031859 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-log-socket\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031918 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/af113d38-8f5a-4d16-a6bf-850332a49d23-iptables-alerter-script\") pod \"iptables-alerter-v6p4r\" (UID: \"af113d38-8f5a-4d16-a6bf-850332a49d23\") " pod="openshift-network-operator/iptables-alerter-v6p4r" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031944 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-run\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031967 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-etc-selinux\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.031988 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-slash\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032004 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-cni-bin\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032023 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65-host\") pod \"node-ca-26zzp\" (UID: \"ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65\") " pod="openshift-image-registry/node-ca-26zzp" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032041 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-multus-cni-dir\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032065 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-os-release\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032089 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-device-dir\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032139 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65-host\") pod \"node-ca-26zzp\" (UID: \"ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65\") " pod="openshift-image-registry/node-ca-26zzp" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032163 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65-serviceca\") pod \"node-ca-26zzp\" (UID: \"ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65\") " pod="openshift-image-registry/node-ca-26zzp" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032183 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-modprobe-d\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032199 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-sysctl-d\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032214 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-var-lib-kubelet\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.032224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032229 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-tmp\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032254 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032289 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8309fc9c-cbda-4f78-bb35-de36683c741e-cni-binary-copy\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032306 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-kubelet\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032337 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-sysconfig\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032371 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-registration-dir\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032400 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8309fc9c-cbda-4f78-bb35-de36683c741e-system-cni-dir\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032426 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-run-systemd\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032468 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-run-ovn\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032491 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-node-log\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032532 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-ovnkube-script-lib\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032609 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-system-cni-dir\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032635 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-kubelet-dir\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032676 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7v7p\" (UniqueName: \"kubernetes.io/projected/92a65b0f-0434-452c-b903-19184282f387-kube-api-access-m7v7p\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032701 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-etc-openvswitch\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032724 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-tuned\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.032954 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032753 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f95b035-879b-41d8-a6e6-b4767b52f3ca-tmp-dir\") pod \"node-resolver-zhm6n\" (UID: \"8f95b035-879b-41d8-a6e6-b4767b52f3ca\") " pod="openshift-dns/node-resolver-zhm6n" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032776 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg4jw\" (UniqueName: \"kubernetes.io/projected/ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65-kube-api-access-hg4jw\") pod \"node-ca-26zzp\" (UID: \"ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65\") " pod="openshift-image-registry/node-ca-26zzp" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032807 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-systemd\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032822 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65-serviceca\") pod \"node-ca-26zzp\" (UID: \"ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65\") " pod="openshift-image-registry/node-ca-26zzp" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032827 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn8rq\" (UniqueName: \"kubernetes.io/projected/ef6345ae-521a-4825-94f6-532cc09b5507-kube-api-access-fn8rq\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032890 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-run-ovn-kubernetes\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032913 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-ovnkube-config\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032931 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj8rg\" (UniqueName: \"kubernetes.io/projected/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-kube-api-access-dj8rg\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032950 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af113d38-8f5a-4d16-a6bf-850332a49d23-host-slash\") pod \"iptables-alerter-v6p4r\" (UID: \"af113d38-8f5a-4d16-a6bf-850332a49d23\") " pod="openshift-network-operator/iptables-alerter-v6p4r" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.032997 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7qx2\" (UniqueName: \"kubernetes.io/projected/0b7ebc87-2186-40e8-a839-68b232700b0c-kube-api-access-n7qx2\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033033 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f95b035-879b-41d8-a6e6-b4767b52f3ca-hosts-file\") pod \"node-resolver-zhm6n\" (UID: \"8f95b035-879b-41d8-a6e6-b4767b52f3ca\") " pod="openshift-dns/node-resolver-zhm6n" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033059 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-cnibin\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033086 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-run-netns\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033111 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-multus-conf-dir\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033140 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef6345ae-521a-4825-94f6-532cc09b5507-multus-daemon-config\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033152 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f95b035-879b-41d8-a6e6-b4767b52f3ca-tmp-dir\") pod \"node-resolver-zhm6n\" (UID: \"8f95b035-879b-41d8-a6e6-b4767b52f3ca\") " pod="openshift-dns/node-resolver-zhm6n" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033167 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-run-openvswitch\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.033668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033214 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-ovn-node-metrics-cert\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033250 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f95b035-879b-41d8-a6e6-b4767b52f3ca-hosts-file\") pod \"node-resolver-zhm6n\" (UID: \"8f95b035-879b-41d8-a6e6-b4767b52f3ca\") " pod="openshift-dns/node-resolver-zhm6n" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033250 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp6hw\" (UniqueName: \"kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw\") pod \"network-check-target-p8bwh\" (UID: \"24cec14d-f098-4f31-b7bc-62d4d23798d3\") " pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033293 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm8jm\" (UniqueName: \"kubernetes.io/projected/af113d38-8f5a-4d16-a6bf-850332a49d23-kube-api-access-hm8jm\") pod \"iptables-alerter-v6p4r\" (UID: \"af113d38-8f5a-4d16-a6bf-850332a49d23\") " pod="openshift-network-operator/iptables-alerter-v6p4r" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033360 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-hostroot\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033403 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db80e063-ddfc-48ae-b2f0-90358a53d4ff-agent-certs\") pod \"konnectivity-agent-9qmt5\" (UID: \"db80e063-ddfc-48ae-b2f0-90358a53d4ff\") " pod="kube-system/konnectivity-agent-9qmt5" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033433 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-sys-fs\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033473 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-env-overrides\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033498 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25p6w\" (UniqueName: \"kubernetes.io/projected/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-kube-api-access-25p6w\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033523 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db80e063-ddfc-48ae-b2f0-90358a53d4ff-konnectivity-ca\") pod \"konnectivity-agent-9qmt5\" (UID: \"db80e063-ddfc-48ae-b2f0-90358a53d4ff\") " pod="kube-system/konnectivity-agent-9qmt5" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033547 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8309fc9c-cbda-4f78-bb35-de36683c741e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033570 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-lib-modules\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033595 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-multus-socket-dir-parent\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033617 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-etc-kubernetes\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033639 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8309fc9c-cbda-4f78-bb35-de36683c741e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033663 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-cni-netd\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.034583 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033689 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:40.035434 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-sys\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.035434 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033721 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-socket-dir\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.035434 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033738 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8309fc9c-cbda-4f78-bb35-de36683c741e-cnibin\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.035434 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033754 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjq6c\" (UniqueName: \"kubernetes.io/projected/8309fc9c-cbda-4f78-bb35-de36683c741e-kube-api-access-cjq6c\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.035434 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033781 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-run-k8s-cni-cncf-io\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.035434 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033813 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-var-lib-openvswitch\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.035434 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033841 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.035434 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033868 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6896b426-88bd-47d9-a32a-ef5a2cd56373-kubelet-config\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:40.035434 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033899 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6896b426-88bd-47d9-a32a-ef5a2cd56373-dbus\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:40.035434 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.033917 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-host\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.042841 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.042808 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 16:38:40.046589 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.046562 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk9pm\" (UniqueName: \"kubernetes.io/projected/8f95b035-879b-41d8-a6e6-b4767b52f3ca-kube-api-access-mk9pm\") pod \"node-resolver-zhm6n\" (UID: \"8f95b035-879b-41d8-a6e6-b4767b52f3ca\") " pod="openshift-dns/node-resolver-zhm6n" Jul 01 16:38:40.047973 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.047951 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg4jw\" (UniqueName: \"kubernetes.io/projected/ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65-kube-api-access-hg4jw\") pod \"node-ca-26zzp\" (UID: \"ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65\") " pod="openshift-image-registry/node-ca-26zzp" Jul 01 16:38:40.134223 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134184 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af113d38-8f5a-4d16-a6bf-850332a49d23-host-slash\") pod \"iptables-alerter-v6p4r\" (UID: \"af113d38-8f5a-4d16-a6bf-850332a49d23\") " pod="openshift-network-operator/iptables-alerter-v6p4r" Jul 01 16:38:40.134398 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134232 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qx2\" (UniqueName: \"kubernetes.io/projected/0b7ebc87-2186-40e8-a839-68b232700b0c-kube-api-access-n7qx2\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:40.134398 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134248 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af113d38-8f5a-4d16-a6bf-850332a49d23-host-slash\") pod \"iptables-alerter-v6p4r\" (UID: \"af113d38-8f5a-4d16-a6bf-850332a49d23\") " pod="openshift-network-operator/iptables-alerter-v6p4r" Jul 01 16:38:40.134398 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134260 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-cnibin\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.134398 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134298 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-run-netns\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.134398 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134325 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-cnibin\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.134398 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134325 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-multus-conf-dir\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.134398 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134357 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef6345ae-521a-4825-94f6-532cc09b5507-multus-daemon-config\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.134398 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134359 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-multus-conf-dir\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.134398 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134385 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-run-openvswitch\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.134913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134426 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-run-openvswitch\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.134913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134430 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-run-netns\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.134913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134448 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-ovn-node-metrics-cert\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.134913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134546 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6hw\" (UniqueName: \"kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw\") pod \"network-check-target-p8bwh\" (UID: \"24cec14d-f098-4f31-b7bc-62d4d23798d3\") " pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:40.134913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134577 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm8jm\" (UniqueName: \"kubernetes.io/projected/af113d38-8f5a-4d16-a6bf-850332a49d23-kube-api-access-hm8jm\") pod \"iptables-alerter-v6p4r\" (UID: \"af113d38-8f5a-4d16-a6bf-850332a49d23\") " pod="openshift-network-operator/iptables-alerter-v6p4r" Jul 01 16:38:40.134913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134604 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-hostroot\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.134913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134634 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db80e063-ddfc-48ae-b2f0-90358a53d4ff-agent-certs\") pod \"konnectivity-agent-9qmt5\" (UID: \"db80e063-ddfc-48ae-b2f0-90358a53d4ff\") " pod="kube-system/konnectivity-agent-9qmt5" Jul 01 16:38:40.134913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134664 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-sys-fs\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.134913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134712 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-env-overrides\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.134913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134762 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25p6w\" (UniqueName: \"kubernetes.io/projected/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-kube-api-access-25p6w\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.134913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134790 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db80e063-ddfc-48ae-b2f0-90358a53d4ff-konnectivity-ca\") pod \"konnectivity-agent-9qmt5\" (UID: \"db80e063-ddfc-48ae-b2f0-90358a53d4ff\") " pod="kube-system/konnectivity-agent-9qmt5" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134913 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef6345ae-521a-4825-94f6-532cc09b5507-multus-daemon-config\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.134937 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-hostroot\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135093 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8309fc9c-cbda-4f78-bb35-de36683c741e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135133 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-lib-modules\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135165 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-multus-socket-dir-parent\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135193 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-etc-kubernetes\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135222 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8309fc9c-cbda-4f78-bb35-de36683c741e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135249 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-cni-netd\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135275 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135301 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-sys\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135326 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-socket-dir\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135351 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8309fc9c-cbda-4f78-bb35-de36683c741e-cnibin\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135363 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-sys-fs\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135380 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjq6c\" (UniqueName: \"kubernetes.io/projected/8309fc9c-cbda-4f78-bb35-de36683c741e-kube-api-access-cjq6c\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135413 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-run-k8s-cni-cncf-io\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135438 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-var-lib-openvswitch\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.135563 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135464 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135517 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6896b426-88bd-47d9-a32a-ef5a2cd56373-kubelet-config\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135524 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-env-overrides\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135542 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6896b426-88bd-47d9-a32a-ef5a2cd56373-dbus\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135566 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-host\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135591 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8309fc9c-cbda-4f78-bb35-de36683c741e-cnibin\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135594 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8309fc9c-cbda-4f78-bb35-de36683c741e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135609 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-lib-modules\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135633 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-systemd-units\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135663 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef6345ae-521a-4825-94f6-532cc09b5507-cni-binary-copy\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135670 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-run-k8s-cni-cncf-io\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135693 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-var-lib-cni-bin\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135701 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-multus-socket-dir-parent\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135722 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-var-lib-openvswitch\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135774 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.135841 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135871 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6896b426-88bd-47d9-a32a-ef5a2cd56373-dbus\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:40.136415 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.135928 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret podName:6896b426-88bd-47d9-a32a-ef5a2cd56373 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:40.63588441 +0000 UTC m=+2.009282596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret") pod "global-pull-secret-syncer-z2z9q" (UID: "6896b426-88bd-47d9-a32a-ef5a2cd56373") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135611 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8309fc9c-cbda-4f78-bb35-de36683c741e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135720 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-var-lib-cni-multus\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135970 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-var-lib-kubelet\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135976 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-sys\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136002 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-run-netns\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136035 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-kubernetes\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136038 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-run-netns\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136021 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db80e063-ddfc-48ae-b2f0-90358a53d4ff-konnectivity-ca\") pod \"konnectivity-agent-9qmt5\" (UID: \"db80e063-ddfc-48ae-b2f0-90358a53d4ff\") " pod="kube-system/konnectivity-agent-9qmt5" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136061 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-sysctl-conf\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136076 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-var-lib-kubelet\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136088 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-run-multus-certs\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136113 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8309fc9c-cbda-4f78-bb35-de36683c741e-os-release\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136126 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-etc-kubernetes\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136134 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6896b426-88bd-47d9-a32a-ef5a2cd56373-kubelet-config\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136139 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-log-socket\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136149 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-systemd-units\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.137353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136166 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/af113d38-8f5a-4d16-a6bf-850332a49d23-iptables-alerter-script\") pod \"iptables-alerter-v6p4r\" (UID: \"af113d38-8f5a-4d16-a6bf-850332a49d23\") " pod="openshift-network-operator/iptables-alerter-v6p4r" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136173 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-cni-netd\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136182 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-kubernetes\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136200 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-run\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136225 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-etc-selinux\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136247 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-slash\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136268 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-cni-bin\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136281 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8309fc9c-cbda-4f78-bb35-de36683c741e-os-release\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136292 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-multus-cni-dir\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136307 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-sysctl-conf\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136322 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-run-multus-certs\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.135926 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-host\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136318 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-os-release\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136381 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-device-dir\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136392 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-os-release\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136396 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-var-lib-cni-multus\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136411 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-modprobe-d\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136436 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-sysctl-d\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.138203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136472 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8309fc9c-cbda-4f78-bb35-de36683c741e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136485 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-var-lib-kubelet\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136514 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-tmp\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136551 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-socket-dir\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136565 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136225 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-host-var-lib-cni-bin\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136571 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-log-socket\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136595 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8309fc9c-cbda-4f78-bb35-de36683c741e-cni-binary-copy\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136619 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-run\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136632 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-kubelet\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136658 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-sysconfig\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136669 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-cni-bin\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136678 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-etc-selinux\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136688 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-registration-dir\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136708 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-slash\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136716 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8309fc9c-cbda-4f78-bb35-de36683c741e-system-cni-dir\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136745 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-multus-cni-dir\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.138906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136768 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-device-dir\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136784 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-run-systemd\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136744 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-run-systemd\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136814 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef6345ae-521a-4825-94f6-532cc09b5507-cni-binary-copy\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136827 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-run-ovn\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136868 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-modprobe-d\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136884 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-var-lib-kubelet\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136904 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-run-ovn\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136916 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-node-log\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136944 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-ovnkube-script-lib\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136948 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/af113d38-8f5a-4d16-a6bf-850332a49d23-iptables-alerter-script\") pod \"iptables-alerter-v6p4r\" (UID: \"af113d38-8f5a-4d16-a6bf-850332a49d23\") " pod="openshift-network-operator/iptables-alerter-v6p4r" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.136973 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-system-cni-dir\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137002 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-node-log\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137013 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-sysctl-d\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137024 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-kubelet-dir\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137051 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7v7p\" (UniqueName: \"kubernetes.io/projected/92a65b0f-0434-452c-b903-19184282f387-kube-api-access-m7v7p\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137073 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef6345ae-521a-4825-94f6-532cc09b5507-system-cni-dir\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137079 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-etc-openvswitch\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.139554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137104 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-tuned\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137126 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-sysconfig\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137132 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-systemd\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137160 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8rq\" (UniqueName: \"kubernetes.io/projected/ef6345ae-521a-4825-94f6-532cc09b5507-kube-api-access-fn8rq\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137169 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-kubelet\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137201 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-run-ovn-kubernetes\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137231 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-ovnkube-config\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137256 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj8rg\" (UniqueName: \"kubernetes.io/projected/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-kube-api-access-dj8rg\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137272 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8309fc9c-cbda-4f78-bb35-de36683c741e-cni-binary-copy\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137355 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8309fc9c-cbda-4f78-bb35-de36683c741e-system-cni-dir\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.137360 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.137420 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs podName:0b7ebc87-2186-40e8-a839-68b232700b0c nodeName:}" failed. No retries permitted until 2026-07-01 16:38:40.637402494 +0000 UTC m=+2.010800661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs") pod "network-metrics-daemon-rjtk4" (UID: "0b7ebc87-2186-40e8-a839-68b232700b0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137597 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-ovnkube-script-lib\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137612 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8309fc9c-cbda-4f78-bb35-de36683c741e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137661 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-etc-openvswitch\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137681 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-ovn-node-metrics-cert\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137713 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-systemd\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.140114 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137721 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-registration-dir\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.140860 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137752 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92a65b0f-0434-452c-b903-19184282f387-kubelet-dir\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.140860 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137789 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-host-run-ovn-kubernetes\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.140860 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.137965 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-ovnkube-config\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.140860 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.138900 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db80e063-ddfc-48ae-b2f0-90358a53d4ff-agent-certs\") pod \"konnectivity-agent-9qmt5\" (UID: \"db80e063-ddfc-48ae-b2f0-90358a53d4ff\") " pod="kube-system/konnectivity-agent-9qmt5" Jul 01 16:38:40.140860 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.139498 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-tmp\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.140860 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.139781 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-etc-tuned\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.149740 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.149707 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:38:40.149740 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.149735 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:38:40.149740 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.149746 2552 projected.go:196] Error preparing data for projected volume kube-api-access-xp6hw for pod openshift-network-diagnostics/network-check-target-p8bwh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:40.149945 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.149824 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw podName:24cec14d-f098-4f31-b7bc-62d4d23798d3 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:40.649805775 +0000 UTC m=+2.023203956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xp6hw" (UniqueName: "kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw") pod "network-check-target-p8bwh" (UID: "24cec14d-f098-4f31-b7bc-62d4d23798d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:40.158188 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.158151 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj8rg\" (UniqueName: \"kubernetes.io/projected/d7b35bf3-e2db-44e7-8845-0cb04e369ab1-kube-api-access-dj8rg\") pod \"ovnkube-node-qnmvz\" (UID: \"d7b35bf3-e2db-44e7-8845-0cb04e369ab1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.163773 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.163746 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn8rq\" (UniqueName: \"kubernetes.io/projected/ef6345ae-521a-4825-94f6-532cc09b5507-kube-api-access-fn8rq\") pod \"multus-6v2mg\" (UID: \"ef6345ae-521a-4825-94f6-532cc09b5507\") " pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.176156 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:40.176115 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d771cc620217a361bf7ea5aeb21cad6.slice/crio-ef4c63a875c13c184f1d8783f1a8759fb9fa25995c13ef1c036dc705b1664e44 WatchSource:0}: Error finding container ef4c63a875c13c184f1d8783f1a8759fb9fa25995c13ef1c036dc705b1664e44: Status 404 returned error can't find the container with id ef4c63a875c13c184f1d8783f1a8759fb9fa25995c13ef1c036dc705b1664e44 Jul 01 16:38:40.176497 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:40.176421 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057e5ae913964739cd5e8d17aa1ccb4e.slice/crio-d48ac1a6b04211c86eb61f091ee16f2a97cdb0dc50c37845749e3b830c18f696 WatchSource:0}: Error finding container d48ac1a6b04211c86eb61f091ee16f2a97cdb0dc50c37845749e3b830c18f696: Status 404 returned error can't find the container with id d48ac1a6b04211c86eb61f091ee16f2a97cdb0dc50c37845749e3b830c18f696 Jul 01 16:38:40.176950 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.176916 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25p6w\" (UniqueName: \"kubernetes.io/projected/cd54c40f-93b5-47cd-aea8-558d87e7f3c3-kube-api-access-25p6w\") pod \"tuned-cs66v\" (UID: \"cd54c40f-93b5-47cd-aea8-558d87e7f3c3\") " pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.177252 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.177205 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7v7p\" (UniqueName: \"kubernetes.io/projected/92a65b0f-0434-452c-b903-19184282f387-kube-api-access-m7v7p\") pod \"aws-ebs-csi-driver-node-snj58\" (UID: \"92a65b0f-0434-452c-b903-19184282f387\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.177450 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.177424 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjq6c\" (UniqueName: \"kubernetes.io/projected/8309fc9c-cbda-4f78-bb35-de36683c741e-kube-api-access-cjq6c\") pod \"multus-additional-cni-plugins-v667t\" (UID: \"8309fc9c-cbda-4f78-bb35-de36683c741e\") " pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.178400 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.178321 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm8jm\" (UniqueName: \"kubernetes.io/projected/af113d38-8f5a-4d16-a6bf-850332a49d23-kube-api-access-hm8jm\") pod \"iptables-alerter-v6p4r\" (UID: \"af113d38-8f5a-4d16-a6bf-850332a49d23\") " pod="openshift-network-operator/iptables-alerter-v6p4r" Jul 01 16:38:40.181079 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.181060 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:38:40.253167 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.253064 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhm6n" Jul 01 16:38:40.262119 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.262093 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-26zzp" Jul 01 16:38:40.262459 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.262441 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7qx2\" (UniqueName: \"kubernetes.io/projected/0b7ebc87-2186-40e8-a839-68b232700b0c-kube-api-access-n7qx2\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:40.264149 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:40.264124 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f95b035_879b_41d8_a6e6_b4767b52f3ca.slice/crio-abb039cd5fc92db5b1f69e8d9caa111f9ac0ff1943ffddbea951661e42162768 WatchSource:0}: Error finding container abb039cd5fc92db5b1f69e8d9caa111f9ac0ff1943ffddbea951661e42162768: Status 404 returned error can't find the container with id abb039cd5fc92db5b1f69e8d9caa111f9ac0ff1943ffddbea951661e42162768 Jul 01 16:38:40.272580 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:40.272548 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7dc41b_5b77_4ffd_9d75_6e40a2cb6a65.slice/crio-28f65dc1f71f7cf38fdd1df8f93c52dd79c9d4d8d50661c02f3504bf3bd489f5 WatchSource:0}: Error finding container 28f65dc1f71f7cf38fdd1df8f93c52dd79c9d4d8d50661c02f3504bf3bd489f5: Status 404 returned error can't find the container with id 28f65dc1f71f7cf38fdd1df8f93c52dd79c9d4d8d50661c02f3504bf3bd489f5 Jul 01 16:38:40.292209 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.292166 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6v2mg" Jul 01 16:38:40.302294 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:40.302261 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6345ae_521a_4825_94f6_532cc09b5507.slice/crio-7217ddf66e1e658bad08759a8b3e9088ebd617e14d4618ed98e0b69c4008b258 WatchSource:0}: Error finding container 7217ddf66e1e658bad08759a8b3e9088ebd617e14d4618ed98e0b69c4008b258: Status 404 returned error can't find the container with id 7217ddf66e1e658bad08759a8b3e9088ebd617e14d4618ed98e0b69c4008b258 Jul 01 16:38:40.316029 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.316006 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v6p4r" Jul 01 16:38:40.325294 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:40.325260 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf113d38_8f5a_4d16_a6bf_850332a49d23.slice/crio-4e7bc30057d995a9a0106cff80ceede32cd73605dbad6cc6b07636eef2d38743 WatchSource:0}: Error finding container 4e7bc30057d995a9a0106cff80ceede32cd73605dbad6cc6b07636eef2d38743: Status 404 returned error can't find the container with id 4e7bc30057d995a9a0106cff80ceede32cd73605dbad6cc6b07636eef2d38743 Jul 01 16:38:40.336306 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.336279 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9qmt5" Jul 01 16:38:40.340988 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.340969 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" Jul 01 16:38:40.348942 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:40.348910 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb80e063_ddfc_48ae_b2f0_90358a53d4ff.slice/crio-5f0e0c7f1230ab7807caaee8ed89799400397d5f87634a994483517c124a9f79 WatchSource:0}: Error finding container 5f0e0c7f1230ab7807caaee8ed89799400397d5f87634a994483517c124a9f79: Status 404 returned error can't find the container with id 5f0e0c7f1230ab7807caaee8ed89799400397d5f87634a994483517c124a9f79 Jul 01 16:38:40.352811 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:40.352783 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a65b0f_0434_452c_b903_19184282f387.slice/crio-9fd59d3be5625b92f9574e3aa820450e746a5aa9aa86e64d149b3c0e5758d600 WatchSource:0}: Error finding container 9fd59d3be5625b92f9574e3aa820450e746a5aa9aa86e64d149b3c0e5758d600: Status 404 returned error can't find the container with id 9fd59d3be5625b92f9574e3aa820450e746a5aa9aa86e64d149b3c0e5758d600 Jul 01 16:38:40.373139 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.373094 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v667t" Jul 01 16:38:40.383250 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:40.383226 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8309fc9c_cbda_4f78_bb35_de36683c741e.slice/crio-8bd37154c3afe9a62b6dde8e0707eb9306e31182f33ff76a7a61eab9dc25688b WatchSource:0}: Error finding container 8bd37154c3afe9a62b6dde8e0707eb9306e31182f33ff76a7a61eab9dc25688b: Status 404 returned error can't find the container with id 8bd37154c3afe9a62b6dde8e0707eb9306e31182f33ff76a7a61eab9dc25688b Jul 01 16:38:40.384604 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.384571 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:38:40.391916 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.391891 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cs66v" Jul 01 16:38:40.394628 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:40.394602 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b35bf3_e2db_44e7_8845_0cb04e369ab1.slice/crio-499ef59e355b5a62bdff2d963858e1e7dff61750f2749b015cffa923facbb819 WatchSource:0}: Error finding container 499ef59e355b5a62bdff2d963858e1e7dff61750f2749b015cffa923facbb819: Status 404 returned error can't find the container with id 499ef59e355b5a62bdff2d963858e1e7dff61750f2749b015cffa923facbb819 Jul 01 16:38:40.402066 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:38:40.402029 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd54c40f_93b5_47cd_aea8_558d87e7f3c3.slice/crio-471c21263bce8044303f69206870526f848ce0eb3d6092cfdc7228ce994ddacb WatchSource:0}: Error finding container 471c21263bce8044303f69206870526f848ce0eb3d6092cfdc7228ce994ddacb: Status 404 returned error can't find the container with id 471c21263bce8044303f69206870526f848ce0eb3d6092cfdc7228ce994ddacb Jul 01 16:38:40.641738 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.641628 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:40.641738 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.641689 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:40.641951 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.641796 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:40.641951 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.641796 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:40.641951 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.641873 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs podName:0b7ebc87-2186-40e8-a839-68b232700b0c nodeName:}" failed. No retries permitted until 2026-07-01 16:38:41.6418524 +0000 UTC m=+3.015250569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs") pod "network-metrics-daemon-rjtk4" (UID: "0b7ebc87-2186-40e8-a839-68b232700b0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:40.641951 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.641894 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret podName:6896b426-88bd-47d9-a32a-ef5a2cd56373 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:41.641883811 +0000 UTC m=+3.015281982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret") pod "global-pull-secret-syncer-z2z9q" (UID: "6896b426-88bd-47d9-a32a-ef5a2cd56373") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:40.742502 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.742412 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6hw\" (UniqueName: \"kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw\") pod \"network-check-target-p8bwh\" (UID: \"24cec14d-f098-4f31-b7bc-62d4d23798d3\") " pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:40.742702 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.742623 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:38:40.742702 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.742652 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:38:40.742702 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.742668 2552 projected.go:196] Error preparing data for projected volume kube-api-access-xp6hw for pod openshift-network-diagnostics/network-check-target-p8bwh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:40.742864 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:40.742741 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw podName:24cec14d-f098-4f31-b7bc-62d4d23798d3 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:41.742719419 +0000 UTC m=+3.116117586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xp6hw" (UniqueName: "kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw") pod "network-check-target-p8bwh" (UID: "24cec14d-f098-4f31-b7bc-62d4d23798d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:40.879344 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:40.879297 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:38:41.003000 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.001954 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:41.003000 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:41.002140 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:38:41.003000 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.002658 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:41.003000 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:41.002785 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:38:41.009859 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.009799 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:33:40 +0000 UTC" deadline="2028-02-29 15:28:17.580519167 +0000 UTC" Jul 01 16:38:41.009859 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.009823 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14590h49m36.570699799s" Jul 01 16:38:41.026793 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.026671 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cs66v" event={"ID":"cd54c40f-93b5-47cd-aea8-558d87e7f3c3","Type":"ContainerStarted","Data":"471c21263bce8044303f69206870526f848ce0eb3d6092cfdc7228ce994ddacb"} Jul 01 16:38:41.045477 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.045166 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" event={"ID":"d7b35bf3-e2db-44e7-8845-0cb04e369ab1","Type":"ContainerStarted","Data":"499ef59e355b5a62bdff2d963858e1e7dff61750f2749b015cffa923facbb819"} Jul 01 16:38:41.052091 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.051977 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" event={"ID":"92a65b0f-0434-452c-b903-19184282f387","Type":"ContainerStarted","Data":"9fd59d3be5625b92f9574e3aa820450e746a5aa9aa86e64d149b3c0e5758d600"} Jul 01 16:38:41.058758 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.058610 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6v2mg" event={"ID":"ef6345ae-521a-4825-94f6-532cc09b5507","Type":"ContainerStarted","Data":"7217ddf66e1e658bad08759a8b3e9088ebd617e14d4618ed98e0b69c4008b258"} Jul 01 16:38:41.064755 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.064704 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-26zzp" event={"ID":"ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65","Type":"ContainerStarted","Data":"28f65dc1f71f7cf38fdd1df8f93c52dd79c9d4d8d50661c02f3504bf3bd489f5"} Jul 01 16:38:41.071686 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.071641 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhm6n" event={"ID":"8f95b035-879b-41d8-a6e6-b4767b52f3ca","Type":"ContainerStarted","Data":"abb039cd5fc92db5b1f69e8d9caa111f9ac0ff1943ffddbea951661e42162768"} Jul 01 16:38:41.076310 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.076263 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" event={"ID":"057e5ae913964739cd5e8d17aa1ccb4e","Type":"ContainerStarted","Data":"d48ac1a6b04211c86eb61f091ee16f2a97cdb0dc50c37845749e3b830c18f696"} Jul 01 16:38:41.079009 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.078974 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" event={"ID":"1d771cc620217a361bf7ea5aeb21cad6","Type":"ContainerStarted","Data":"ef4c63a875c13c184f1d8783f1a8759fb9fa25995c13ef1c036dc705b1664e44"} Jul 01 16:38:41.082120 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.082082 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v667t" event={"ID":"8309fc9c-cbda-4f78-bb35-de36683c741e","Type":"ContainerStarted","Data":"8bd37154c3afe9a62b6dde8e0707eb9306e31182f33ff76a7a61eab9dc25688b"} Jul 01 16:38:41.088187 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.088147 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9qmt5" event={"ID":"db80e063-ddfc-48ae-b2f0-90358a53d4ff","Type":"ContainerStarted","Data":"5f0e0c7f1230ab7807caaee8ed89799400397d5f87634a994483517c124a9f79"} Jul 01 16:38:41.094112 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.094075 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v6p4r" event={"ID":"af113d38-8f5a-4d16-a6bf-850332a49d23","Type":"ContainerStarted","Data":"4e7bc30057d995a9a0106cff80ceede32cd73605dbad6cc6b07636eef2d38743"} Jul 01 16:38:41.248746 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.248708 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:38:41.650651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.650603 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:41.650865 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.650707 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:41.650937 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:41.650865 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:41.650937 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:41.650935 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret podName:6896b426-88bd-47d9-a32a-ef5a2cd56373 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:43.650914431 +0000 UTC m=+5.024312601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret") pod "global-pull-secret-syncer-z2z9q" (UID: "6896b426-88bd-47d9-a32a-ef5a2cd56373") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:41.651405 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:41.651386 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:41.651498 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:41.651443 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs podName:0b7ebc87-2186-40e8-a839-68b232700b0c nodeName:}" failed. No retries permitted until 2026-07-01 16:38:43.651427126 +0000 UTC m=+5.024825301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs") pod "network-metrics-daemon-rjtk4" (UID: "0b7ebc87-2186-40e8-a839-68b232700b0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:41.751561 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.751483 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6hw\" (UniqueName: \"kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw\") pod \"network-check-target-p8bwh\" (UID: \"24cec14d-f098-4f31-b7bc-62d4d23798d3\") " pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:41.751742 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:41.751686 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:38:41.751742 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:41.751707 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:38:41.751742 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:41.751721 2552 projected.go:196] Error preparing data for projected volume kube-api-access-xp6hw for pod openshift-network-diagnostics/network-check-target-p8bwh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:41.751923 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:41.751788 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw podName:24cec14d-f098-4f31-b7bc-62d4d23798d3 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:43.751768877 +0000 UTC m=+5.125167059 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xp6hw" (UniqueName: "kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw") pod "network-check-target-p8bwh" (UID: "24cec14d-f098-4f31-b7bc-62d4d23798d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:41.998218 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:41.998100 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:41.998727 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:41.998243 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:38:42.010309 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:42.010245 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:33:40 +0000 UTC" deadline="2027-11-26 22:41:19.099712789 +0000 UTC" Jul 01 16:38:42.010309 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:42.010306 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12318h2m37.089410958s" Jul 01 16:38:42.145758 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:42.145714 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:38:42.999080 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:42.999038 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:42.999527 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:42.999061 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:42.999527 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:42.999206 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:38:42.999527 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:42.999260 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:38:43.670462 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:43.670415 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:43.670680 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:43.670510 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:43.670680 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:43.670609 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:43.670680 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:43.670672 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:43.670861 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:43.670684 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs podName:0b7ebc87-2186-40e8-a839-68b232700b0c nodeName:}" failed. No retries permitted until 2026-07-01 16:38:47.670663538 +0000 UTC m=+9.044061712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs") pod "network-metrics-daemon-rjtk4" (UID: "0b7ebc87-2186-40e8-a839-68b232700b0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:43.670861 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:43.670751 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret podName:6896b426-88bd-47d9-a32a-ef5a2cd56373 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:47.670731279 +0000 UTC m=+9.044129462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret") pod "global-pull-secret-syncer-z2z9q" (UID: "6896b426-88bd-47d9-a32a-ef5a2cd56373") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:43.771069 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:43.771023 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6hw\" (UniqueName: \"kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw\") pod \"network-check-target-p8bwh\" (UID: \"24cec14d-f098-4f31-b7bc-62d4d23798d3\") " pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:43.771265 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:43.771233 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:38:43.771265 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:43.771258 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:38:43.771393 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:43.771269 2552 projected.go:196] Error preparing data for projected volume kube-api-access-xp6hw for pod openshift-network-diagnostics/network-check-target-p8bwh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:43.771393 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:43.771338 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw podName:24cec14d-f098-4f31-b7bc-62d4d23798d3 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:47.771314774 +0000 UTC m=+9.144712953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xp6hw" (UniqueName: "kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw") pod "network-check-target-p8bwh" (UID: "24cec14d-f098-4f31-b7bc-62d4d23798d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:43.999012 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:43.998473 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:43.999012 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:43.998635 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:38:45.001423 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:45.001390 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:45.001939 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:45.001550 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:38:45.001939 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:45.001869 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:45.002024 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:45.001944 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:38:45.998628 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:45.998585 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:45.998802 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:45.998752 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:38:46.999107 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:46.999066 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:46.999628 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:46.999123 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:46.999628 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:46.999205 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:38:46.999748 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:46.999672 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:38:47.708365 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:47.708056 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:47.708664 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:47.708420 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:47.708664 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:47.708332 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:47.708664 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:47.708641 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret podName:6896b426-88bd-47d9-a32a-ef5a2cd56373 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:55.708620331 +0000 UTC m=+17.082018499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret") pod "global-pull-secret-syncer-z2z9q" (UID: "6896b426-88bd-47d9-a32a-ef5a2cd56373") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:47.709020 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:47.708562 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:47.709142 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:47.709058 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs podName:0b7ebc87-2186-40e8-a839-68b232700b0c nodeName:}" failed. No retries permitted until 2026-07-01 16:38:55.709043692 +0000 UTC m=+17.082441859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs") pod "network-metrics-daemon-rjtk4" (UID: "0b7ebc87-2186-40e8-a839-68b232700b0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:47.809718 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:47.809681 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6hw\" (UniqueName: \"kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw\") pod \"network-check-target-p8bwh\" (UID: \"24cec14d-f098-4f31-b7bc-62d4d23798d3\") " pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:47.809928 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:47.809899 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:38:47.810009 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:47.809932 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:38:47.810009 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:47.809948 2552 projected.go:196] Error preparing data for projected volume kube-api-access-xp6hw for pod openshift-network-diagnostics/network-check-target-p8bwh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:47.810120 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:47.810012 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw podName:24cec14d-f098-4f31-b7bc-62d4d23798d3 nodeName:}" failed. No retries permitted until 2026-07-01 16:38:55.809997005 +0000 UTC m=+17.183395172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xp6hw" (UniqueName: "kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw") pod "network-check-target-p8bwh" (UID: "24cec14d-f098-4f31-b7bc-62d4d23798d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:47.999153 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:47.998545 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:47.999153 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:47.998722 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:38:49.007591 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:49.004681 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:49.007591 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:49.005969 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:38:49.007591 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:49.006589 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:49.008721 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:49.008543 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:38:49.998856 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:49.998817 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:49.999060 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:49.998965 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:38:51.000651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:51.000590 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:51.001197 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:51.000736 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:38:51.001560 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:51.001362 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:51.001560 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:51.001502 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:38:51.998121 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:51.998086 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:51.998315 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:51.998239 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:38:52.998835 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:52.998787 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:52.999271 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:52.998841 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:52.999271 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:52.998930 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:38:52.999271 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:52.999057 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:38:53.998291 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:53.998259 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:53.998521 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:53.998399 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:38:54.998981 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:54.998940 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:54.999390 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:54.999101 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:54.999390 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:54.999097 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:38:54.999390 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:54.999187 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:38:55.779822 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:55.779775 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:55.780026 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:55.779838 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:55.780026 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:55.779942 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:55.780026 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:55.779971 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:55.780026 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:55.780024 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret podName:6896b426-88bd-47d9-a32a-ef5a2cd56373 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:11.780001993 +0000 UTC m=+33.153400168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret") pod "global-pull-secret-syncer-z2z9q" (UID: "6896b426-88bd-47d9-a32a-ef5a2cd56373") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:38:55.780210 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:55.780040 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs podName:0b7ebc87-2186-40e8-a839-68b232700b0c nodeName:}" failed. No retries permitted until 2026-07-01 16:39:11.78003292 +0000 UTC m=+33.153431085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs") pod "network-metrics-daemon-rjtk4" (UID: "0b7ebc87-2186-40e8-a839-68b232700b0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:38:55.880785 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:55.880748 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6hw\" (UniqueName: \"kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw\") pod \"network-check-target-p8bwh\" (UID: \"24cec14d-f098-4f31-b7bc-62d4d23798d3\") " pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:55.880964 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:55.880920 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:38:55.880964 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:55.880947 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:38:55.880964 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:55.880957 2552 projected.go:196] Error preparing data for projected volume kube-api-access-xp6hw for pod openshift-network-diagnostics/network-check-target-p8bwh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:55.881095 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:55.881017 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw podName:24cec14d-f098-4f31-b7bc-62d4d23798d3 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:11.881003191 +0000 UTC m=+33.254401378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xp6hw" (UniqueName: "kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw") pod "network-check-target-p8bwh" (UID: "24cec14d-f098-4f31-b7bc-62d4d23798d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:38:55.998231 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:55.998191 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:55.998392 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:55.998323 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:38:56.998688 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:56.998171 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:56.998688 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:56.998171 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:56.998688 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:56.998313 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:38:56.998688 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:56.998344 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:38:57.998929 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:57.998889 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:57.999361 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:57.999050 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:38:58.999065 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:58.999032 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:38:58.999545 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:58.999159 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:38:58.999545 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:58.999245 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:38:58.999545 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:58.999367 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:38:59.998431 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:38:59.998396 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:38:59.998635 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:38:59.998533 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:39:01.000822 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:01.000794 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:01.001189 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:01.000892 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:39:01.001189 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:01.000945 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:01.001189 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:01.001041 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:39:01.998671 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:01.998317 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:39:01.998840 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:01.998810 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:39:02.147526 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.147272 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cs66v" event={"ID":"cd54c40f-93b5-47cd-aea8-558d87e7f3c3","Type":"ContainerStarted","Data":"8a042330a5d92c7ff94ac5c756f4a2d32988fdafcae72fbd8492bb66ef2d270f"} Jul 01 16:39:02.149713 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.149689 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" event={"ID":"d7b35bf3-e2db-44e7-8845-0cb04e369ab1","Type":"ContainerStarted","Data":"22f99ed95fb7ed07b15942cf5cc74e6ecb3e4382d6faf6155ee00e508b59e05a"} Jul 01 16:39:02.149839 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.149756 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" event={"ID":"d7b35bf3-e2db-44e7-8845-0cb04e369ab1","Type":"ContainerStarted","Data":"6e68f49448ecdf23b1a1a9c730b4e7e62e59ecc280fa52e293b5009c10a73513"} Jul 01 16:39:02.149839 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.149789 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" event={"ID":"d7b35bf3-e2db-44e7-8845-0cb04e369ab1","Type":"ContainerStarted","Data":"42c6da4f65961febcb50ccde362e547a11bf357ac4d18219c73db19896e0cc5f"} Jul 01 16:39:02.149839 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.149824 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" event={"ID":"d7b35bf3-e2db-44e7-8845-0cb04e369ab1","Type":"ContainerStarted","Data":"265736b2dd43c769cd73f2af486014d26214f8c002018bd83a5f5714893aadf3"} Jul 01 16:39:02.151045 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.151022 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" event={"ID":"92a65b0f-0434-452c-b903-19184282f387","Type":"ContainerStarted","Data":"e3d2427eb653192ba71ad3ec35ff2ab0f944cddaa42673b458b0e3ea5c3bb27b"} Jul 01 16:39:02.152409 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.152383 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6v2mg" event={"ID":"ef6345ae-521a-4825-94f6-532cc09b5507","Type":"ContainerStarted","Data":"311d0e04090b434967b72db672a65e6b20c710f46126ff83df0f13be7797c815"} Jul 01 16:39:02.153823 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.153800 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-26zzp" event={"ID":"ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65","Type":"ContainerStarted","Data":"cb2183b91e71554b9e773d905fc9bb05e66cb8c03a55681f9dc39225c912b7d1"} Jul 01 16:39:02.155265 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.155243 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhm6n" event={"ID":"8f95b035-879b-41d8-a6e6-b4767b52f3ca","Type":"ContainerStarted","Data":"2f954c18d286593aa25cf206f84df2ce75e578a8b39d69d600d4789b09890d22"} Jul 01 16:39:02.156868 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.156846 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" event={"ID":"057e5ae913964739cd5e8d17aa1ccb4e","Type":"ContainerStarted","Data":"133fd99b98d2d02b4d05e26f40cf72deeccd5240c8c907c48348a23595d01059"} Jul 01 16:39:02.158520 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.158495 2552 generic.go:356] "Generic (PLEG): container finished" podID="1d771cc620217a361bf7ea5aeb21cad6" containerID="543f180020c0e1cc69357c09e20474d2338ed405a5ede7c31deb3ff79edd4fe3" exitCode=0 Jul 01 16:39:02.158604 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.158522 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" event={"ID":"1d771cc620217a361bf7ea5aeb21cad6","Type":"ContainerDied","Data":"543f180020c0e1cc69357c09e20474d2338ed405a5ede7c31deb3ff79edd4fe3"} Jul 01 16:39:02.160076 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.160057 2552 generic.go:356] "Generic (PLEG): container finished" podID="8309fc9c-cbda-4f78-bb35-de36683c741e" containerID="8dacf3656dfff09fd0db788673ce0d1c1910e0922e2785d6f67a6acf80d3b490" exitCode=0 Jul 01 16:39:02.160194 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.160117 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v667t" event={"ID":"8309fc9c-cbda-4f78-bb35-de36683c741e","Type":"ContainerDied","Data":"8dacf3656dfff09fd0db788673ce0d1c1910e0922e2785d6f67a6acf80d3b490"} Jul 01 16:39:02.161719 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.161695 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9qmt5" event={"ID":"db80e063-ddfc-48ae-b2f0-90358a53d4ff","Type":"ContainerStarted","Data":"c7958c4201da08495018afe92c14b61a0eb7e3f3a9c2fd800ca2fcdfd9c3ee5f"} Jul 01 16:39:02.175243 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.175186 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cs66v" podStartSLOduration=1.139752947 podStartE2EDuration="22.175165392s" totalImagesPullingTime="21.035412445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:02.174369058 +0000 UTC m=+23.547767254" watchObservedRunningTime="2026-07-01 16:39:02.175165392 +0000 UTC m=+23.548563583" Jul 01 16:39:02.218321 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.218278 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zhm6n" podStartSLOduration=1.045593395 podStartE2EDuration="22.218261391s" totalImagesPullingTime="21.172667996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:02.198742141 +0000 UTC m=+23.572140319" watchObservedRunningTime="2026-07-01 16:39:02.218261391 +0000 UTC m=+23.591659578" Jul 01 16:39:02.244082 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.244027 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-26zzp" podStartSLOduration=1.5569458809999999 podStartE2EDuration="22.244006715s" totalImagesPullingTime="20.687060834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:02.218377342 +0000 UTC m=+23.591775604" watchObservedRunningTime="2026-07-01 16:39:02.244006715 +0000 UTC m=+23.617404905" Jul 01 16:39:02.291534 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.291485 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" podStartSLOduration=22.291468389 podStartE2EDuration="22.291468389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:02.259896353 +0000 UTC m=+23.633294540" watchObservedRunningTime="2026-07-01 16:39:02.291468389 +0000 UTC m=+23.664866581" Jul 01 16:39:02.327279 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.327226 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6v2mg" podStartSLOduration=1.000523391 podStartE2EDuration="22.327207937s" totalImagesPullingTime="21.326684546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:02.291358899 +0000 UTC m=+23.664757083" watchObservedRunningTime="2026-07-01 16:39:02.327207937 +0000 UTC m=+23.700606124" Jul 01 16:39:02.327502 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.327419 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9qmt5" podStartSLOduration=1.716755965 podStartE2EDuration="22.327413855s" totalImagesPullingTime="20.61065789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:02.32690358 +0000 UTC m=+23.700301767" watchObservedRunningTime="2026-07-01 16:39:02.327413855 +0000 UTC m=+23.700812045" Jul 01 16:39:02.998212 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.998179 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:02.998403 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:02.998314 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:39:02.998403 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:02.998367 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:02.998510 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:02.998479 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:39:03.167605 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:03.167558 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" event={"ID":"d7b35bf3-e2db-44e7-8845-0cb04e369ab1","Type":"ContainerStarted","Data":"f560f8a1469858856f4731e33262c98e96b575ef8a08a1619c7bfd9bdf69423a"} Jul 01 16:39:03.168101 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:03.167661 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" event={"ID":"d7b35bf3-e2db-44e7-8845-0cb04e369ab1","Type":"ContainerStarted","Data":"691b67c320451d496353b09d8af312229ba33e12868c5bc8db08e32c5bbb0fbe"} Jul 01 16:39:03.169652 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:03.169594 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v6p4r" event={"ID":"af113d38-8f5a-4d16-a6bf-850332a49d23","Type":"ContainerStarted","Data":"0ad2a1227a04db36766dc8d07b34c90cd55267e94b759923dd1fa997e4bd3ac1"} Jul 01 16:39:03.221659 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:03.221601 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v6p4r" podStartSLOduration=2.133771063 podStartE2EDuration="23.22157524s" totalImagesPullingTime="21.087804177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:03.200871518 +0000 UTC m=+24.574269704" watchObservedRunningTime="2026-07-01 16:39:03.22157524 +0000 UTC m=+24.594973430" Jul 01 16:39:03.811520 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:03.811487 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9qmt5" Jul 01 16:39:03.812219 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:03.812187 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9qmt5" Jul 01 16:39:03.998601 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:03.998567 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:39:03.998777 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:03.998726 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:39:04.174396 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:04.174292 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" event={"ID":"1d771cc620217a361bf7ea5aeb21cad6","Type":"ContainerStarted","Data":"874385ca5307daa5e05871a310a0ffc5c5dde68ae51100fe5d1c2f2a669b6e5d"} Jul 01 16:39:04.174838 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:04.174624 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9qmt5" Jul 01 16:39:04.175080 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:04.175058 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9qmt5" Jul 01 16:39:04.210466 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:04.210395 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" podStartSLOduration=24.210377246 podStartE2EDuration="24.210377246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:04.210116243 +0000 UTC m=+25.583514433" watchObservedRunningTime="2026-07-01 16:39:04.210377246 +0000 UTC m=+25.583775432" Jul 01 16:39:04.998418 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:04.998374 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:04.998660 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:04.998374 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:04.998660 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:04.998533 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:39:04.998660 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:04.998614 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:39:05.179296 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:05.179262 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" event={"ID":"d7b35bf3-e2db-44e7-8845-0cb04e369ab1","Type":"ContainerStarted","Data":"31efbb5ce898956a6889263453aba6d3851bc6d6d1c0a432755459d6d335708a"} Jul 01 16:39:05.998541 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:05.998499 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:39:05.998727 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:05.998654 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:39:06.998116 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:06.997878 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:06.998653 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:06.998229 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:39:06.998653 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:06.998087 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:06.998653 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:06.998328 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:39:07.015238 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:07.013971 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 16:39:07.187388 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:07.187355 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" event={"ID":"d7b35bf3-e2db-44e7-8845-0cb04e369ab1","Type":"ContainerStarted","Data":"7d7a396cf81d80152c6155ee0aaa14db56b7a61a379c3594e1fb548cb9879757"} Jul 01 16:39:07.187813 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:07.187728 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:39:07.189420 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:07.189393 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" event={"ID":"92a65b0f-0434-452c-b903-19184282f387","Type":"ContainerStarted","Data":"cfbf786304aa8ba1fabd936b8c3ab28bf3b6ca41822cf7eaad2216a35c29e9e0"} Jul 01 16:39:07.191233 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:07.191210 2552 generic.go:356] "Generic (PLEG): container finished" podID="8309fc9c-cbda-4f78-bb35-de36683c741e" containerID="747e6c040581b6e4530067b2bd24b4bc440e879c9c3cf909e20ea88201fbdcae" exitCode=0 Jul 01 16:39:07.191345 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:07.191249 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v667t" event={"ID":"8309fc9c-cbda-4f78-bb35-de36683c741e","Type":"ContainerDied","Data":"747e6c040581b6e4530067b2bd24b4bc440e879c9c3cf909e20ea88201fbdcae"} Jul 01 16:39:07.204761 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:07.204728 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:39:07.272059 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:07.272005 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" podStartSLOduration=6.186390975 podStartE2EDuration="27.271987394s" totalImagesPullingTime="21.085596419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:07.242761664 +0000 UTC m=+28.616159852" watchObservedRunningTime="2026-07-01 16:39:07.271987394 +0000 UTC m=+28.645385611" Jul 01 16:39:07.998242 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:07.998203 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:39:07.998940 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:07.998338 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:39:08.003403 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:08.003333 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T16:39:07.01399388Z","UUID":"ef4cd880-8d9e-43a4-8248-27a43ad5abcd","Handler":null,"Name":"","Endpoint":""} Jul 01 16:39:08.004908 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:08.004884 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 16:39:08.005013 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:08.004920 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 16:39:08.194757 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:08.194666 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:39:08.194757 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:08.194739 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:39:08.213266 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:08.213233 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:39:09.001710 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:09.001680 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:09.002265 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:09.001681 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:09.002265 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:09.001791 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:39:09.002265 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:09.001854 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:39:09.327603 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:09.327324 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p8bwh"] Jul 01 16:39:09.327603 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:09.327602 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:09.327823 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:09.327686 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:39:09.331389 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:09.331361 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z2z9q"] Jul 01 16:39:09.331537 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:09.331495 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:09.331631 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:09.331608 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:39:09.351094 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:09.351058 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rjtk4"] Jul 01 16:39:09.351249 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:09.351166 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:39:09.351289 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:09.351254 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:39:10.998301 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:10.998271 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:10.998699 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:10.998271 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:39:10.998699 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:10.998389 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:39:10.998699 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:10.998503 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:39:10.998699 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:10.998272 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:10.998699 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:10.998610 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:39:11.203116 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:11.203076 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" event={"ID":"92a65b0f-0434-452c-b903-19184282f387","Type":"ContainerStarted","Data":"e889996089941842212d598b9b9256b9417ab6f746fa60139cb5c118b16b60e1"} Jul 01 16:39:11.205319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:11.205293 2552 generic.go:356] "Generic (PLEG): container finished" podID="8309fc9c-cbda-4f78-bb35-de36683c741e" containerID="d297213bc24b66a25465c757684ba265fb6ceea2cb92acad48607fbefef818ba" exitCode=0 Jul 01 16:39:11.205431 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:11.205330 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v667t" event={"ID":"8309fc9c-cbda-4f78-bb35-de36683c741e","Type":"ContainerDied","Data":"d297213bc24b66a25465c757684ba265fb6ceea2cb92acad48607fbefef818ba"} Jul 01 16:39:11.232578 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:11.232527 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snj58" podStartSLOduration=2.060982661 podStartE2EDuration="31.232512232s" totalImagesPullingTime="29.171529571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:11.23217985 +0000 UTC m=+32.605578038" watchObservedRunningTime="2026-07-01 16:39:11.232512232 +0000 UTC m=+32.605910418" Jul 01 16:39:11.795383 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:11.795348 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:11.795590 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:11.795414 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:39:11.795590 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:11.795517 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:39:11.795590 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:11.795570 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:39:11.795722 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:11.795597 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret podName:6896b426-88bd-47d9-a32a-ef5a2cd56373 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:43.795576408 +0000 UTC m=+65.168974579 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret") pod "global-pull-secret-syncer-z2z9q" (UID: "6896b426-88bd-47d9-a32a-ef5a2cd56373") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:39:11.795722 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:11.795662 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs podName:0b7ebc87-2186-40e8-a839-68b232700b0c nodeName:}" failed. No retries permitted until 2026-07-01 16:39:43.795643235 +0000 UTC m=+65.169041400 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs") pod "network-metrics-daemon-rjtk4" (UID: "0b7ebc87-2186-40e8-a839-68b232700b0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:39:11.896354 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:11.896318 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6hw\" (UniqueName: \"kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw\") pod \"network-check-target-p8bwh\" (UID: \"24cec14d-f098-4f31-b7bc-62d4d23798d3\") " pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:11.896560 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:11.896529 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:39:11.896560 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:11.896554 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:39:11.896655 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:11.896567 2552 projected.go:196] Error preparing data for projected volume kube-api-access-xp6hw for pod openshift-network-diagnostics/network-check-target-p8bwh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:39:11.896655 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:11.896637 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw podName:24cec14d-f098-4f31-b7bc-62d4d23798d3 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:43.896615863 +0000 UTC m=+65.270014030 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xp6hw" (UniqueName: "kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw") pod "network-check-target-p8bwh" (UID: "24cec14d-f098-4f31-b7bc-62d4d23798d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:39:12.210158 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:12.210121 2552 generic.go:356] "Generic (PLEG): container finished" podID="8309fc9c-cbda-4f78-bb35-de36683c741e" containerID="b627fb6ac698fd8a62da2662137c33c59f973c5d2dcd43f6c4f52ff50f53bdbd" exitCode=0 Jul 01 16:39:12.210652 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:12.210209 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v667t" event={"ID":"8309fc9c-cbda-4f78-bb35-de36683c741e","Type":"ContainerDied","Data":"b627fb6ac698fd8a62da2662137c33c59f973c5d2dcd43f6c4f52ff50f53bdbd"} Jul 01 16:39:12.998934 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:12.998897 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:12.999119 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:12.999023 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8bwh" podUID="24cec14d-f098-4f31-b7bc-62d4d23798d3" Jul 01 16:39:12.999228 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:12.999214 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:12.999306 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:12.999291 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2z9q" podUID="6896b426-88bd-47d9-a32a-ef5a2cd56373" Jul 01 16:39:12.999466 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:12.999422 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:39:12.999544 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:12.999516 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjtk4" podUID="0b7ebc87-2186-40e8-a839-68b232700b0c" Jul 01 16:39:14.475278 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.475197 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeReady" Jul 01 16:39:14.475743 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.475371 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 16:39:14.559898 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.559858 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8lfxr"] Jul 01 16:39:14.574780 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.574743 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sg7zv"] Jul 01 16:39:14.574969 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.574896 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:14.586989 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.586960 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sg7zv" Jul 01 16:39:14.589768 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.589739 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 16:39:14.590618 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.590601 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 16:39:14.593586 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.593564 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c5tj8\"" Jul 01 16:39:14.593790 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.593562 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 16:39:14.593864 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.593791 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 16:39:14.594028 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.594009 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 16:39:14.599681 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.599658 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sg7zv"] Jul 01 16:39:14.604573 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.604552 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qw5lg\"" Jul 01 16:39:14.662245 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.662213 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8lfxr"] Jul 01 16:39:14.718495 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.718434 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsgd8\" (UniqueName: \"kubernetes.io/projected/32dd7a3b-a849-4339-9822-8599d954dc7a-kube-api-access-xsgd8\") pod \"ingress-canary-sg7zv\" (UID: \"32dd7a3b-a849-4339-9822-8599d954dc7a\") " pod="openshift-ingress-canary/ingress-canary-sg7zv" Jul 01 16:39:14.718705 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.718517 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:14.718705 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.718546 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32dd7a3b-a849-4339-9822-8599d954dc7a-cert\") pod \"ingress-canary-sg7zv\" (UID: \"32dd7a3b-a849-4339-9822-8599d954dc7a\") " pod="openshift-ingress-canary/ingress-canary-sg7zv" Jul 01 16:39:14.718705 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.718582 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac4efdc8-0c68-4c92-9811-a6cd246757b6-tmp-dir\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:14.718705 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.718608 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmg8r\" (UniqueName: \"kubernetes.io/projected/ac4efdc8-0c68-4c92-9811-a6cd246757b6-kube-api-access-dmg8r\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:14.718705 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.718672 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac4efdc8-0c68-4c92-9811-a6cd246757b6-config-volume\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:14.819087 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.819046 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac4efdc8-0c68-4c92-9811-a6cd246757b6-tmp-dir\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:14.819392 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.819095 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmg8r\" (UniqueName: \"kubernetes.io/projected/ac4efdc8-0c68-4c92-9811-a6cd246757b6-kube-api-access-dmg8r\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:14.819392 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.819148 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac4efdc8-0c68-4c92-9811-a6cd246757b6-config-volume\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:14.819392 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.819180 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsgd8\" (UniqueName: \"kubernetes.io/projected/32dd7a3b-a849-4339-9822-8599d954dc7a-kube-api-access-xsgd8\") pod \"ingress-canary-sg7zv\" (UID: \"32dd7a3b-a849-4339-9822-8599d954dc7a\") " pod="openshift-ingress-canary/ingress-canary-sg7zv" Jul 01 16:39:14.819392 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.819205 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:14.819392 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.819227 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32dd7a3b-a849-4339-9822-8599d954dc7a-cert\") pod \"ingress-canary-sg7zv\" (UID: \"32dd7a3b-a849-4339-9822-8599d954dc7a\") " pod="openshift-ingress-canary/ingress-canary-sg7zv" Jul 01 16:39:14.819392 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:14.819328 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:39:14.819747 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:14.819405 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls podName:ac4efdc8-0c68-4c92-9811-a6cd246757b6 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:15.319386105 +0000 UTC m=+36.692784270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls") pod "dns-default-8lfxr" (UID: "ac4efdc8-0c68-4c92-9811-a6cd246757b6") : secret "dns-default-metrics-tls" not found Jul 01 16:39:14.819747 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.819565 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac4efdc8-0c68-4c92-9811-a6cd246757b6-tmp-dir\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:14.819879 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.819856 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac4efdc8-0c68-4c92-9811-a6cd246757b6-config-volume\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:14.824111 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.824090 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32dd7a3b-a849-4339-9822-8599d954dc7a-cert\") pod \"ingress-canary-sg7zv\" (UID: \"32dd7a3b-a849-4339-9822-8599d954dc7a\") " pod="openshift-ingress-canary/ingress-canary-sg7zv" Jul 01 16:39:14.832277 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.832252 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmg8r\" (UniqueName: \"kubernetes.io/projected/ac4efdc8-0c68-4c92-9811-a6cd246757b6-kube-api-access-dmg8r\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:14.832456 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.832420 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsgd8\" (UniqueName: \"kubernetes.io/projected/32dd7a3b-a849-4339-9822-8599d954dc7a-kube-api-access-xsgd8\") pod \"ingress-canary-sg7zv\" (UID: \"32dd7a3b-a849-4339-9822-8599d954dc7a\") " pod="openshift-ingress-canary/ingress-canary-sg7zv" Jul 01 16:39:14.897666 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.897625 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sg7zv" Jul 01 16:39:14.998815 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.998322 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:14.998815 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.998322 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:14.998815 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:14.998730 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:39:15.002361 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:15.002337 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:39:15.002361 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:15.002350 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:39:15.002578 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:15.002341 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d6vzb\"" Jul 01 16:39:15.002578 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:15.002405 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-89cgw\"" Jul 01 16:39:15.002970 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:15.002951 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:39:15.003363 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:15.003341 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:39:15.323709 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:15.323673 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:15.324002 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:15.323838 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:39:15.324002 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:15.323925 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls podName:ac4efdc8-0c68-4c92-9811-a6cd246757b6 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:16.323911603 +0000 UTC m=+37.697309768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls") pod "dns-default-8lfxr" (UID: "ac4efdc8-0c68-4c92-9811-a6cd246757b6") : secret "dns-default-metrics-tls" not found Jul 01 16:39:16.331135 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:16.331077 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:16.331737 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:16.331230 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:39:16.331737 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:16.331297 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls podName:ac4efdc8-0c68-4c92-9811-a6cd246757b6 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:18.33128333 +0000 UTC m=+39.704681495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls") pod "dns-default-8lfxr" (UID: "ac4efdc8-0c68-4c92-9811-a6cd246757b6") : secret "dns-default-metrics-tls" not found Jul 01 16:39:16.523052 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:16.523020 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sg7zv"] Jul 01 16:39:16.575721 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:39:16.575397 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32dd7a3b_a849_4339_9822_8599d954dc7a.slice/crio-f42332f2b740f1ba04c66d8d41421249c2af42ac5dd365b5df14f132cf012bea WatchSource:0}: Error finding container f42332f2b740f1ba04c66d8d41421249c2af42ac5dd365b5df14f132cf012bea: Status 404 returned error can't find the container with id f42332f2b740f1ba04c66d8d41421249c2af42ac5dd365b5df14f132cf012bea Jul 01 16:39:17.226703 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:17.226663 2552 generic.go:356] "Generic (PLEG): container finished" podID="8309fc9c-cbda-4f78-bb35-de36683c741e" containerID="3efa9876cbd8974d5ecbcba987d4a46975f4d27c1f689aaffd0fcfab3b22086e" exitCode=0 Jul 01 16:39:17.226880 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:17.226734 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v667t" event={"ID":"8309fc9c-cbda-4f78-bb35-de36683c741e","Type":"ContainerDied","Data":"3efa9876cbd8974d5ecbcba987d4a46975f4d27c1f689aaffd0fcfab3b22086e"} Jul 01 16:39:17.227982 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:17.227953 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sg7zv" event={"ID":"32dd7a3b-a849-4339-9822-8599d954dc7a","Type":"ContainerStarted","Data":"f42332f2b740f1ba04c66d8d41421249c2af42ac5dd365b5df14f132cf012bea"} Jul 01 16:39:18.236681 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:18.236640 2552 generic.go:356] "Generic (PLEG): container finished" podID="8309fc9c-cbda-4f78-bb35-de36683c741e" containerID="c3999e34da6abffd890893779f94fa6ec4b99c3b63918945f9101712db6df226" exitCode=0 Jul 01 16:39:18.237248 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:18.236724 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v667t" event={"ID":"8309fc9c-cbda-4f78-bb35-de36683c741e","Type":"ContainerDied","Data":"c3999e34da6abffd890893779f94fa6ec4b99c3b63918945f9101712db6df226"} Jul 01 16:39:18.347648 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:18.347589 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:18.347848 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:18.347742 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:39:18.347848 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:18.347825 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls podName:ac4efdc8-0c68-4c92-9811-a6cd246757b6 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:22.347802907 +0000 UTC m=+43.721201092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls") pod "dns-default-8lfxr" (UID: "ac4efdc8-0c68-4c92-9811-a6cd246757b6") : secret "dns-default-metrics-tls" not found Jul 01 16:39:19.015722 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.015688 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78d54f8c9b-9m5v5"] Jul 01 16:39:19.031133 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.031102 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.035270 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.034726 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 16:39:19.035270 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.034821 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 16:39:19.035270 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.034936 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pzznc\"" Jul 01 16:39:19.035270 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.035196 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 16:39:19.038006 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.037978 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78d54f8c9b-9m5v5"] Jul 01 16:39:19.056163 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.056107 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 16:39:19.153181 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.153092 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.153181 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.153134 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3faaec88-52dc-458d-887f-4c4e3862e6f9-ca-trust-extracted\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.153181 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.153160 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3faaec88-52dc-458d-887f-4c4e3862e6f9-installation-pull-secrets\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.153419 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.153241 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-certificates\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.153419 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.153326 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3faaec88-52dc-458d-887f-4c4e3862e6f9-image-registry-private-configuration\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.153419 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.153362 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3faaec88-52dc-458d-887f-4c4e3862e6f9-trusted-ca\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.153419 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.153391 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-bound-sa-token\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.153419 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.153415 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhf97\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-kube-api-access-mhf97\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.242936 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.242890 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v667t" event={"ID":"8309fc9c-cbda-4f78-bb35-de36683c741e","Type":"ContainerStarted","Data":"c904d6fdedb6040c5a0cd10e5499cfa44b33b817fd416ea49d7d7ededf47fbde"} Jul 01 16:39:19.254760 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.254730 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.254760 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.254768 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3faaec88-52dc-458d-887f-4c4e3862e6f9-ca-trust-extracted\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.254960 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.254784 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3faaec88-52dc-458d-887f-4c4e3862e6f9-installation-pull-secrets\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.254960 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.254814 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-certificates\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.254960 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:19.254890 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:39:19.254960 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:19.254910 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d54f8c9b-9m5v5: secret "image-registry-tls" not found Jul 01 16:39:19.255111 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.254963 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3faaec88-52dc-458d-887f-4c4e3862e6f9-image-registry-private-configuration\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.255111 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:19.254976 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls podName:3faaec88-52dc-458d-887f-4c4e3862e6f9 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:19.754958407 +0000 UTC m=+41.128356600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls") pod "image-registry-78d54f8c9b-9m5v5" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9") : secret "image-registry-tls" not found Jul 01 16:39:19.255111 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.255003 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3faaec88-52dc-458d-887f-4c4e3862e6f9-trusted-ca\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.255111 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.255031 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-bound-sa-token\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.255111 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.255057 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhf97\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-kube-api-access-mhf97\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.255930 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.255896 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3faaec88-52dc-458d-887f-4c4e3862e6f9-ca-trust-extracted\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.256081 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.255904 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-certificates\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.259151 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.258366 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3faaec88-52dc-458d-887f-4c4e3862e6f9-trusted-ca\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.261278 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.261258 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3faaec88-52dc-458d-887f-4c4e3862e6f9-image-registry-private-configuration\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.261354 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.261265 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3faaec88-52dc-458d-887f-4c4e3862e6f9-installation-pull-secrets\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.266937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.266907 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-bound-sa-token\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.267410 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.267386 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhf97\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-kube-api-access-mhf97\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.275027 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.274973 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v667t" podStartSLOduration=5.246452477 podStartE2EDuration="39.274951501s" totalImagesPullingTime="34.028499024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:19.273796092 +0000 UTC m=+40.647194291" watchObservedRunningTime="2026-07-01 16:39:19.274951501 +0000 UTC m=+40.648349689" Jul 01 16:39:19.759167 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:19.758983 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:19.759345 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:19.759124 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:39:19.759345 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:19.759204 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d54f8c9b-9m5v5: secret "image-registry-tls" not found Jul 01 16:39:19.759345 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:19.759257 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls podName:3faaec88-52dc-458d-887f-4c4e3862e6f9 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:20.759242566 +0000 UTC m=+42.132640731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls") pod "image-registry-78d54f8c9b-9m5v5" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9") : secret "image-registry-tls" not found Jul 01 16:39:20.766643 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:20.766591 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:20.767106 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:20.766740 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:39:20.767106 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:20.766764 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d54f8c9b-9m5v5: secret "image-registry-tls" not found Jul 01 16:39:20.767106 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:20.766840 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls podName:3faaec88-52dc-458d-887f-4c4e3862e6f9 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:22.76682095 +0000 UTC m=+44.140219139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls") pod "image-registry-78d54f8c9b-9m5v5" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9") : secret "image-registry-tls" not found Jul 01 16:39:22.251175 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.251139 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sg7zv" event={"ID":"32dd7a3b-a849-4339-9822-8599d954dc7a","Type":"ContainerStarted","Data":"8dacceb97f88837282304ceded463db57e941918df62bd44f8e9fed2baf28724"} Jul 01 16:39:22.281508 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.281435 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sg7zv" podStartSLOduration=3.541900149 podStartE2EDuration="8.28141747s" totalImagesPullingTime="4.739517321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:22.277932915 +0000 UTC m=+43.651331104" watchObservedRunningTime="2026-07-01 16:39:22.28141747 +0000 UTC m=+43.654815657" Jul 01 16:39:22.301339 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.301306 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9ft7l"] Jul 01 16:39:22.321862 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.321831 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9ft7l"] Jul 01 16:39:22.322008 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.321976 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.325485 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.325452 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 16:39:22.326795 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.326774 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 16:39:22.326968 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.326774 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 16:39:22.326968 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.326955 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 16:39:22.327065 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.326997 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mj5tc\"" Jul 01 16:39:22.378672 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.378630 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:22.378862 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:22.378787 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:39:22.378862 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:22.378857 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls podName:ac4efdc8-0c68-4c92-9811-a6cd246757b6 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:30.37883931 +0000 UTC m=+51.752237494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls") pod "dns-default-8lfxr" (UID: "ac4efdc8-0c68-4c92-9811-a6cd246757b6") : secret "dns-default-metrics-tls" not found Jul 01 16:39:22.479999 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.479957 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b8e4441-41ed-4265-a895-07a6fafb769f-crio-socket\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.479999 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.480001 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.480244 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.480025 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b8e4441-41ed-4265-a895-07a6fafb769f-data-volume\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.480244 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.480162 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zltsh\" (UniqueName: \"kubernetes.io/projected/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-api-access-zltsh\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.480244 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.480215 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.581257 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.581164 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b8e4441-41ed-4265-a895-07a6fafb769f-crio-socket\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.581257 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.581202 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.581257 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.581226 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b8e4441-41ed-4265-a895-07a6fafb769f-data-volume\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.581558 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.581268 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltsh\" (UniqueName: \"kubernetes.io/projected/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-api-access-zltsh\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.581558 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.581308 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.581558 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:22.581345 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:39:22.581558 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:22.581391 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:39:22.581558 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:22.581464 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls podName:2b8e4441-41ed-4265-a895-07a6fafb769f nodeName:}" failed. No retries permitted until 2026-07-01 16:39:23.081419346 +0000 UTC m=+44.454817531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ft7l" (UID: "2b8e4441-41ed-4265-a895-07a6fafb769f") : secret "insights-runtime-extractor-tls" not found Jul 01 16:39:22.581558 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:22.581486 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm podName:2b8e4441-41ed-4265-a895-07a6fafb769f nodeName:}" failed. No retries permitted until 2026-07-01 16:39:23.081475244 +0000 UTC m=+44.454873410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ft7l" (UID: "2b8e4441-41ed-4265-a895-07a6fafb769f") : configmap "kube-rbac-proxy" not found Jul 01 16:39:22.581558 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.581488 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b8e4441-41ed-4265-a895-07a6fafb769f-crio-socket\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.581830 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.581612 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b8e4441-41ed-4265-a895-07a6fafb769f-data-volume\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.595289 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.595256 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zltsh\" (UniqueName: \"kubernetes.io/projected/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-api-access-zltsh\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:22.783118 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:22.783077 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:22.783295 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:22.783235 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:39:22.783295 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:22.783255 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d54f8c9b-9m5v5: secret "image-registry-tls" not found Jul 01 16:39:22.783368 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:22.783311 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls podName:3faaec88-52dc-458d-887f-4c4e3862e6f9 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:26.783294157 +0000 UTC m=+48.156692326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls") pod "image-registry-78d54f8c9b-9m5v5" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9") : secret "image-registry-tls" not found Jul 01 16:39:23.085573 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:23.085517 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:23.085757 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:23.085633 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:23.085757 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:23.085649 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:39:23.085757 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:23.085715 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm podName:2b8e4441-41ed-4265-a895-07a6fafb769f nodeName:}" failed. No retries permitted until 2026-07-01 16:39:24.085697485 +0000 UTC m=+45.459095649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ft7l" (UID: "2b8e4441-41ed-4265-a895-07a6fafb769f") : configmap "kube-rbac-proxy" not found Jul 01 16:39:23.085878 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:23.085791 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:39:23.085878 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:23.085841 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls podName:2b8e4441-41ed-4265-a895-07a6fafb769f nodeName:}" failed. No retries permitted until 2026-07-01 16:39:24.085830153 +0000 UTC m=+45.459228317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ft7l" (UID: "2b8e4441-41ed-4265-a895-07a6fafb769f") : secret "insights-runtime-extractor-tls" not found Jul 01 16:39:24.094865 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:24.094819 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:24.095299 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:24.094931 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:24.095299 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:24.094960 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:39:24.095299 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:24.095028 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm podName:2b8e4441-41ed-4265-a895-07a6fafb769f nodeName:}" failed. No retries permitted until 2026-07-01 16:39:26.095008314 +0000 UTC m=+47.468406496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ft7l" (UID: "2b8e4441-41ed-4265-a895-07a6fafb769f") : configmap "kube-rbac-proxy" not found Jul 01 16:39:24.095299 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:24.095115 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:39:24.095299 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:24.095191 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls podName:2b8e4441-41ed-4265-a895-07a6fafb769f nodeName:}" failed. No retries permitted until 2026-07-01 16:39:26.095172574 +0000 UTC m=+47.468570755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ft7l" (UID: "2b8e4441-41ed-4265-a895-07a6fafb769f") : secret "insights-runtime-extractor-tls" not found Jul 01 16:39:24.480749 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:24.480720 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhm6n_8f95b035-879b-41d8-a6e6-b4767b52f3ca/dns-node-resolver/0.log" Jul 01 16:39:25.079435 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.079411 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-26zzp_ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65/node-ca/0.log" Jul 01 16:39:25.180551 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.180509 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-2z98h"] Jul 01 16:39:25.223818 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.223782 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-2z98h"] Jul 01 16:39:25.223980 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.223909 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" Jul 01 16:39:25.226860 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.226828 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 01 16:39:25.227007 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.226969 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 01 16:39:25.227007 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.226980 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mdl44\"" Jul 01 16:39:25.228184 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.228158 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 01 16:39:25.228286 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.228189 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 01 16:39:25.305098 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.305064 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/48384ee4-14a9-4f11-9254-05f16a5a0e02-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-2z98h\" (UID: \"48384ee4-14a9-4f11-9254-05f16a5a0e02\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" Jul 01 16:39:25.305301 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.305188 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/48384ee4-14a9-4f11-9254-05f16a5a0e02-signing-key\") pod \"service-ca-7bb4f4bcc7-2z98h\" (UID: \"48384ee4-14a9-4f11-9254-05f16a5a0e02\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" Jul 01 16:39:25.305301 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.305235 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2wvf\" (UniqueName: \"kubernetes.io/projected/48384ee4-14a9-4f11-9254-05f16a5a0e02-kube-api-access-k2wvf\") pod \"service-ca-7bb4f4bcc7-2z98h\" (UID: \"48384ee4-14a9-4f11-9254-05f16a5a0e02\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" Jul 01 16:39:25.406372 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.406295 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/48384ee4-14a9-4f11-9254-05f16a5a0e02-signing-key\") pod \"service-ca-7bb4f4bcc7-2z98h\" (UID: \"48384ee4-14a9-4f11-9254-05f16a5a0e02\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" Jul 01 16:39:25.406372 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.406332 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2wvf\" (UniqueName: \"kubernetes.io/projected/48384ee4-14a9-4f11-9254-05f16a5a0e02-kube-api-access-k2wvf\") pod \"service-ca-7bb4f4bcc7-2z98h\" (UID: \"48384ee4-14a9-4f11-9254-05f16a5a0e02\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" Jul 01 16:39:25.406571 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.406530 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/48384ee4-14a9-4f11-9254-05f16a5a0e02-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-2z98h\" (UID: \"48384ee4-14a9-4f11-9254-05f16a5a0e02\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" Jul 01 16:39:25.407080 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.407056 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/48384ee4-14a9-4f11-9254-05f16a5a0e02-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-2z98h\" (UID: \"48384ee4-14a9-4f11-9254-05f16a5a0e02\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" Jul 01 16:39:25.408815 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.408797 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/48384ee4-14a9-4f11-9254-05f16a5a0e02-signing-key\") pod \"service-ca-7bb4f4bcc7-2z98h\" (UID: \"48384ee4-14a9-4f11-9254-05f16a5a0e02\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" Jul 01 16:39:25.416858 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.416827 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2wvf\" (UniqueName: \"kubernetes.io/projected/48384ee4-14a9-4f11-9254-05f16a5a0e02-kube-api-access-k2wvf\") pod \"service-ca-7bb4f4bcc7-2z98h\" (UID: \"48384ee4-14a9-4f11-9254-05f16a5a0e02\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" Jul 01 16:39:25.533370 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.533319 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" Jul 01 16:39:25.713558 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.713526 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-2z98h"] Jul 01 16:39:25.716172 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:39:25.716145 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48384ee4_14a9_4f11_9254_05f16a5a0e02.slice/crio-6d682c297fe89f2bc2658b3543892c67d9ec717ee69439aefefbd81137caf27a WatchSource:0}: Error finding container 6d682c297fe89f2bc2658b3543892c67d9ec717ee69439aefefbd81137caf27a: Status 404 returned error can't find the container with id 6d682c297fe89f2bc2658b3543892c67d9ec717ee69439aefefbd81137caf27a Jul 01 16:39:25.880477 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:25.880429 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sg7zv_32dd7a3b-a849-4339-9822-8599d954dc7a/serve-healthcheck-canary/0.log" Jul 01 16:39:26.111268 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:26.111227 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:26.111514 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:26.111310 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:26.111514 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:26.111356 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:39:26.111514 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:26.111432 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:39:26.111514 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:26.111462 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm podName:2b8e4441-41ed-4265-a895-07a6fafb769f nodeName:}" failed. No retries permitted until 2026-07-01 16:39:30.11141913 +0000 UTC m=+51.484817310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9ft7l" (UID: "2b8e4441-41ed-4265-a895-07a6fafb769f") : configmap "kube-rbac-proxy" not found Jul 01 16:39:26.111746 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:26.111529 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls podName:2b8e4441-41ed-4265-a895-07a6fafb769f nodeName:}" failed. No retries permitted until 2026-07-01 16:39:30.111510218 +0000 UTC m=+51.484908386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ft7l" (UID: "2b8e4441-41ed-4265-a895-07a6fafb769f") : secret "insights-runtime-extractor-tls" not found Jul 01 16:39:26.261093 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:26.261054 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" event={"ID":"48384ee4-14a9-4f11-9254-05f16a5a0e02","Type":"ContainerStarted","Data":"6d682c297fe89f2bc2658b3543892c67d9ec717ee69439aefefbd81137caf27a"} Jul 01 16:39:26.816240 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:26.816196 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:26.816514 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:26.816344 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:39:26.816514 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:26.816364 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d54f8c9b-9m5v5: secret "image-registry-tls" not found Jul 01 16:39:26.816514 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:26.816418 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls podName:3faaec88-52dc-458d-887f-4c4e3862e6f9 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:34.816403537 +0000 UTC m=+56.189801701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls") pod "image-registry-78d54f8c9b-9m5v5" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9") : secret "image-registry-tls" not found Jul 01 16:39:30.145391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:30.145353 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:30.145867 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:30.145455 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:30.145867 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:30.145537 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:39:30.145867 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:30.145614 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls podName:2b8e4441-41ed-4265-a895-07a6fafb769f nodeName:}" failed. No retries permitted until 2026-07-01 16:39:38.145598178 +0000 UTC m=+59.518996346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9ft7l" (UID: "2b8e4441-41ed-4265-a895-07a6fafb769f") : secret "insights-runtime-extractor-tls" not found Jul 01 16:39:30.145987 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:30.145936 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b8e4441-41ed-4265-a895-07a6fafb769f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:30.272614 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:30.272566 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" event={"ID":"48384ee4-14a9-4f11-9254-05f16a5a0e02","Type":"ContainerStarted","Data":"f634c8301e14bda8d93a3c41bad1911e74bdd1e8f6fd1f2b98e56c27d993d645"} Jul 01 16:39:30.291796 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:30.291740 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-2z98h" podStartSLOduration=1.782485125 podStartE2EDuration="5.291723062s" totalImagesPullingTime="3.509237937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:30.291201928 +0000 UTC m=+51.664600127" watchObservedRunningTime="2026-07-01 16:39:30.291723062 +0000 UTC m=+51.665121249" Jul 01 16:39:30.448157 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:30.448056 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:30.448328 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:30.448187 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:39:30.448328 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:39:30.448248 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls podName:ac4efdc8-0c68-4c92-9811-a6cd246757b6 nodeName:}" failed. No retries permitted until 2026-07-01 16:39:46.448234971 +0000 UTC m=+67.821633136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls") pod "dns-default-8lfxr" (UID: "ac4efdc8-0c68-4c92-9811-a6cd246757b6") : secret "dns-default-metrics-tls" not found Jul 01 16:39:34.879393 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:34.879351 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:34.881860 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:34.881834 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls\") pod \"image-registry-78d54f8c9b-9m5v5\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:34.946125 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:34.946081 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:35.080648 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:35.080613 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78d54f8c9b-9m5v5"] Jul 01 16:39:35.084204 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:39:35.084175 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3faaec88_52dc_458d_887f_4c4e3862e6f9.slice/crio-22767dc1890ca1e0568b0c0ac6164b2ff0e223306c19b3e7b5b76512516b1245 WatchSource:0}: Error finding container 22767dc1890ca1e0568b0c0ac6164b2ff0e223306c19b3e7b5b76512516b1245: Status 404 returned error can't find the container with id 22767dc1890ca1e0568b0c0ac6164b2ff0e223306c19b3e7b5b76512516b1245 Jul 01 16:39:35.286025 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:35.285983 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" event={"ID":"3faaec88-52dc-458d-887f-4c4e3862e6f9","Type":"ContainerStarted","Data":"783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b"} Jul 01 16:39:35.286224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:35.286046 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" event={"ID":"3faaec88-52dc-458d-887f-4c4e3862e6f9","Type":"ContainerStarted","Data":"22767dc1890ca1e0568b0c0ac6164b2ff0e223306c19b3e7b5b76512516b1245"} Jul 01 16:39:35.286224 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:35.286179 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:39:35.312320 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:35.312255 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" podStartSLOduration=17.312230972 podStartE2EDuration="17.312230972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:39:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:35.311790285 +0000 UTC m=+56.685188494" watchObservedRunningTime="2026-07-01 16:39:35.312230972 +0000 UTC m=+56.685629139" Jul 01 16:39:38.204572 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:38.204538 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:38.207218 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:38.207184 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b8e4441-41ed-4265-a895-07a6fafb769f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ft7l\" (UID: \"2b8e4441-41ed-4265-a895-07a6fafb769f\") " pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:38.232204 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:38.232162 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9ft7l" Jul 01 16:39:38.414365 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:38.414333 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9ft7l"] Jul 01 16:39:38.418526 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:39:38.418495 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8e4441_41ed_4265_a895_07a6fafb769f.slice/crio-ba940acc4ed1b7dbe2de9ca94b44946e7c89e76f36bebfda58ba227d3a354127 WatchSource:0}: Error finding container ba940acc4ed1b7dbe2de9ca94b44946e7c89e76f36bebfda58ba227d3a354127: Status 404 returned error can't find the container with id ba940acc4ed1b7dbe2de9ca94b44946e7c89e76f36bebfda58ba227d3a354127 Jul 01 16:39:39.298478 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:39.298424 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ft7l" event={"ID":"2b8e4441-41ed-4265-a895-07a6fafb769f","Type":"ContainerStarted","Data":"ba940acc4ed1b7dbe2de9ca94b44946e7c89e76f36bebfda58ba227d3a354127"} Jul 01 16:39:40.210351 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:40.210321 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qnmvz" Jul 01 16:39:43.837992 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.837943 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp"] Jul 01 16:39:43.841345 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.841318 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97"] Jul 01 16:39:43.841538 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.841483 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:43.844785 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.844755 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 01 16:39:43.844927 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.844886 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:43.845000 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.844975 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78d54f8c9b-9m5v5"] Jul 01 16:39:43.847952 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.847926 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 01 16:39:43.848427 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.848394 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 01 16:39:43.848673 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.848654 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 01 16:39:43.849331 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.848905 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:43.849331 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.848936 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 01 16:39:43.849331 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.848982 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:39:43.849776 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.849752 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 16:39:43.850805 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.850628 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 16:39:43.853139 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.852953 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:39:43.853893 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.853872 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:39:43.863324 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.861842 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp"] Jul 01 16:39:43.863324 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.862322 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 16:39:43.863483 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.863337 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6896b426-88bd-47d9-a32a-ef5a2cd56373-original-pull-secret\") pod \"global-pull-secret-syncer-z2z9q\" (UID: \"6896b426-88bd-47d9-a32a-ef5a2cd56373\") " pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:43.863544 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.863513 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97"] Jul 01 16:39:43.865779 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.865746 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b7ebc87-2186-40e8-a839-68b232700b0c-metrics-certs\") pod \"network-metrics-daemon-rjtk4\" (UID: \"0b7ebc87-2186-40e8-a839-68b232700b0c\") " pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:39:43.949968 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.949930 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5830f308-eaad-4f03-8347-8b8680df4ecf-klusterlet-config\") pod \"klusterlet-addon-workmgr-8b6d6df69-xwblp\" (UID: \"5830f308-eaad-4f03-8347-8b8680df4ecf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:43.949968 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.949976 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e4ac8df3-b449-41d1-b442-81056cf6371d-hub\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:43.950215 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.950075 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ac8df3-b449-41d1-b442-81056cf6371d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:43.950215 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.950118 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxrtf\" (UniqueName: \"kubernetes.io/projected/e4ac8df3-b449-41d1-b442-81056cf6371d-kube-api-access-nxrtf\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:43.950215 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.950149 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e4ac8df3-b449-41d1-b442-81056cf6371d-ca\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:43.950215 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.950184 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e4ac8df3-b449-41d1-b442-81056cf6371d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:43.950379 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.950225 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5830f308-eaad-4f03-8347-8b8680df4ecf-tmp\") pod \"klusterlet-addon-workmgr-8b6d6df69-xwblp\" (UID: \"5830f308-eaad-4f03-8347-8b8680df4ecf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:43.950379 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.950257 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lrnm\" (UniqueName: \"kubernetes.io/projected/5830f308-eaad-4f03-8347-8b8680df4ecf-kube-api-access-8lrnm\") pod \"klusterlet-addon-workmgr-8b6d6df69-xwblp\" (UID: \"5830f308-eaad-4f03-8347-8b8680df4ecf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:43.950379 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.950289 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4ac8df3-b449-41d1-b442-81056cf6371d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:43.950379 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.950360 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6hw\" (UniqueName: \"kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw\") pod \"network-check-target-p8bwh\" (UID: \"24cec14d-f098-4f31-b7bc-62d4d23798d3\") " pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:43.961567 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.961536 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:39:43.982830 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.982800 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:39:43.994337 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:43.994304 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp6hw\" (UniqueName: \"kubernetes.io/projected/24cec14d-f098-4f31-b7bc-62d4d23798d3-kube-api-access-xp6hw\") pod \"network-check-target-p8bwh\" (UID: \"24cec14d-f098-4f31-b7bc-62d4d23798d3\") " pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:44.051180 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.051146 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ac8df3-b449-41d1-b442-81056cf6371d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.051180 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.051187 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxrtf\" (UniqueName: \"kubernetes.io/projected/e4ac8df3-b449-41d1-b442-81056cf6371d-kube-api-access-nxrtf\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.051425 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.051221 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e4ac8df3-b449-41d1-b442-81056cf6371d-ca\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.051425 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.051249 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e4ac8df3-b449-41d1-b442-81056cf6371d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.051425 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.051274 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5830f308-eaad-4f03-8347-8b8680df4ecf-tmp\") pod \"klusterlet-addon-workmgr-8b6d6df69-xwblp\" (UID: \"5830f308-eaad-4f03-8347-8b8680df4ecf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:44.051425 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.051306 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lrnm\" (UniqueName: \"kubernetes.io/projected/5830f308-eaad-4f03-8347-8b8680df4ecf-kube-api-access-8lrnm\") pod \"klusterlet-addon-workmgr-8b6d6df69-xwblp\" (UID: \"5830f308-eaad-4f03-8347-8b8680df4ecf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:44.051425 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.051330 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4ac8df3-b449-41d1-b442-81056cf6371d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.051425 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.051384 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5830f308-eaad-4f03-8347-8b8680df4ecf-klusterlet-config\") pod \"klusterlet-addon-workmgr-8b6d6df69-xwblp\" (UID: \"5830f308-eaad-4f03-8347-8b8680df4ecf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:44.051425 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.051409 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e4ac8df3-b449-41d1-b442-81056cf6371d-hub\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.051779 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.051678 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5830f308-eaad-4f03-8347-8b8680df4ecf-tmp\") pod \"klusterlet-addon-workmgr-8b6d6df69-xwblp\" (UID: \"5830f308-eaad-4f03-8347-8b8680df4ecf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:44.052127 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.051900 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ac8df3-b449-41d1-b442-81056cf6371d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.054257 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.054226 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5830f308-eaad-4f03-8347-8b8680df4ecf-klusterlet-config\") pod \"klusterlet-addon-workmgr-8b6d6df69-xwblp\" (UID: \"5830f308-eaad-4f03-8347-8b8680df4ecf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:44.054456 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.054417 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e4ac8df3-b449-41d1-b442-81056cf6371d-ca\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.054609 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.054586 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e4ac8df3-b449-41d1-b442-81056cf6371d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.054743 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.054724 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4ac8df3-b449-41d1-b442-81056cf6371d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.054803 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.054788 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e4ac8df3-b449-41d1-b442-81056cf6371d-hub\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.064781 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.064756 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxrtf\" (UniqueName: \"kubernetes.io/projected/e4ac8df3-b449-41d1-b442-81056cf6371d-kube-api-access-nxrtf\") pod \"cluster-proxy-proxy-agent-7cb99ccc89-xhw97\" (UID: \"e4ac8df3-b449-41d1-b442-81056cf6371d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.067733 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.067710 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lrnm\" (UniqueName: \"kubernetes.io/projected/5830f308-eaad-4f03-8347-8b8680df4ecf-kube-api-access-8lrnm\") pod \"klusterlet-addon-workmgr-8b6d6df69-xwblp\" (UID: \"5830f308-eaad-4f03-8347-8b8680df4ecf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:44.110687 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.110605 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2z9q" Jul 01 16:39:44.130308 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.130266 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-89cgw\"" Jul 01 16:39:44.131509 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.131487 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d6vzb\"" Jul 01 16:39:44.134599 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.134572 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjtk4" Jul 01 16:39:44.138219 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.138186 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:44.154829 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.154805 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:44.182312 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.181957 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" Jul 01 16:39:44.310202 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.310134 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z2z9q"] Jul 01 16:39:44.313932 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:39:44.313887 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6896b426_88bd_47d9_a32a_ef5a2cd56373.slice/crio-06c3a433c02e3d6f57a7df823b23f8d2ec8bec4bb46bc8063aaec77782a41ef0 WatchSource:0}: Error finding container 06c3a433c02e3d6f57a7df823b23f8d2ec8bec4bb46bc8063aaec77782a41ef0: Status 404 returned error can't find the container with id 06c3a433c02e3d6f57a7df823b23f8d2ec8bec4bb46bc8063aaec77782a41ef0 Jul 01 16:39:44.320198 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.319308 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ft7l" event={"ID":"2b8e4441-41ed-4265-a895-07a6fafb769f","Type":"ContainerStarted","Data":"22539befb75711cede8be96642813566614c36f93aa901e4d03dcbb616d7dfbc"} Jul 01 16:39:44.345125 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.345092 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rjtk4"] Jul 01 16:39:44.352645 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:39:44.352602 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b7ebc87_2186_40e8_a839_68b232700b0c.slice/crio-e2cc4a5d2b47196b59ad4ced709ab04af4c66445dac430af41a6b6e87cb7937f WatchSource:0}: Error finding container e2cc4a5d2b47196b59ad4ced709ab04af4c66445dac430af41a6b6e87cb7937f: Status 404 returned error can't find the container with id e2cc4a5d2b47196b59ad4ced709ab04af4c66445dac430af41a6b6e87cb7937f Jul 01 16:39:44.357847 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.357775 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p8bwh"] Jul 01 16:39:44.361340 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:39:44.361279 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24cec14d_f098_4f31_b7bc_62d4d23798d3.slice/crio-6d84a2b6e45ea3f673cdf1b3afeac02cbe1e6ab2c46b5a93b717fafb3432990e WatchSource:0}: Error finding container 6d84a2b6e45ea3f673cdf1b3afeac02cbe1e6ab2c46b5a93b717fafb3432990e: Status 404 returned error can't find the container with id 6d84a2b6e45ea3f673cdf1b3afeac02cbe1e6ab2c46b5a93b717fafb3432990e Jul 01 16:39:44.583670 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.583639 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp"] Jul 01 16:39:44.586948 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:44.586824 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97"] Jul 01 16:39:44.586948 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:39:44.586888 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5830f308_eaad_4f03_8347_8b8680df4ecf.slice/crio-75ef96488a422ecb41cfeaac7a924562dc5d872f3a67dd3fb75a6dab5e608720 WatchSource:0}: Error finding container 75ef96488a422ecb41cfeaac7a924562dc5d872f3a67dd3fb75a6dab5e608720: Status 404 returned error can't find the container with id 75ef96488a422ecb41cfeaac7a924562dc5d872f3a67dd3fb75a6dab5e608720 Jul 01 16:39:44.589320 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:39:44.589302 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4ac8df3_b449_41d1_b442_81056cf6371d.slice/crio-6e66f2056241e2e3077054c125a176a9b62b29091d9e80d15f558975bce2eb24 WatchSource:0}: Error finding container 6e66f2056241e2e3077054c125a176a9b62b29091d9e80d15f558975bce2eb24: Status 404 returned error can't find the container with id 6e66f2056241e2e3077054c125a176a9b62b29091d9e80d15f558975bce2eb24 Jul 01 16:39:45.324681 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:45.324645 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rjtk4" event={"ID":"0b7ebc87-2186-40e8-a839-68b232700b0c","Type":"ContainerStarted","Data":"e2cc4a5d2b47196b59ad4ced709ab04af4c66445dac430af41a6b6e87cb7937f"} Jul 01 16:39:45.326329 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:45.326297 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z2z9q" event={"ID":"6896b426-88bd-47d9-a32a-ef5a2cd56373","Type":"ContainerStarted","Data":"06c3a433c02e3d6f57a7df823b23f8d2ec8bec4bb46bc8063aaec77782a41ef0"} Jul 01 16:39:45.329517 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:45.329431 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ft7l" event={"ID":"2b8e4441-41ed-4265-a895-07a6fafb769f","Type":"ContainerStarted","Data":"9bfd6183a571d651dbfecad2f42f2f9360368f737415194bdfbc951e8c8f7bd9"} Jul 01 16:39:45.330803 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:45.330778 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" event={"ID":"5830f308-eaad-4f03-8347-8b8680df4ecf","Type":"ContainerStarted","Data":"75ef96488a422ecb41cfeaac7a924562dc5d872f3a67dd3fb75a6dab5e608720"} Jul 01 16:39:45.332084 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:45.332051 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p8bwh" event={"ID":"24cec14d-f098-4f31-b7bc-62d4d23798d3","Type":"ContainerStarted","Data":"6d84a2b6e45ea3f673cdf1b3afeac02cbe1e6ab2c46b5a93b717fafb3432990e"} Jul 01 16:39:45.333416 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:45.333390 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" event={"ID":"e4ac8df3-b449-41d1-b442-81056cf6371d","Type":"ContainerStarted","Data":"6e66f2056241e2e3077054c125a176a9b62b29091d9e80d15f558975bce2eb24"} Jul 01 16:39:46.364142 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:46.364100 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rjtk4" event={"ID":"0b7ebc87-2186-40e8-a839-68b232700b0c","Type":"ContainerStarted","Data":"d5a6633bd9793dd963c302d80efe27ca431702e3a28800f285c47811e6ed5d0d"} Jul 01 16:39:46.364666 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:46.364217 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rjtk4" event={"ID":"0b7ebc87-2186-40e8-a839-68b232700b0c","Type":"ContainerStarted","Data":"bf9cdf438b026f71ba772ae53c6e4d7a29e9d2fe1e06bf6e7eac8fc675eee127"} Jul 01 16:39:46.479003 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:46.477990 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:46.485428 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:46.485363 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac4efdc8-0c68-4c92-9811-a6cd246757b6-metrics-tls\") pod \"dns-default-8lfxr\" (UID: \"ac4efdc8-0c68-4c92-9811-a6cd246757b6\") " pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:46.690143 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:46.689851 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qw5lg\"" Jul 01 16:39:46.697249 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:46.696970 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8lfxr" Jul 01 16:39:53.851367 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:53.851323 2552 patch_prober.go:28] interesting pod/image-registry-78d54f8c9b-9m5v5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 16:39:53.851833 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:53.851416 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" podUID="3faaec88-52dc-458d-887f-4c4e3862e6f9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:39:54.057677 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:54.057617 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rjtk4" podStartSLOduration=73.092644263 podStartE2EDuration="1m14.057592042s" totalImagesPullingTime="964.947779ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:46.39496876 +0000 UTC m=+67.768366948" watchObservedRunningTime="2026-07-01 16:39:54.057592042 +0000 UTC m=+75.430990244" Jul 01 16:39:54.057881 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:54.057862 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8lfxr"] Jul 01 16:39:54.887629 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:39:54.887272 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4efdc8_0c68_4c92_9811_a6cd246757b6.slice/crio-e0ce7b4cacb4f68c798e36f709801c7bd63175e8c03704a7f6b09044c1ea5560 WatchSource:0}: Error finding container e0ce7b4cacb4f68c798e36f709801c7bd63175e8c03704a7f6b09044c1ea5560: Status 404 returned error can't find the container with id e0ce7b4cacb4f68c798e36f709801c7bd63175e8c03704a7f6b09044c1ea5560 Jul 01 16:39:55.404119 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.404012 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p8bwh" event={"ID":"24cec14d-f098-4f31-b7bc-62d4d23798d3","Type":"ContainerStarted","Data":"8e4bd11245582f00043c7f7910eb82f927efdf435661621ee96e9cf38beb0950"} Jul 01 16:39:55.404309 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.404171 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:39:55.406177 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.406141 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" event={"ID":"e4ac8df3-b449-41d1-b442-81056cf6371d","Type":"ContainerStarted","Data":"67e42980f5eada8979cefc06c19de93ba132922ea6c6f34d2dd5f0b9f88c0bb6"} Jul 01 16:39:55.406326 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.406186 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" event={"ID":"e4ac8df3-b449-41d1-b442-81056cf6371d","Type":"ContainerStarted","Data":"e0b98231243b96a9656e3834e1da588c70a91a3bb6fbe3daf3cbf6bffd537ac6"} Jul 01 16:39:55.406326 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.406204 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" event={"ID":"e4ac8df3-b449-41d1-b442-81056cf6371d","Type":"ContainerStarted","Data":"6de09d8b693cc1577e2e106a6ad3a5e1cd0209372fd6ffb6039e64749bb6bbe1"} Jul 01 16:39:55.407588 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.407561 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z2z9q" event={"ID":"6896b426-88bd-47d9-a32a-ef5a2cd56373","Type":"ContainerStarted","Data":"04c7b4d86fe090a364cb00cb409d22c91ad965b7bd5cbb3a952f67ee2a5df905"} Jul 01 16:39:55.409940 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.409914 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ft7l" event={"ID":"2b8e4441-41ed-4265-a895-07a6fafb769f","Type":"ContainerStarted","Data":"264ed4a9e6b1aa48bcbf6214122fb22cd7a433b423d0233f658248ea643ec039"} Jul 01 16:39:55.411330 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.411306 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" event={"ID":"5830f308-eaad-4f03-8347-8b8680df4ecf","Type":"ContainerStarted","Data":"ba3fa1dfc0102023d48774d68d67fa9cfc61ade093944d1b6cdd37c56fd70dd8"} Jul 01 16:39:55.411471 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.411354 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:55.412475 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.412434 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8lfxr" event={"ID":"ac4efdc8-0c68-4c92-9811-a6cd246757b6","Type":"ContainerStarted","Data":"e0ce7b4cacb4f68c798e36f709801c7bd63175e8c03704a7f6b09044c1ea5560"} Jul 01 16:39:55.413308 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.413290 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" Jul 01 16:39:55.456942 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.456889 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p8bwh" podStartSLOduration=64.882738126 podStartE2EDuration="1m15.456873525s" totalImagesPullingTime="10.574135399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:55.432142567 +0000 UTC m=+76.805540754" watchObservedRunningTime="2026-07-01 16:39:55.456873525 +0000 UTC m=+76.830271711" Jul 01 16:39:55.457109 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.457078 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z2z9q" podStartSLOduration=64.887027203 podStartE2EDuration="1m15.45707237s" totalImagesPullingTime="10.570045167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:55.456013547 +0000 UTC m=+76.829411733" watchObservedRunningTime="2026-07-01 16:39:55.45707237 +0000 UTC m=+76.830470534" Jul 01 16:39:55.512455 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.512389 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9ft7l" podStartSLOduration=17.210968413 podStartE2EDuration="33.512352124s" totalImagesPullingTime="16.301383711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:39:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:55.480478977 +0000 UTC m=+76.853877175" watchObservedRunningTime="2026-07-01 16:39:55.512352124 +0000 UTC m=+76.885750310" Jul 01 16:39:55.541273 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.541187 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cb99ccc89-xhw97" podStartSLOduration=2.245620803 podStartE2EDuration="12.541165766s" totalImagesPullingTime="10.295544963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:55.513034262 +0000 UTC m=+76.886432449" watchObservedRunningTime="2026-07-01 16:39:55.541165766 +0000 UTC m=+76.914563954" Jul 01 16:39:55.541826 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:55.541797 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b6d6df69-xwblp" podStartSLOduration=2.244167179 podStartE2EDuration="12.541784963s" totalImagesPullingTime="10.297617784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:55.541070334 +0000 UTC m=+76.914468521" watchObservedRunningTime="2026-07-01 16:39:55.541784963 +0000 UTC m=+76.915183166" Jul 01 16:39:57.421769 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:57.421738 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8lfxr" event={"ID":"ac4efdc8-0c68-4c92-9811-a6cd246757b6","Type":"ContainerStarted","Data":"169aa520757f5499bd04336fdc033f19dab4204b4d318acc3d8b2cfa30044a8a"} Jul 01 16:39:57.422155 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:57.421785 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8lfxr" event={"ID":"ac4efdc8-0c68-4c92-9811-a6cd246757b6","Type":"ContainerStarted","Data":"884f64d3857f1fc22b5c56d370e950edc631d7f0a22870753cf65488859807f0"} Jul 01 16:39:57.451370 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:57.451310 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8lfxr" podStartSLOduration=41.404617895 podStartE2EDuration="43.451287745s" totalImagesPullingTime="2.04666985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:39:57.449060484 +0000 UTC m=+78.822458672" watchObservedRunningTime="2026-07-01 16:39:57.451287745 +0000 UTC m=+78.824685933" Jul 01 16:39:58.425723 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:39:58.425693 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8lfxr" Jul 01 16:40:00.271256 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.271136 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l6685"] Jul 01 16:40:00.276106 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.276085 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.286372 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.286344 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 16:40:00.286515 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.286397 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 16:40:00.286710 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.286694 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 16:40:00.287745 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.287722 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 16:40:00.287745 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.287722 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 16:40:00.287908 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.287713 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fpg24\"" Jul 01 16:40:00.288073 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.288058 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 16:40:00.388677 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.388635 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-sys\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.388869 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.388687 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.388869 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.388725 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4b6b\" (UniqueName: \"kubernetes.io/projected/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-kube-api-access-v4b6b\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.388869 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.388762 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-accelerators-collector-config\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.388869 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.388804 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-metrics-client-ca\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.388869 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.388839 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-textfile\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.389063 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.388916 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-tls\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.389063 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.388962 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-root\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.389063 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.389015 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-wtmp\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490142 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490099 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-textfile\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490142 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490155 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-tls\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490401 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490185 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-root\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490401 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490222 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-wtmp\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490401 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490262 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-sys\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490401 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490288 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490401 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490319 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4b6b\" (UniqueName: \"kubernetes.io/projected/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-kube-api-access-v4b6b\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490401 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490326 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-root\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490401 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490354 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-accelerators-collector-config\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490401 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490402 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-metrics-client-ca\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490818 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490416 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-wtmp\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490818 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490551 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-textfile\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490916 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490868 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-sys\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.490969 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490932 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-accelerators-collector-config\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.491023 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.490992 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-metrics-client-ca\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.492824 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.492802 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-tls\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.492998 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.492978 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.503069 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.503037 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4b6b\" (UniqueName: \"kubernetes.io/projected/2fdc4341-98c4-4fc5-8dc6-2b15d126891f-kube-api-access-v4b6b\") pod \"node-exporter-l6685\" (UID: \"2fdc4341-98c4-4fc5-8dc6-2b15d126891f\") " pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.585475 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:00.585371 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l6685" Jul 01 16:40:00.597456 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:40:00.597405 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fdc4341_98c4_4fc5_8dc6_2b15d126891f.slice/crio-001b65f2bb27766bf1b2956a9c38e6c4503a94e519d793584d73737eb4873656 WatchSource:0}: Error finding container 001b65f2bb27766bf1b2956a9c38e6c4503a94e519d793584d73737eb4873656: Status 404 returned error can't find the container with id 001b65f2bb27766bf1b2956a9c38e6c4503a94e519d793584d73737eb4873656 Jul 01 16:40:01.437704 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:01.437665 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6685" event={"ID":"2fdc4341-98c4-4fc5-8dc6-2b15d126891f","Type":"ContainerStarted","Data":"001b65f2bb27766bf1b2956a9c38e6c4503a94e519d793584d73737eb4873656"} Jul 01 16:40:02.442165 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:02.442131 2552 generic.go:356] "Generic (PLEG): container finished" podID="2fdc4341-98c4-4fc5-8dc6-2b15d126891f" containerID="f5525f8302aa4ee358581956b78b0f4e892c713d6a3f6696685a3f78bf92aba9" exitCode=0 Jul 01 16:40:02.442628 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:02.442214 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6685" event={"ID":"2fdc4341-98c4-4fc5-8dc6-2b15d126891f","Type":"ContainerDied","Data":"f5525f8302aa4ee358581956b78b0f4e892c713d6a3f6696685a3f78bf92aba9"} Jul 01 16:40:03.449140 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:03.449101 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6685" event={"ID":"2fdc4341-98c4-4fc5-8dc6-2b15d126891f","Type":"ContainerStarted","Data":"41b4f9c15efe47d35cc204af643fe3d06f9063656729b9403c82b546d2342c62"} Jul 01 16:40:03.449559 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:03.449157 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6685" event={"ID":"2fdc4341-98c4-4fc5-8dc6-2b15d126891f","Type":"ContainerStarted","Data":"3be2943bbef413e85c1faff233bde110047f1f4651d6ac19e231bf3f3788eaa8"} Jul 01 16:40:03.474279 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:03.474209 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l6685" podStartSLOduration=1.7115669690000002 podStartE2EDuration="3.474184983s" totalImagesPullingTime="1.688268315s" totalInitContainerRuntime="74.349699ms" isStatefulPod=true podCreationTimestamp="2026-07-01 16:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:40:03.474002189 +0000 UTC m=+84.847400376" watchObservedRunningTime="2026-07-01 16:40:03.474184983 +0000 UTC m=+84.847583173" Jul 01 16:40:03.850050 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:03.850013 2552 patch_prober.go:28] interesting pod/image-registry-78d54f8c9b-9m5v5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 16:40:03.850199 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:03.850066 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" podUID="3faaec88-52dc-458d-887f-4c4e3862e6f9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:40:08.431391 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:08.431352 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8lfxr" Jul 01 16:40:08.873629 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:08.873588 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" podUID="3faaec88-52dc-458d-887f-4c4e3862e6f9" containerName="registry" containerID="cri-o://783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b" gracePeriod=30 Jul 01 16:40:09.117214 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.117189 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:40:09.264615 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.264583 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3faaec88-52dc-458d-887f-4c4e3862e6f9-image-registry-private-configuration\") pod \"3faaec88-52dc-458d-887f-4c4e3862e6f9\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " Jul 01 16:40:09.264615 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.264630 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-certificates\") pod \"3faaec88-52dc-458d-887f-4c4e3862e6f9\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " Jul 01 16:40:09.264892 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.264659 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls\") pod \"3faaec88-52dc-458d-887f-4c4e3862e6f9\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " Jul 01 16:40:09.264892 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.264687 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3faaec88-52dc-458d-887f-4c4e3862e6f9-trusted-ca\") pod \"3faaec88-52dc-458d-887f-4c4e3862e6f9\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " Jul 01 16:40:09.264892 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.264710 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-bound-sa-token\") pod \"3faaec88-52dc-458d-887f-4c4e3862e6f9\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " Jul 01 16:40:09.264892 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.264731 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhf97\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-kube-api-access-mhf97\") pod \"3faaec88-52dc-458d-887f-4c4e3862e6f9\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " Jul 01 16:40:09.264892 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.264751 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3faaec88-52dc-458d-887f-4c4e3862e6f9-installation-pull-secrets\") pod \"3faaec88-52dc-458d-887f-4c4e3862e6f9\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " Jul 01 16:40:09.264892 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.264772 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3faaec88-52dc-458d-887f-4c4e3862e6f9-ca-trust-extracted\") pod \"3faaec88-52dc-458d-887f-4c4e3862e6f9\" (UID: \"3faaec88-52dc-458d-887f-4c4e3862e6f9\") " Jul 01 16:40:09.265169 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.265014 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3faaec88-52dc-458d-887f-4c4e3862e6f9" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:40:09.265223 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.265198 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3faaec88-52dc-458d-887f-4c4e3862e6f9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3faaec88-52dc-458d-887f-4c4e3862e6f9" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:40:09.267371 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.267337 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3faaec88-52dc-458d-887f-4c4e3862e6f9" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:40:09.267669 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.267633 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3faaec88-52dc-458d-887f-4c4e3862e6f9" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:40:09.267791 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.267635 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3faaec88-52dc-458d-887f-4c4e3862e6f9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3faaec88-52dc-458d-887f-4c4e3862e6f9" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:40:09.267791 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.267721 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-kube-api-access-mhf97" (OuterVolumeSpecName: "kube-api-access-mhf97") pod "3faaec88-52dc-458d-887f-4c4e3862e6f9" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9"). InnerVolumeSpecName "kube-api-access-mhf97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:40:09.267791 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.267741 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3faaec88-52dc-458d-887f-4c4e3862e6f9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3faaec88-52dc-458d-887f-4c4e3862e6f9" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:40:09.273929 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.273902 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3faaec88-52dc-458d-887f-4c4e3862e6f9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3faaec88-52dc-458d-887f-4c4e3862e6f9" (UID: "3faaec88-52dc-458d-887f-4c4e3862e6f9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:40:09.366170 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.366124 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-certificates\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:40:09.366170 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.366169 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-registry-tls\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:40:09.366170 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.366179 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3faaec88-52dc-458d-887f-4c4e3862e6f9-trusted-ca\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:40:09.366170 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.366187 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-bound-sa-token\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:40:09.366170 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.366195 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhf97\" (UniqueName: \"kubernetes.io/projected/3faaec88-52dc-458d-887f-4c4e3862e6f9-kube-api-access-mhf97\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:40:09.366459 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.366204 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3faaec88-52dc-458d-887f-4c4e3862e6f9-installation-pull-secrets\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:40:09.366459 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.366212 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3faaec88-52dc-458d-887f-4c4e3862e6f9-ca-trust-extracted\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:40:09.366459 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.366221 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3faaec88-52dc-458d-887f-4c4e3862e6f9-image-registry-private-configuration\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:40:09.474400 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.474362 2552 generic.go:356] "Generic (PLEG): container finished" podID="3faaec88-52dc-458d-887f-4c4e3862e6f9" containerID="783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b" exitCode=0 Jul 01 16:40:09.474805 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.474407 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" Jul 01 16:40:09.474805 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.474421 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" event={"ID":"3faaec88-52dc-458d-887f-4c4e3862e6f9","Type":"ContainerDied","Data":"783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b"} Jul 01 16:40:09.474805 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.474495 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d54f8c9b-9m5v5" event={"ID":"3faaec88-52dc-458d-887f-4c4e3862e6f9","Type":"ContainerDied","Data":"22767dc1890ca1e0568b0c0ac6164b2ff0e223306c19b3e7b5b76512516b1245"} Jul 01 16:40:09.474805 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.474519 2552 scope.go:117] "RemoveContainer" containerID="783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b" Jul 01 16:40:09.482963 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.482944 2552 scope.go:117] "RemoveContainer" containerID="783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b" Jul 01 16:40:09.483230 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:40:09.483210 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b\": container with ID starting with 783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b not found: ID does not exist" containerID="783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b" Jul 01 16:40:09.483300 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.483244 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b"} err="failed to get container status \"783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b\": rpc error: code = NotFound desc = could not find container \"783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b\": container with ID starting with 783143ff53899f8a20deaff62e0e15631eff458c019a733f74dd91c682e9b14b not found: ID does not exist" Jul 01 16:40:09.497395 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.497368 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78d54f8c9b-9m5v5"] Jul 01 16:40:09.503657 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:09.503631 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78d54f8c9b-9m5v5"] Jul 01 16:40:11.003240 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:11.003205 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3faaec88-52dc-458d-887f-4c4e3862e6f9" path="/var/lib/kubelet/pods/3faaec88-52dc-458d-887f-4c4e3862e6f9/volumes" Jul 01 16:40:26.419345 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:40:26.419309 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p8bwh" Jul 01 16:43:38.942712 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:43:38.942674 2552 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 16:44:33.298687 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.298599 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4"] Jul 01 16:44:33.299128 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.298850 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3faaec88-52dc-458d-887f-4c4e3862e6f9" containerName="registry" Jul 01 16:44:33.299128 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.298863 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3faaec88-52dc-458d-887f-4c4e3862e6f9" containerName="registry" Jul 01 16:44:33.299128 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.298912 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3faaec88-52dc-458d-887f-4c4e3862e6f9" containerName="registry" Jul 01 16:44:33.301724 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.301706 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4" Jul 01 16:44:33.304418 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.304394 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vwpks\"" Jul 01 16:44:33.304585 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.304394 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 16:44:33.304585 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.304396 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 16:44:33.310822 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.310794 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4"] Jul 01 16:44:33.393927 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.393883 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09dbc469-09a1-49eb-9efe-7dba4f68f789-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-vmbb4\" (UID: \"09dbc469-09a1-49eb-9efe-7dba4f68f789\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4" Jul 01 16:44:33.393927 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.393921 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4plfp\" (UniqueName: \"kubernetes.io/projected/09dbc469-09a1-49eb-9efe-7dba4f68f789-kube-api-access-4plfp\") pod \"cert-manager-cainjector-5d99449ffd-vmbb4\" (UID: \"09dbc469-09a1-49eb-9efe-7dba4f68f789\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4" Jul 01 16:44:33.494742 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.494706 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09dbc469-09a1-49eb-9efe-7dba4f68f789-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-vmbb4\" (UID: \"09dbc469-09a1-49eb-9efe-7dba4f68f789\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4" Jul 01 16:44:33.494870 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.494746 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4plfp\" (UniqueName: \"kubernetes.io/projected/09dbc469-09a1-49eb-9efe-7dba4f68f789-kube-api-access-4plfp\") pod \"cert-manager-cainjector-5d99449ffd-vmbb4\" (UID: \"09dbc469-09a1-49eb-9efe-7dba4f68f789\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4" Jul 01 16:44:33.504945 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.504911 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4plfp\" (UniqueName: \"kubernetes.io/projected/09dbc469-09a1-49eb-9efe-7dba4f68f789-kube-api-access-4plfp\") pod \"cert-manager-cainjector-5d99449ffd-vmbb4\" (UID: \"09dbc469-09a1-49eb-9efe-7dba4f68f789\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4" Jul 01 16:44:33.505076 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.504914 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09dbc469-09a1-49eb-9efe-7dba4f68f789-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-vmbb4\" (UID: \"09dbc469-09a1-49eb-9efe-7dba4f68f789\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4" Jul 01 16:44:33.610992 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.610898 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4" Jul 01 16:44:33.742756 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.742711 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4"] Jul 01 16:44:33.745570 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:44:33.745536 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09dbc469_09a1_49eb_9efe_7dba4f68f789.slice/crio-51a4d26ae2d51f6dba7112771e8488323c26f0bc649ed901a382c2512d588a16 WatchSource:0}: Error finding container 51a4d26ae2d51f6dba7112771e8488323c26f0bc649ed901a382c2512d588a16: Status 404 returned error can't find the container with id 51a4d26ae2d51f6dba7112771e8488323c26f0bc649ed901a382c2512d588a16 Jul 01 16:44:33.747525 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:33.747505 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:44:34.321925 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:34.321879 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4" event={"ID":"09dbc469-09a1-49eb-9efe-7dba4f68f789","Type":"ContainerStarted","Data":"51a4d26ae2d51f6dba7112771e8488323c26f0bc649ed901a382c2512d588a16"} Jul 01 16:44:37.336231 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:37.336189 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4" event={"ID":"09dbc469-09a1-49eb-9efe-7dba4f68f789","Type":"ContainerStarted","Data":"88fef54f00f5c8c196d2eabbc3804613b7a671e679af9a553e1d352d8de1c099"} Jul 01 16:44:37.357979 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:44:37.357903 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-vmbb4" podStartSLOduration=1.518862392 podStartE2EDuration="4.357887455s" totalImagesPullingTime="2.839025063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:44:37.356550739 +0000 UTC m=+358.729948928" watchObservedRunningTime="2026-07-01 16:44:37.357887455 +0000 UTC m=+358.731285641" Jul 01 16:45:04.477856 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.477382 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d"] Jul 01 16:45:04.480729 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.480711 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.484435 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.484375 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 16:45:04.484671 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.484398 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kwhtb\"" Jul 01 16:45:04.484804 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.484683 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 16:45:04.484804 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.484397 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 16:45:04.484804 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.484771 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 16:45:04.495850 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.495820 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d"] Jul 01 16:45:04.513839 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.513800 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcjkv\" (UniqueName: \"kubernetes.io/projected/eb90a035-24fb-490e-9aed-51b03a2ebab8-kube-api-access-dcjkv\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.514017 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.513846 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb90a035-24fb-490e-9aed-51b03a2ebab8-webhook-cert\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.514017 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.513869 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb90a035-24fb-490e-9aed-51b03a2ebab8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.514017 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.513941 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb90a035-24fb-490e-9aed-51b03a2ebab8-manifests\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.514141 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.514026 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb90a035-24fb-490e-9aed-51b03a2ebab8-tmp\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.615136 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.615101 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb90a035-24fb-490e-9aed-51b03a2ebab8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.615330 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.615142 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb90a035-24fb-490e-9aed-51b03a2ebab8-manifests\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.615330 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.615179 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb90a035-24fb-490e-9aed-51b03a2ebab8-tmp\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.615330 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.615209 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcjkv\" (UniqueName: \"kubernetes.io/projected/eb90a035-24fb-490e-9aed-51b03a2ebab8-kube-api-access-dcjkv\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.615330 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.615236 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb90a035-24fb-490e-9aed-51b03a2ebab8-webhook-cert\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.615725 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.615693 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb90a035-24fb-490e-9aed-51b03a2ebab8-manifests\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.617756 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.617727 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb90a035-24fb-490e-9aed-51b03a2ebab8-tmp\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.617865 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.617849 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb90a035-24fb-490e-9aed-51b03a2ebab8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.617962 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.617942 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb90a035-24fb-490e-9aed-51b03a2ebab8-webhook-cert\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.627203 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.627167 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcjkv\" (UniqueName: \"kubernetes.io/projected/eb90a035-24fb-490e-9aed-51b03a2ebab8-kube-api-access-dcjkv\") pod \"opendatahub-operator-controller-manager-579557fd58-jbt2d\" (UID: \"eb90a035-24fb-490e-9aed-51b03a2ebab8\") " pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.791352 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.791258 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:04.939193 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:04.939163 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d"] Jul 01 16:45:04.941827 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:45:04.941789 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb90a035_24fb_490e_9aed_51b03a2ebab8.slice/crio-b2f65cd418c4b279c8bd6097d572363affecd49b7594f8c01f1ad382d59e348b WatchSource:0}: Error finding container b2f65cd418c4b279c8bd6097d572363affecd49b7594f8c01f1ad382d59e348b: Status 404 returned error can't find the container with id b2f65cd418c4b279c8bd6097d572363affecd49b7594f8c01f1ad382d59e348b Jul 01 16:45:05.428585 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:05.428544 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" event={"ID":"eb90a035-24fb-490e-9aed-51b03a2ebab8","Type":"ContainerStarted","Data":"b2f65cd418c4b279c8bd6097d572363affecd49b7594f8c01f1ad382d59e348b"} Jul 01 16:45:09.447597 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:09.447563 2552 generic.go:356] "Generic (PLEG): container finished" podID="eb90a035-24fb-490e-9aed-51b03a2ebab8" containerID="6d8174aefc8f0eba0c436c14a882125a4b434aa07028dbdbcca9c0a910151140" exitCode=0 Jul 01 16:45:09.448054 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:09.447622 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" event={"ID":"eb90a035-24fb-490e-9aed-51b03a2ebab8","Type":"ContainerDied","Data":"6d8174aefc8f0eba0c436c14a882125a4b434aa07028dbdbcca9c0a910151140"} Jul 01 16:45:10.452991 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:10.452952 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" event={"ID":"eb90a035-24fb-490e-9aed-51b03a2ebab8","Type":"ContainerStarted","Data":"03291b43e94749c5f4d0038ce222b57af8793caa2ed1a7378359955fc1e2530d"} Jul 01 16:45:10.453461 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:10.453076 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:10.492667 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:10.492606 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" podStartSLOduration=1.655587766 podStartE2EDuration="6.492587857s" totalImagesPullingTime="3.888816979s" totalInitContainerRuntime="948.183112ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:45:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:45:10.49083325 +0000 UTC m=+391.864231439" watchObservedRunningTime="2026-07-01 16:45:10.492587857 +0000 UTC m=+391.865986043" Jul 01 16:45:21.458772 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:21.458739 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-579557fd58-jbt2d" Jul 01 16:45:24.808918 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.808871 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6"] Jul 01 16:45:24.817885 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.817854 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-dfztg"] Jul 01 16:45:24.818079 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.818000 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" Jul 01 16:45:24.820718 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.820688 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 16:45:24.820876 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.820838 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 16:45:24.820946 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.820793 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6vf8g\"" Jul 01 16:45:24.821619 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.821598 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" Jul 01 16:45:24.821891 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.821863 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 16:45:24.821999 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.821871 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 16:45:24.824206 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.824178 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-n4nrg\"" Jul 01 16:45:24.824586 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.824558 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 01 16:45:24.837069 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.837039 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-dfztg"] Jul 01 16:45:24.838723 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.838688 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6"] Jul 01 16:45:24.871851 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.871812 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69c5995f-976a-4f6f-812b-52dadd8c54b3-tmp\") pod \"kube-auth-proxy-64c6c96ddc-4psd6\" (UID: \"69c5995f-976a-4f6f-812b-52dadd8c54b3\") " pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" Jul 01 16:45:24.872014 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.871861 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d5fb676-e97b-45e6-a228-578180012c2a-cert\") pod \"odh-model-controller-6dc94f689f-dfztg\" (UID: \"8d5fb676-e97b-45e6-a228-578180012c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" Jul 01 16:45:24.872014 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.871957 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qww65\" (UniqueName: \"kubernetes.io/projected/69c5995f-976a-4f6f-812b-52dadd8c54b3-kube-api-access-qww65\") pod \"kube-auth-proxy-64c6c96ddc-4psd6\" (UID: \"69c5995f-976a-4f6f-812b-52dadd8c54b3\") " pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" Jul 01 16:45:24.872014 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.871995 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69c5995f-976a-4f6f-812b-52dadd8c54b3-tls-certs\") pod \"kube-auth-proxy-64c6c96ddc-4psd6\" (UID: \"69c5995f-976a-4f6f-812b-52dadd8c54b3\") " pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" Jul 01 16:45:24.872130 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.872029 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r58fq\" (UniqueName: \"kubernetes.io/projected/8d5fb676-e97b-45e6-a228-578180012c2a-kube-api-access-r58fq\") pod \"odh-model-controller-6dc94f689f-dfztg\" (UID: \"8d5fb676-e97b-45e6-a228-578180012c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" Jul 01 16:45:24.973048 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.973005 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69c5995f-976a-4f6f-812b-52dadd8c54b3-tmp\") pod \"kube-auth-proxy-64c6c96ddc-4psd6\" (UID: \"69c5995f-976a-4f6f-812b-52dadd8c54b3\") " pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" Jul 01 16:45:24.973048 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.973049 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d5fb676-e97b-45e6-a228-578180012c2a-cert\") pod \"odh-model-controller-6dc94f689f-dfztg\" (UID: \"8d5fb676-e97b-45e6-a228-578180012c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" Jul 01 16:45:24.973316 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:45:24.973148 2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 01 16:45:24.973316 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.973186 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qww65\" (UniqueName: \"kubernetes.io/projected/69c5995f-976a-4f6f-812b-52dadd8c54b3-kube-api-access-qww65\") pod \"kube-auth-proxy-64c6c96ddc-4psd6\" (UID: \"69c5995f-976a-4f6f-812b-52dadd8c54b3\") " pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" Jul 01 16:45:24.973316 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:45:24.973198 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5fb676-e97b-45e6-a228-578180012c2a-cert podName:8d5fb676-e97b-45e6-a228-578180012c2a nodeName:}" failed. No retries permitted until 2026-07-01 16:45:25.473182671 +0000 UTC m=+406.846580838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8d5fb676-e97b-45e6-a228-578180012c2a-cert") pod "odh-model-controller-6dc94f689f-dfztg" (UID: "8d5fb676-e97b-45e6-a228-578180012c2a") : secret "odh-model-controller-webhook-cert" not found Jul 01 16:45:24.973316 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.973252 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69c5995f-976a-4f6f-812b-52dadd8c54b3-tls-certs\") pod \"kube-auth-proxy-64c6c96ddc-4psd6\" (UID: \"69c5995f-976a-4f6f-812b-52dadd8c54b3\") " pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" Jul 01 16:45:24.973316 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.973293 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58fq\" (UniqueName: \"kubernetes.io/projected/8d5fb676-e97b-45e6-a228-578180012c2a-kube-api-access-r58fq\") pod \"odh-model-controller-6dc94f689f-dfztg\" (UID: \"8d5fb676-e97b-45e6-a228-578180012c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" Jul 01 16:45:24.975565 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.975543 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69c5995f-976a-4f6f-812b-52dadd8c54b3-tmp\") pod \"kube-auth-proxy-64c6c96ddc-4psd6\" (UID: \"69c5995f-976a-4f6f-812b-52dadd8c54b3\") " pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" Jul 01 16:45:24.975855 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.975838 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69c5995f-976a-4f6f-812b-52dadd8c54b3-tls-certs\") pod \"kube-auth-proxy-64c6c96ddc-4psd6\" (UID: \"69c5995f-976a-4f6f-812b-52dadd8c54b3\") " pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" Jul 01 16:45:24.986648 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.986621 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r58fq\" (UniqueName: \"kubernetes.io/projected/8d5fb676-e97b-45e6-a228-578180012c2a-kube-api-access-r58fq\") pod \"odh-model-controller-6dc94f689f-dfztg\" (UID: \"8d5fb676-e97b-45e6-a228-578180012c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" Jul 01 16:45:24.986775 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:24.986717 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qww65\" (UniqueName: \"kubernetes.io/projected/69c5995f-976a-4f6f-812b-52dadd8c54b3-kube-api-access-qww65\") pod \"kube-auth-proxy-64c6c96ddc-4psd6\" (UID: \"69c5995f-976a-4f6f-812b-52dadd8c54b3\") " pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" Jul 01 16:45:25.131226 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.131124 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" Jul 01 16:45:25.296553 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.296434 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6"] Jul 01 16:45:25.301955 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:45:25.301924 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c5995f_976a_4f6f_812b_52dadd8c54b3.slice/crio-28178ebaf8dfdbfc8d38a6126522841c37d641cc604a534f180040606795fc56 WatchSource:0}: Error finding container 28178ebaf8dfdbfc8d38a6126522841c37d641cc604a534f180040606795fc56: Status 404 returned error can't find the container with id 28178ebaf8dfdbfc8d38a6126522841c37d641cc604a534f180040606795fc56 Jul 01 16:45:25.477808 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.477778 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d5fb676-e97b-45e6-a228-578180012c2a-cert\") pod \"odh-model-controller-6dc94f689f-dfztg\" (UID: \"8d5fb676-e97b-45e6-a228-578180012c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" Jul 01 16:45:25.480408 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.480374 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d5fb676-e97b-45e6-a228-578180012c2a-cert\") pod \"odh-model-controller-6dc94f689f-dfztg\" (UID: \"8d5fb676-e97b-45e6-a228-578180012c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" Jul 01 16:45:25.505365 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.505328 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" event={"ID":"69c5995f-976a-4f6f-812b-52dadd8c54b3","Type":"ContainerStarted","Data":"28178ebaf8dfdbfc8d38a6126522841c37d641cc604a534f180040606795fc56"} Jul 01 16:45:25.740260 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.740152 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" Jul 01 16:45:25.805429 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.805391 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-w9lt2"] Jul 01 16:45:25.811847 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.811815 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" Jul 01 16:45:25.815187 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.815038 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 01 16:45:25.815187 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.815052 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-qwnbm\"" Jul 01 16:45:25.827721 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.826647 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-w9lt2"] Jul 01 16:45:25.881622 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.881589 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jjnl\" (UniqueName: \"kubernetes.io/projected/d4096a77-bcc8-4224-a181-97edaced1e9c-kube-api-access-8jjnl\") pod \"model-serving-api-5dd488fc48-w9lt2\" (UID: \"d4096a77-bcc8-4224-a181-97edaced1e9c\") " pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" Jul 01 16:45:25.881813 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.881647 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4096a77-bcc8-4224-a181-97edaced1e9c-tls-certs\") pod \"model-serving-api-5dd488fc48-w9lt2\" (UID: \"d4096a77-bcc8-4224-a181-97edaced1e9c\") " pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" Jul 01 16:45:25.903399 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.903367 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-dfztg"] Jul 01 16:45:25.906823 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:45:25.906792 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5fb676_e97b_45e6_a228_578180012c2a.slice/crio-49db5f8d3df65b0734fda0bb2f9b6bd8bc619d01faddc9716b6c4100e8aa3b45 WatchSource:0}: Error finding container 49db5f8d3df65b0734fda0bb2f9b6bd8bc619d01faddc9716b6c4100e8aa3b45: Status 404 returned error can't find the container with id 49db5f8d3df65b0734fda0bb2f9b6bd8bc619d01faddc9716b6c4100e8aa3b45 Jul 01 16:45:25.982205 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.982168 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jjnl\" (UniqueName: \"kubernetes.io/projected/d4096a77-bcc8-4224-a181-97edaced1e9c-kube-api-access-8jjnl\") pod \"model-serving-api-5dd488fc48-w9lt2\" (UID: \"d4096a77-bcc8-4224-a181-97edaced1e9c\") " pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" Jul 01 16:45:25.982396 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.982215 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4096a77-bcc8-4224-a181-97edaced1e9c-tls-certs\") pod \"model-serving-api-5dd488fc48-w9lt2\" (UID: \"d4096a77-bcc8-4224-a181-97edaced1e9c\") " pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" Jul 01 16:45:25.982396 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:45:25.982341 2552 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 01 16:45:25.982529 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:45:25.982408 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4096a77-bcc8-4224-a181-97edaced1e9c-tls-certs podName:d4096a77-bcc8-4224-a181-97edaced1e9c nodeName:}" failed. No retries permitted until 2026-07-01 16:45:26.482384265 +0000 UTC m=+407.855782447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d4096a77-bcc8-4224-a181-97edaced1e9c-tls-certs") pod "model-serving-api-5dd488fc48-w9lt2" (UID: "d4096a77-bcc8-4224-a181-97edaced1e9c") : secret "model-serving-api-tls" not found Jul 01 16:45:25.994364 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.994230 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jjnl\" (UniqueName: \"kubernetes.io/projected/d4096a77-bcc8-4224-a181-97edaced1e9c-kube-api-access-8jjnl\") pod \"model-serving-api-5dd488fc48-w9lt2\" (UID: \"d4096a77-bcc8-4224-a181-97edaced1e9c\") " pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" Jul 01 16:45:25.996840 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:25.996800 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2"] Jul 01 16:45:26.000813 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.000789 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.003816 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.003793 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 16:45:26.003945 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.003793 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 16:45:26.004190 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.004171 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 16:45:26.004454 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.004422 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 16:45:26.009207 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.009186 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7knrp\"" Jul 01 16:45:26.015494 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.015476 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2"] Jul 01 16:45:26.082958 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.082920 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rggg\" (UniqueName: \"kubernetes.io/projected/bba9dae2-2a05-44a2-8770-d07876f229e6-kube-api-access-7rggg\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.083156 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.082979 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-token\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.083156 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.083031 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-cacerts\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.083261 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.083169 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba9dae2-2a05-44a2-8770-d07876f229e6-local-certs\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.083261 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.083202 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.083261 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.083237 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.083405 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.083260 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.183995 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.183959 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba9dae2-2a05-44a2-8770-d07876f229e6-local-certs\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.184198 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.184006 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.184198 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.184043 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.184198 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.184066 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.184198 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.184104 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rggg\" (UniqueName: \"kubernetes.io/projected/bba9dae2-2a05-44a2-8770-d07876f229e6-kube-api-access-7rggg\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.184198 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.184137 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-token\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.184482 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.184217 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-cacerts\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.185255 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.185224 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.187694 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.187641 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba9dae2-2a05-44a2-8770-d07876f229e6-local-certs\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.187913 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.187863 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.188733 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.188708 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-cacerts\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.189865 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.189841 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.194795 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.194738 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rggg\" (UniqueName: \"kubernetes.io/projected/bba9dae2-2a05-44a2-8770-d07876f229e6-kube-api-access-7rggg\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.195594 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.195568 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-token\") pod \"istiod-openshift-gateway-7574459656-zjhh2\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.311174 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.311083 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:26.469461 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.469408 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2"] Jul 01 16:45:26.473717 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:45:26.473688 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba9dae2_2a05_44a2_8770_d07876f229e6.slice/crio-013db75733d4c4ac4dc77415d36c32a3e4550d5370d8a23bc7516b61c64ee9c5 WatchSource:0}: Error finding container 013db75733d4c4ac4dc77415d36c32a3e4550d5370d8a23bc7516b61c64ee9c5: Status 404 returned error can't find the container with id 013db75733d4c4ac4dc77415d36c32a3e4550d5370d8a23bc7516b61c64ee9c5 Jul 01 16:45:26.486673 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.486642 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4096a77-bcc8-4224-a181-97edaced1e9c-tls-certs\") pod \"model-serving-api-5dd488fc48-w9lt2\" (UID: \"d4096a77-bcc8-4224-a181-97edaced1e9c\") " pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" Jul 01 16:45:26.489896 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.489861 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4096a77-bcc8-4224-a181-97edaced1e9c-tls-certs\") pod \"model-serving-api-5dd488fc48-w9lt2\" (UID: \"d4096a77-bcc8-4224-a181-97edaced1e9c\") " pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" Jul 01 16:45:26.516950 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.516907 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" event={"ID":"bba9dae2-2a05-44a2-8770-d07876f229e6","Type":"ContainerStarted","Data":"013db75733d4c4ac4dc77415d36c32a3e4550d5370d8a23bc7516b61c64ee9c5"} Jul 01 16:45:26.518817 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.518770 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" event={"ID":"8d5fb676-e97b-45e6-a228-578180012c2a","Type":"ContainerStarted","Data":"49db5f8d3df65b0734fda0bb2f9b6bd8bc619d01faddc9716b6c4100e8aa3b45"} Jul 01 16:45:26.728849 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.728529 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" Jul 01 16:45:26.903505 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:26.903473 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-w9lt2"] Jul 01 16:45:27.531464 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:27.531213 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" event={"ID":"d4096a77-bcc8-4224-a181-97edaced1e9c","Type":"ContainerStarted","Data":"a6c7f4de46d182befdaba0d6911873a754ddaa043cfd85dfd07fd989ba5ef367"} Jul 01 16:45:32.484250 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:32.484206 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 16:45:32.484605 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:32.484280 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 16:45:33.558610 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.558571 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" event={"ID":"69c5995f-976a-4f6f-812b-52dadd8c54b3","Type":"ContainerStarted","Data":"cba38bebf91ded843e88ba89fbc8fd72249f9beb50e06900b31c2f6b18c9dc98"} Jul 01 16:45:33.560558 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.560483 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" event={"ID":"bba9dae2-2a05-44a2-8770-d07876f229e6","Type":"ContainerStarted","Data":"f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472"} Jul 01 16:45:33.560819 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.560629 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:33.562700 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.562391 2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-zjhh2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 01 16:45:33.562700 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.562471 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" podUID="bba9dae2-2a05-44a2-8770-d07876f229e6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:45:33.563064 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.563038 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" event={"ID":"8d5fb676-e97b-45e6-a228-578180012c2a","Type":"ContainerStarted","Data":"7e892d07831c2bb5f6c9d8e832481b953b6b54186cca08292b2e636eec797699"} Jul 01 16:45:33.563339 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.563293 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" Jul 01 16:45:33.565629 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.565274 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" event={"ID":"d4096a77-bcc8-4224-a181-97edaced1e9c","Type":"ContainerStarted","Data":"9becc2bee9adb18f30c0c5f350b91cc445bbc372877bd3a931ee96663af6d0a3"} Jul 01 16:45:33.565629 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.565436 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" Jul 01 16:45:33.604388 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.604298 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-64c6c96ddc-4psd6" podStartSLOduration=2.493357515 podStartE2EDuration="9.604275782s" totalImagesPullingTime="7.110918267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:45:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:45:33.603351751 +0000 UTC m=+414.976749938" watchObservedRunningTime="2026-07-01 16:45:33.604275782 +0000 UTC m=+414.977673969" Jul 01 16:45:33.645504 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.645430 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" podStartSLOduration=3.079643707 podStartE2EDuration="9.645411938s" totalImagesPullingTime="6.565768231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:45:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:45:33.644513666 +0000 UTC m=+415.017911870" watchObservedRunningTime="2026-07-01 16:45:33.645411938 +0000 UTC m=+415.018810124" Jul 01 16:45:33.673971 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.673915 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" podStartSLOduration=2.666608846 podStartE2EDuration="8.67389475s" totalImagesPullingTime="6.007285904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:45:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:45:33.672999835 +0000 UTC m=+415.046398059" watchObservedRunningTime="2026-07-01 16:45:33.67389475 +0000 UTC m=+415.047292931" Jul 01 16:45:33.693906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:33.693855 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" podStartSLOduration=3.122693225 podStartE2EDuration="8.693836159s" totalImagesPullingTime="5.571142934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:45:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:45:33.693282339 +0000 UTC m=+415.066680525" watchObservedRunningTime="2026-07-01 16:45:33.693836159 +0000 UTC m=+415.067234345" Jul 01 16:45:34.570012 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:34.569984 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:37.125157 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.125119 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-hjdhk"] Jul 01 16:45:37.128125 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.128107 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" Jul 01 16:45:37.131782 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.131748 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pwnsl\"" Jul 01 16:45:37.133172 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.133138 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 01 16:45:37.134678 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.134657 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb"] Jul 01 16:45:37.138104 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.138082 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" Jul 01 16:45:37.145898 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.145872 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zbskr\"" Jul 01 16:45:37.152387 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.152359 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 01 16:45:37.154321 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.154298 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-hjdhk"] Jul 01 16:45:37.159174 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.159146 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb"] Jul 01 16:45:37.291847 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.291807 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zv2j\" (UniqueName: \"kubernetes.io/projected/fccc6fb3-9689-487d-8ba3-36246ad3086d-kube-api-access-2zv2j\") pod \"kserve-controller-manager-69fc866d76-hjdhk\" (UID: \"fccc6fb3-9689-487d-8ba3-36246ad3086d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" Jul 01 16:45:37.291847 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.291860 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21e7b05b-e4c2-4064-9cf7-ca030fe40ad7-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-z74vb\" (UID: \"21e7b05b-e4c2-4064-9cf7-ca030fe40ad7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" Jul 01 16:45:37.292063 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.291881 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7l5t\" (UniqueName: \"kubernetes.io/projected/21e7b05b-e4c2-4064-9cf7-ca030fe40ad7-kube-api-access-w7l5t\") pod \"llmisvc-controller-manager-864bfd7bc9-z74vb\" (UID: \"21e7b05b-e4c2-4064-9cf7-ca030fe40ad7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" Jul 01 16:45:37.292063 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.291939 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fccc6fb3-9689-487d-8ba3-36246ad3086d-cert\") pod \"kserve-controller-manager-69fc866d76-hjdhk\" (UID: \"fccc6fb3-9689-487d-8ba3-36246ad3086d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" Jul 01 16:45:37.393493 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.393375 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fccc6fb3-9689-487d-8ba3-36246ad3086d-cert\") pod \"kserve-controller-manager-69fc866d76-hjdhk\" (UID: \"fccc6fb3-9689-487d-8ba3-36246ad3086d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" Jul 01 16:45:37.393669 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.393492 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zv2j\" (UniqueName: \"kubernetes.io/projected/fccc6fb3-9689-487d-8ba3-36246ad3086d-kube-api-access-2zv2j\") pod \"kserve-controller-manager-69fc866d76-hjdhk\" (UID: \"fccc6fb3-9689-487d-8ba3-36246ad3086d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" Jul 01 16:45:37.393669 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.393532 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21e7b05b-e4c2-4064-9cf7-ca030fe40ad7-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-z74vb\" (UID: \"21e7b05b-e4c2-4064-9cf7-ca030fe40ad7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" Jul 01 16:45:37.393669 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.393556 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7l5t\" (UniqueName: \"kubernetes.io/projected/21e7b05b-e4c2-4064-9cf7-ca030fe40ad7-kube-api-access-w7l5t\") pod \"llmisvc-controller-manager-864bfd7bc9-z74vb\" (UID: \"21e7b05b-e4c2-4064-9cf7-ca030fe40ad7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" Jul 01 16:45:37.393669 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:45:37.393644 2552 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 01 16:45:37.393926 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:45:37.393730 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21e7b05b-e4c2-4064-9cf7-ca030fe40ad7-cert podName:21e7b05b-e4c2-4064-9cf7-ca030fe40ad7 nodeName:}" failed. No retries permitted until 2026-07-01 16:45:37.893710513 +0000 UTC m=+419.267108684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/21e7b05b-e4c2-4064-9cf7-ca030fe40ad7-cert") pod "llmisvc-controller-manager-864bfd7bc9-z74vb" (UID: "21e7b05b-e4c2-4064-9cf7-ca030fe40ad7") : secret "llmisvc-webhook-server-cert" not found Jul 01 16:45:37.396272 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.396246 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fccc6fb3-9689-487d-8ba3-36246ad3086d-cert\") pod \"kserve-controller-manager-69fc866d76-hjdhk\" (UID: \"fccc6fb3-9689-487d-8ba3-36246ad3086d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" Jul 01 16:45:37.417425 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.417393 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zv2j\" (UniqueName: \"kubernetes.io/projected/fccc6fb3-9689-487d-8ba3-36246ad3086d-kube-api-access-2zv2j\") pod \"kserve-controller-manager-69fc866d76-hjdhk\" (UID: \"fccc6fb3-9689-487d-8ba3-36246ad3086d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" Jul 01 16:45:37.418729 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.418700 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7l5t\" (UniqueName: \"kubernetes.io/projected/21e7b05b-e4c2-4064-9cf7-ca030fe40ad7-kube-api-access-w7l5t\") pod \"llmisvc-controller-manager-864bfd7bc9-z74vb\" (UID: \"21e7b05b-e4c2-4064-9cf7-ca030fe40ad7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" Jul 01 16:45:37.439254 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.439214 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" Jul 01 16:45:37.591396 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.591364 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-hjdhk"] Jul 01 16:45:37.594198 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:45:37.594161 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccc6fb3_9689_487d_8ba3_36246ad3086d.slice/crio-3130469cdfd13ffcfe639a7b24bd301d9ac4852e6bf58dc5f0886e1f266f39a6 WatchSource:0}: Error finding container 3130469cdfd13ffcfe639a7b24bd301d9ac4852e6bf58dc5f0886e1f266f39a6: Status 404 returned error can't find the container with id 3130469cdfd13ffcfe639a7b24bd301d9ac4852e6bf58dc5f0886e1f266f39a6 Jul 01 16:45:37.898908 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.898866 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21e7b05b-e4c2-4064-9cf7-ca030fe40ad7-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-z74vb\" (UID: \"21e7b05b-e4c2-4064-9cf7-ca030fe40ad7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" Jul 01 16:45:37.901511 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:37.901479 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21e7b05b-e4c2-4064-9cf7-ca030fe40ad7-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-z74vb\" (UID: \"21e7b05b-e4c2-4064-9cf7-ca030fe40ad7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" Jul 01 16:45:38.049210 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.049170 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" Jul 01 16:45:38.215033 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.215008 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb"] Jul 01 16:45:38.216552 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:45:38.216524 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod21e7b05b_e4c2_4064_9cf7_ca030fe40ad7.slice/crio-06df7191d30616281e9d3b28de723d5dbf9ac9d07d852a6e55a022c4090b7811 WatchSource:0}: Error finding container 06df7191d30616281e9d3b28de723d5dbf9ac9d07d852a6e55a022c4090b7811: Status 404 returned error can't find the container with id 06df7191d30616281e9d3b28de723d5dbf9ac9d07d852a6e55a022c4090b7811 Jul 01 16:45:38.501085 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.501049 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2"] Jul 01 16:45:38.501282 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.501227 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" podUID="bba9dae2-2a05-44a2-8770-d07876f229e6" containerName="discovery" containerID="cri-o://f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472" gracePeriod=30 Jul 01 16:45:38.588402 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.588355 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" event={"ID":"21e7b05b-e4c2-4064-9cf7-ca030fe40ad7","Type":"ContainerStarted","Data":"06df7191d30616281e9d3b28de723d5dbf9ac9d07d852a6e55a022c4090b7811"} Jul 01 16:45:38.589898 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.589863 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" event={"ID":"fccc6fb3-9689-487d-8ba3-36246ad3086d","Type":"ContainerStarted","Data":"3130469cdfd13ffcfe639a7b24bd301d9ac4852e6bf58dc5f0886e1f266f39a6"} Jul 01 16:45:38.754806 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.754749 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:38.907643 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.907611 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rggg\" (UniqueName: \"kubernetes.io/projected/bba9dae2-2a05-44a2-8770-d07876f229e6-kube-api-access-7rggg\") pod \"bba9dae2-2a05-44a2-8770-d07876f229e6\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " Jul 01 16:45:38.907818 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.907658 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-kubeconfig\") pod \"bba9dae2-2a05-44a2-8770-d07876f229e6\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " Jul 01 16:45:38.907818 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.907692 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-csr-ca-configmap\") pod \"bba9dae2-2a05-44a2-8770-d07876f229e6\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " Jul 01 16:45:38.907818 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.907731 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-csr-dns-cert\") pod \"bba9dae2-2a05-44a2-8770-d07876f229e6\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " Jul 01 16:45:38.907818 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.907763 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba9dae2-2a05-44a2-8770-d07876f229e6-local-certs\") pod \"bba9dae2-2a05-44a2-8770-d07876f229e6\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " Jul 01 16:45:38.907818 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.907784 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-token\") pod \"bba9dae2-2a05-44a2-8770-d07876f229e6\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " Jul 01 16:45:38.907818 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.907811 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-cacerts\") pod \"bba9dae2-2a05-44a2-8770-d07876f229e6\" (UID: \"bba9dae2-2a05-44a2-8770-d07876f229e6\") " Jul 01 16:45:38.908210 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.908168 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "bba9dae2-2a05-44a2-8770-d07876f229e6" (UID: "bba9dae2-2a05-44a2-8770-d07876f229e6"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:45:38.910780 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.910745 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "bba9dae2-2a05-44a2-8770-d07876f229e6" (UID: "bba9dae2-2a05-44a2-8770-d07876f229e6"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:45:38.910896 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.910755 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-cacerts" (OuterVolumeSpecName: "cacerts") pod "bba9dae2-2a05-44a2-8770-d07876f229e6" (UID: "bba9dae2-2a05-44a2-8770-d07876f229e6"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:45:38.910896 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.910849 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "bba9dae2-2a05-44a2-8770-d07876f229e6" (UID: "bba9dae2-2a05-44a2-8770-d07876f229e6"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:45:38.910896 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.910852 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba9dae2-2a05-44a2-8770-d07876f229e6-kube-api-access-7rggg" (OuterVolumeSpecName: "kube-api-access-7rggg") pod "bba9dae2-2a05-44a2-8770-d07876f229e6" (UID: "bba9dae2-2a05-44a2-8770-d07876f229e6"). InnerVolumeSpecName "kube-api-access-7rggg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:45:38.910896 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.910858 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba9dae2-2a05-44a2-8770-d07876f229e6-local-certs" (OuterVolumeSpecName: "local-certs") pod "bba9dae2-2a05-44a2-8770-d07876f229e6" (UID: "bba9dae2-2a05-44a2-8770-d07876f229e6"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:45:38.910896 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:38.910882 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "bba9dae2-2a05-44a2-8770-d07876f229e6" (UID: "bba9dae2-2a05-44a2-8770-d07876f229e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:45:39.008415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.008348 2552 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-kubeconfig\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:45:39.008415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.008372 2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-csr-ca-configmap\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:45:39.008415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.008382 2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-csr-dns-cert\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:45:39.008415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.008390 2552 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bba9dae2-2a05-44a2-8770-d07876f229e6-local-certs\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:45:39.008415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.008397 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bba9dae2-2a05-44a2-8770-d07876f229e6-istio-token\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:45:39.008415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.008405 2552 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bba9dae2-2a05-44a2-8770-d07876f229e6-cacerts\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:45:39.008415 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.008411 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rggg\" (UniqueName: \"kubernetes.io/projected/bba9dae2-2a05-44a2-8770-d07876f229e6-kube-api-access-7rggg\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:45:39.600674 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.600633 2552 generic.go:356] "Generic (PLEG): container finished" podID="bba9dae2-2a05-44a2-8770-d07876f229e6" containerID="f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472" exitCode=0 Jul 01 16:45:39.601098 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.600703 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" event={"ID":"bba9dae2-2a05-44a2-8770-d07876f229e6","Type":"ContainerDied","Data":"f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472"} Jul 01 16:45:39.601098 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.600786 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" event={"ID":"bba9dae2-2a05-44a2-8770-d07876f229e6","Type":"ContainerDied","Data":"013db75733d4c4ac4dc77415d36c32a3e4550d5370d8a23bc7516b61c64ee9c5"} Jul 01 16:45:39.601098 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.600815 2552 scope.go:117] "RemoveContainer" containerID="f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472" Jul 01 16:45:39.601098 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.600981 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2" Jul 01 16:45:39.663980 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.663931 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2"] Jul 01 16:45:39.665767 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.665731 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zjhh2"] Jul 01 16:45:39.699357 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.699327 2552 scope.go:117] "RemoveContainer" containerID="f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472" Jul 01 16:45:39.699886 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:45:39.699856 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472\": container with ID starting with f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472 not found: ID does not exist" containerID="f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472" Jul 01 16:45:39.700006 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:39.699900 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472"} err="failed to get container status \"f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472\": rpc error: code = NotFound desc = could not find container \"f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472\": container with ID starting with f9824d3542902cfae2b2186c62ec01a3be5fad2c51bf5409b8ae75f6f495a472 not found: ID does not exist" Jul 01 16:45:41.004877 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:41.004835 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bba9dae2-2a05-44a2-8770-d07876f229e6" path="/var/lib/kubelet/pods/bba9dae2-2a05-44a2-8770-d07876f229e6/volumes" Jul 01 16:45:41.612381 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:41.612348 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" event={"ID":"fccc6fb3-9689-487d-8ba3-36246ad3086d","Type":"ContainerStarted","Data":"bccfca3fd7d9ba5319c596791bdbd7939442051434a3f9e2c1b3d78f0b26f521"} Jul 01 16:45:41.612562 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:41.612504 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" Jul 01 16:45:41.639547 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:41.639481 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" podStartSLOduration=1.602078251 podStartE2EDuration="4.639464717s" totalImagesPullingTime="3.037386466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:45:41.637849581 +0000 UTC m=+423.011247767" watchObservedRunningTime="2026-07-01 16:45:41.639464717 +0000 UTC m=+423.012862905" Jul 01 16:45:42.618298 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:42.618263 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" event={"ID":"21e7b05b-e4c2-4064-9cf7-ca030fe40ad7","Type":"ContainerStarted","Data":"02619a669a2302fbe150928e1ff473532ce60fa55d8830ebd7b08c000011cdac"} Jul 01 16:45:42.637292 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:42.637238 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" podStartSLOduration=1.99357571 podStartE2EDuration="5.637220952s" totalImagesPullingTime="3.643645242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:45:42.636345311 +0000 UTC m=+424.009743498" watchObservedRunningTime="2026-07-01 16:45:42.637220952 +0000 UTC m=+424.010619138" Jul 01 16:45:43.621930 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:43.621904 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" Jul 01 16:45:44.571906 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:44.571875 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-dfztg" Jul 01 16:45:44.575238 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:45:44.575216 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-w9lt2" Jul 01 16:46:12.623702 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:12.623625 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-hjdhk" Jul 01 16:46:14.628842 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:14.628813 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-z74vb" Jul 01 16:46:25.722311 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:25.722277 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8sb5p"] Jul 01 16:46:25.722708 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:25.722575 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba9dae2-2a05-44a2-8770-d07876f229e6" containerName="discovery" Jul 01 16:46:25.722708 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:25.722588 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba9dae2-2a05-44a2-8770-d07876f229e6" containerName="discovery" Jul 01 16:46:25.722708 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:25.722638 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba9dae2-2a05-44a2-8770-d07876f229e6" containerName="discovery" Jul 01 16:46:25.738574 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:25.738525 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8sb5p"] Jul 01 16:46:25.738737 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:25.738682 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" Jul 01 16:46:25.741685 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:25.741662 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 16:46:25.741685 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:25.741684 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jj5bg\"" Jul 01 16:46:25.741875 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:25.741661 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 16:46:25.772733 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:25.772695 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8krm\" (UniqueName: \"kubernetes.io/projected/dc0649bd-76f7-4d18-9e5f-901363704e49-kube-api-access-j8krm\") pod \"kuadrant-operator-catalog-8sb5p\" (UID: \"dc0649bd-76f7-4d18-9e5f-901363704e49\") " pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" Jul 01 16:46:25.873851 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:25.873811 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8krm\" (UniqueName: \"kubernetes.io/projected/dc0649bd-76f7-4d18-9e5f-901363704e49-kube-api-access-j8krm\") pod \"kuadrant-operator-catalog-8sb5p\" (UID: \"dc0649bd-76f7-4d18-9e5f-901363704e49\") " pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" Jul 01 16:46:25.888505 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:25.888466 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8krm\" (UniqueName: \"kubernetes.io/projected/dc0649bd-76f7-4d18-9e5f-901363704e49-kube-api-access-j8krm\") pod \"kuadrant-operator-catalog-8sb5p\" (UID: \"dc0649bd-76f7-4d18-9e5f-901363704e49\") " pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" Jul 01 16:46:26.049526 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.049484 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" Jul 01 16:46:26.082706 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.082665 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8sb5p"] Jul 01 16:46:26.188585 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.188477 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8sb5p"] Jul 01 16:46:26.190831 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:46:26.190801 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0649bd_76f7_4d18_9e5f_901363704e49.slice/crio-54b8022cef5f190bf00029a33d93d4a4eae969de4bfdc9e3cfaf94aa7de9d562 WatchSource:0}: Error finding container 54b8022cef5f190bf00029a33d93d4a4eae969de4bfdc9e3cfaf94aa7de9d562: Status 404 returned error can't find the container with id 54b8022cef5f190bf00029a33d93d4a4eae969de4bfdc9e3cfaf94aa7de9d562 Jul 01 16:46:26.294982 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.294944 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4h7ft"] Jul 01 16:46:26.299428 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.299407 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4h7ft" Jul 01 16:46:26.306357 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.306323 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4h7ft"] Jul 01 16:46:26.378416 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.378378 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvhzw\" (UniqueName: \"kubernetes.io/projected/9f557893-781c-468d-b164-3da5910e74c6-kube-api-access-tvhzw\") pod \"kuadrant-operator-catalog-4h7ft\" (UID: \"9f557893-781c-468d-b164-3da5910e74c6\") " pod="kuadrant-system/kuadrant-operator-catalog-4h7ft" Jul 01 16:46:26.479417 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.479375 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvhzw\" (UniqueName: \"kubernetes.io/projected/9f557893-781c-468d-b164-3da5910e74c6-kube-api-access-tvhzw\") pod \"kuadrant-operator-catalog-4h7ft\" (UID: \"9f557893-781c-468d-b164-3da5910e74c6\") " pod="kuadrant-system/kuadrant-operator-catalog-4h7ft" Jul 01 16:46:26.490920 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.490892 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvhzw\" (UniqueName: \"kubernetes.io/projected/9f557893-781c-468d-b164-3da5910e74c6-kube-api-access-tvhzw\") pod \"kuadrant-operator-catalog-4h7ft\" (UID: \"9f557893-781c-468d-b164-3da5910e74c6\") " pod="kuadrant-system/kuadrant-operator-catalog-4h7ft" Jul 01 16:46:26.609054 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.608958 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4h7ft" Jul 01 16:46:26.759496 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.759467 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4h7ft"] Jul 01 16:46:26.763218 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:46:26.763189 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f557893_781c_468d_b164_3da5910e74c6.slice/crio-0d3f4d27933fef1d5218131b6c394d684a8b6ac1fefca9aea8f097fb824dd0df WatchSource:0}: Error finding container 0d3f4d27933fef1d5218131b6c394d684a8b6ac1fefca9aea8f097fb824dd0df: Status 404 returned error can't find the container with id 0d3f4d27933fef1d5218131b6c394d684a8b6ac1fefca9aea8f097fb824dd0df Jul 01 16:46:26.797357 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.797319 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" event={"ID":"dc0649bd-76f7-4d18-9e5f-901363704e49","Type":"ContainerStarted","Data":"54b8022cef5f190bf00029a33d93d4a4eae969de4bfdc9e3cfaf94aa7de9d562"} Jul 01 16:46:26.798503 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:26.798472 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4h7ft" event={"ID":"9f557893-781c-468d-b164-3da5910e74c6","Type":"ContainerStarted","Data":"0d3f4d27933fef1d5218131b6c394d684a8b6ac1fefca9aea8f097fb824dd0df"} Jul 01 16:46:28.811986 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:28.811942 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" event={"ID":"dc0649bd-76f7-4d18-9e5f-901363704e49","Type":"ContainerStarted","Data":"0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0"} Jul 01 16:46:28.812611 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:28.811971 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" podUID="dc0649bd-76f7-4d18-9e5f-901363704e49" containerName="registry-server" containerID="cri-o://0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0" gracePeriod=2 Jul 01 16:46:28.813801 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:28.813540 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4h7ft" event={"ID":"9f557893-781c-468d-b164-3da5910e74c6","Type":"ContainerStarted","Data":"111290ead61ba9ab7ce5c86dbfda78a03b387e3cfc0547b3472b41f0ae4c0fe0"} Jul 01 16:46:28.831293 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:28.831231 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" podStartSLOduration=1.328428917 podStartE2EDuration="3.83121286s" totalImagesPullingTime="2.502783943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:46:28.829778 +0000 UTC m=+470.203176200" watchObservedRunningTime="2026-07-01 16:46:28.83121286 +0000 UTC m=+470.204611046" Jul 01 16:46:28.848788 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:28.848713 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4h7ft" podStartSLOduration=0.915156291 podStartE2EDuration="2.848691526s" totalImagesPullingTime="1.933535235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:46:28.848106985 +0000 UTC m=+470.221505173" watchObservedRunningTime="2026-07-01 16:46:28.848691526 +0000 UTC m=+470.222089714" Jul 01 16:46:29.057658 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.057624 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" Jul 01 16:46:29.100918 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.100873 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8krm\" (UniqueName: \"kubernetes.io/projected/dc0649bd-76f7-4d18-9e5f-901363704e49-kube-api-access-j8krm\") pod \"dc0649bd-76f7-4d18-9e5f-901363704e49\" (UID: \"dc0649bd-76f7-4d18-9e5f-901363704e49\") " Jul 01 16:46:29.103586 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.103555 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc0649bd-76f7-4d18-9e5f-901363704e49-kube-api-access-j8krm" (OuterVolumeSpecName: "kube-api-access-j8krm") pod "dc0649bd-76f7-4d18-9e5f-901363704e49" (UID: "dc0649bd-76f7-4d18-9e5f-901363704e49"). InnerVolumeSpecName "kube-api-access-j8krm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:46:29.201798 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.201761 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8krm\" (UniqueName: \"kubernetes.io/projected/dc0649bd-76f7-4d18-9e5f-901363704e49-kube-api-access-j8krm\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:46:29.818794 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.818756 2552 generic.go:356] "Generic (PLEG): container finished" podID="dc0649bd-76f7-4d18-9e5f-901363704e49" containerID="0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0" exitCode=0 Jul 01 16:46:29.819197 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.818808 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" Jul 01 16:46:29.819197 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.818840 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" event={"ID":"dc0649bd-76f7-4d18-9e5f-901363704e49","Type":"ContainerDied","Data":"0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0"} Jul 01 16:46:29.819197 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.818896 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8sb5p" event={"ID":"dc0649bd-76f7-4d18-9e5f-901363704e49","Type":"ContainerDied","Data":"54b8022cef5f190bf00029a33d93d4a4eae969de4bfdc9e3cfaf94aa7de9d562"} Jul 01 16:46:29.819197 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.818916 2552 scope.go:117] "RemoveContainer" containerID="0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0" Jul 01 16:46:29.827663 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.827641 2552 scope.go:117] "RemoveContainer" containerID="0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0" Jul 01 16:46:29.827963 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:46:29.827944 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0\": container with ID starting with 0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0 not found: ID does not exist" containerID="0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0" Jul 01 16:46:29.828018 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.827974 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0"} err="failed to get container status \"0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0\": rpc error: code = NotFound desc = could not find container \"0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0\": container with ID starting with 0f2daad5e3dd039e40a39ebbfa147a14e9e8365c9ef7838b9e207d64c388d8e0 not found: ID does not exist" Jul 01 16:46:29.843236 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.843199 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8sb5p"] Jul 01 16:46:29.850890 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:29.850862 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8sb5p"] Jul 01 16:46:31.003539 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:31.003511 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc0649bd-76f7-4d18-9e5f-901363704e49" path="/var/lib/kubelet/pods/dc0649bd-76f7-4d18-9e5f-901363704e49/volumes" Jul 01 16:46:36.609793 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:36.609755 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4h7ft" Jul 01 16:46:36.610290 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:36.609836 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4h7ft" Jul 01 16:46:36.632492 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:36.632462 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4h7ft" Jul 01 16:46:36.872721 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:36.872648 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4h7ft" Jul 01 16:46:58.270667 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.270636 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q95kv"] Jul 01 16:46:58.271148 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.270929 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc0649bd-76f7-4d18-9e5f-901363704e49" containerName="registry-server" Jul 01 16:46:58.271148 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.270941 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc0649bd-76f7-4d18-9e5f-901363704e49" containerName="registry-server" Jul 01 16:46:58.271148 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.271050 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc0649bd-76f7-4d18-9e5f-901363704e49" containerName="registry-server" Jul 01 16:46:58.280212 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.280169 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q95kv" Jul 01 16:46:58.284877 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.284850 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cm9zp\"" Jul 01 16:46:58.285241 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.285217 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q95kv"] Jul 01 16:46:58.435348 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.435309 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zxkk\" (UniqueName: \"kubernetes.io/projected/1b9c9dec-9819-4f1a-97ee-6cc824226779-kube-api-access-8zxkk\") pod \"authorino-operator-75cc8d5cb7-q95kv\" (UID: \"1b9c9dec-9819-4f1a-97ee-6cc824226779\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q95kv" Jul 01 16:46:58.536207 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.536112 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zxkk\" (UniqueName: \"kubernetes.io/projected/1b9c9dec-9819-4f1a-97ee-6cc824226779-kube-api-access-8zxkk\") pod \"authorino-operator-75cc8d5cb7-q95kv\" (UID: \"1b9c9dec-9819-4f1a-97ee-6cc824226779\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q95kv" Jul 01 16:46:58.549327 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.549298 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zxkk\" (UniqueName: \"kubernetes.io/projected/1b9c9dec-9819-4f1a-97ee-6cc824226779-kube-api-access-8zxkk\") pod \"authorino-operator-75cc8d5cb7-q95kv\" (UID: \"1b9c9dec-9819-4f1a-97ee-6cc824226779\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q95kv" Jul 01 16:46:58.591260 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.591219 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q95kv" Jul 01 16:46:58.734795 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.734771 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q95kv"] Jul 01 16:46:58.737211 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:46:58.737184 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9c9dec_9819_4f1a_97ee_6cc824226779.slice/crio-c2896e2b45e78522785ddc09f3cbf67f0422fea4e3a5d05f89f5ffec4cef5fba WatchSource:0}: Error finding container c2896e2b45e78522785ddc09f3cbf67f0422fea4e3a5d05f89f5ffec4cef5fba: Status 404 returned error can't find the container with id c2896e2b45e78522785ddc09f3cbf67f0422fea4e3a5d05f89f5ffec4cef5fba Jul 01 16:46:58.940677 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:46:58.940597 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q95kv" event={"ID":"1b9c9dec-9819-4f1a-97ee-6cc824226779","Type":"ContainerStarted","Data":"c2896e2b45e78522785ddc09f3cbf67f0422fea4e3a5d05f89f5ffec4cef5fba"} Jul 01 16:47:01.514434 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:01.514403 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7"] Jul 01 16:47:01.517534 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:01.517501 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:01.520094 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:01.520074 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pvlmk\"" Jul 01 16:47:01.529935 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:01.529910 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7"] Jul 01 16:47:01.660350 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:01.660304 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmvnj\" (UniqueName: \"kubernetes.io/projected/80829ca0-62e2-4657-9df3-2d84e39f525a-kube-api-access-tmvnj\") pod \"limitador-operator-controller-manager-859d7b78bd-4trd7\" (UID: \"80829ca0-62e2-4657-9df3-2d84e39f525a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:01.761186 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:01.761137 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmvnj\" (UniqueName: \"kubernetes.io/projected/80829ca0-62e2-4657-9df3-2d84e39f525a-kube-api-access-tmvnj\") pod \"limitador-operator-controller-manager-859d7b78bd-4trd7\" (UID: \"80829ca0-62e2-4657-9df3-2d84e39f525a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:01.777568 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:01.777536 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmvnj\" (UniqueName: \"kubernetes.io/projected/80829ca0-62e2-4657-9df3-2d84e39f525a-kube-api-access-tmvnj\") pod \"limitador-operator-controller-manager-859d7b78bd-4trd7\" (UID: \"80829ca0-62e2-4657-9df3-2d84e39f525a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:01.827385 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:01.827341 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:01.956482 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:01.956407 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q95kv" event={"ID":"1b9c9dec-9819-4f1a-97ee-6cc824226779","Type":"ContainerStarted","Data":"83e2aa09164128fd4b3352129323bafe384d63cb25aafb3872c54b0867b5f389"} Jul 01 16:47:01.968002 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:01.967943 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7"] Jul 01 16:47:01.970601 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:47:01.970572 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80829ca0_62e2_4657_9df3_2d84e39f525a.slice/crio-28fbc3b9de71a4574cde645ff60698b88d392d03741792fbd2601f3859a6663b WatchSource:0}: Error finding container 28fbc3b9de71a4574cde645ff60698b88d392d03741792fbd2601f3859a6663b: Status 404 returned error can't find the container with id 28fbc3b9de71a4574cde645ff60698b88d392d03741792fbd2601f3859a6663b Jul 01 16:47:01.979007 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:01.978950 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q95kv" podStartSLOduration=1.2697950310000001 podStartE2EDuration="3.978932073s" totalImagesPullingTime="2.709137042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:47:01.97758792 +0000 UTC m=+503.350986151" watchObservedRunningTime="2026-07-01 16:47:01.978932073 +0000 UTC m=+503.352330259" Jul 01 16:47:02.962083 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:02.962048 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" event={"ID":"80829ca0-62e2-4657-9df3-2d84e39f525a","Type":"ContainerStarted","Data":"28fbc3b9de71a4574cde645ff60698b88d392d03741792fbd2601f3859a6663b"} Jul 01 16:47:02.962491 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:02.962131 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q95kv" Jul 01 16:47:04.787382 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:04.787340 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd"] Jul 01 16:47:04.791128 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:04.791108 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd" Jul 01 16:47:04.795420 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:04.795397 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 01 16:47:04.796058 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:04.796026 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qkpb2\"" Jul 01 16:47:04.804212 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:04.804178 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd"] Jul 01 16:47:04.887993 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:04.887946 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4cjr\" (UniqueName: \"kubernetes.io/projected/86e098d9-8d9e-48eb-83f6-760cf409240b-kube-api-access-h4cjr\") pod \"dns-operator-controller-manager-864dd78c4c-hqznd\" (UID: \"86e098d9-8d9e-48eb-83f6-760cf409240b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd" Jul 01 16:47:04.974067 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:04.974025 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" event={"ID":"80829ca0-62e2-4657-9df3-2d84e39f525a","Type":"ContainerStarted","Data":"8c08894a6697370685895dd173e53edd0db5c640b1d20b710c116734415b25d1"} Jul 01 16:47:04.974275 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:04.974176 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:04.988385 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:04.988343 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4cjr\" (UniqueName: \"kubernetes.io/projected/86e098d9-8d9e-48eb-83f6-760cf409240b-kube-api-access-h4cjr\") pod \"dns-operator-controller-manager-864dd78c4c-hqznd\" (UID: \"86e098d9-8d9e-48eb-83f6-760cf409240b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd" Jul 01 16:47:04.998305 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:04.998250 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" podStartSLOduration=1.96987829 podStartE2EDuration="3.998236098s" totalImagesPullingTime="2.028357808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:47:04.996491506 +0000 UTC m=+506.369889712" watchObservedRunningTime="2026-07-01 16:47:04.998236098 +0000 UTC m=+506.371634286" Jul 01 16:47:05.001785 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:05.001755 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4cjr\" (UniqueName: \"kubernetes.io/projected/86e098d9-8d9e-48eb-83f6-760cf409240b-kube-api-access-h4cjr\") pod \"dns-operator-controller-manager-864dd78c4c-hqznd\" (UID: \"86e098d9-8d9e-48eb-83f6-760cf409240b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd" Jul 01 16:47:05.102361 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:05.102266 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd" Jul 01 16:47:05.240764 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:05.240729 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd"] Jul 01 16:47:05.244700 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:47:05.244658 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e098d9_8d9e_48eb_83f6_760cf409240b.slice/crio-adfe3092381b31fa7695328ebda66db828877db3fe11b64e061f25e95c44d8f5 WatchSource:0}: Error finding container adfe3092381b31fa7695328ebda66db828877db3fe11b64e061f25e95c44d8f5: Status 404 returned error can't find the container with id adfe3092381b31fa7695328ebda66db828877db3fe11b64e061f25e95c44d8f5 Jul 01 16:47:05.980991 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:05.980922 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd" event={"ID":"86e098d9-8d9e-48eb-83f6-760cf409240b","Type":"ContainerStarted","Data":"adfe3092381b31fa7695328ebda66db828877db3fe11b64e061f25e95c44d8f5"} Jul 01 16:47:07.990640 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:07.990602 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd" event={"ID":"86e098d9-8d9e-48eb-83f6-760cf409240b","Type":"ContainerStarted","Data":"de60ac0704b579031222e3c16e7c0b0a6fb354cbae0e1c2a700f7c7918d0e63b"} Jul 01 16:47:07.991131 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:07.990750 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd" Jul 01 16:47:08.013623 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:08.013571 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd" podStartSLOduration=2.001506862 podStartE2EDuration="4.013554585s" totalImagesPullingTime="2.012047723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:47:08.011601712 +0000 UTC m=+509.384999896" watchObservedRunningTime="2026-07-01 16:47:08.013554585 +0000 UTC m=+509.386952772" Jul 01 16:47:09.810810 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:09.810773 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q"] Jul 01 16:47:09.814175 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:09.814148 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:09.821249 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:09.821229 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n68tt\"" Jul 01 16:47:09.831625 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:09.831588 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q"] Jul 01 16:47:09.933752 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:09.933706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdpfw\" (UniqueName: \"kubernetes.io/projected/a31c6d94-039b-4227-9447-a5c016fff9c7-kube-api-access-vdpfw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nbd2q\" (UID: \"a31c6d94-039b-4227-9447-a5c016fff9c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:09.933957 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:09.933782 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a31c6d94-039b-4227-9447-a5c016fff9c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nbd2q\" (UID: \"a31c6d94-039b-4227-9447-a5c016fff9c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:10.034492 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:10.034420 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a31c6d94-039b-4227-9447-a5c016fff9c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nbd2q\" (UID: \"a31c6d94-039b-4227-9447-a5c016fff9c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:10.034663 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:10.034531 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdpfw\" (UniqueName: \"kubernetes.io/projected/a31c6d94-039b-4227-9447-a5c016fff9c7-kube-api-access-vdpfw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nbd2q\" (UID: \"a31c6d94-039b-4227-9447-a5c016fff9c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:10.034843 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:10.034804 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a31c6d94-039b-4227-9447-a5c016fff9c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nbd2q\" (UID: \"a31c6d94-039b-4227-9447-a5c016fff9c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:10.044342 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:10.044304 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdpfw\" (UniqueName: \"kubernetes.io/projected/a31c6d94-039b-4227-9447-a5c016fff9c7-kube-api-access-vdpfw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nbd2q\" (UID: \"a31c6d94-039b-4227-9447-a5c016fff9c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:10.123711 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:10.123625 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:10.270687 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:10.270649 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q"] Jul 01 16:47:10.274028 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:47:10.273982 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31c6d94_039b_4227_9447_a5c016fff9c7.slice/crio-ea04b6f0a2303599fd4c6adf3960c3614d1946a090333cca6bdc101feac62de6 WatchSource:0}: Error finding container ea04b6f0a2303599fd4c6adf3960c3614d1946a090333cca6bdc101feac62de6: Status 404 returned error can't find the container with id ea04b6f0a2303599fd4c6adf3960c3614d1946a090333cca6bdc101feac62de6 Jul 01 16:47:11.004490 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:11.004434 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" event={"ID":"a31c6d94-039b-4227-9447-a5c016fff9c7","Type":"ContainerStarted","Data":"ea04b6f0a2303599fd4c6adf3960c3614d1946a090333cca6bdc101feac62de6"} Jul 01 16:47:13.969699 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:13.969664 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q95kv" Jul 01 16:47:15.983832 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:15.983799 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:17.035378 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:17.035341 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" event={"ID":"a31c6d94-039b-4227-9447-a5c016fff9c7","Type":"ContainerStarted","Data":"c5780647420bcff95336a4a3139c1dca979d691c719c6e3a3e52883c22b39aa0"} Jul 01 16:47:17.035781 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:17.035483 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:17.087416 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:17.087353 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" podStartSLOduration=1.457638843 podStartE2EDuration="8.08733638s" totalImagesPullingTime="6.629697537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:47:17.086322839 +0000 UTC m=+518.459721027" watchObservedRunningTime="2026-07-01 16:47:17.08733638 +0000 UTC m=+518.460734568" Jul 01 16:47:18.997274 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:18.997241 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hqznd" Jul 01 16:47:19.750582 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.750534 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97"] Jul 01 16:47:19.754422 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.754394 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" Jul 01 16:47:19.757185 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.757152 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 01 16:47:19.757349 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.757187 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 01 16:47:19.757349 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.757187 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jgl85\"" Jul 01 16:47:19.773880 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.773847 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97"] Jul 01 16:47:19.810993 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.810958 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/de642c45-6d36-4387-9d15-d769a6e2ea31-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kcf97\" (UID: \"de642c45-6d36-4387-9d15-d769a6e2ea31\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" Jul 01 16:47:19.811157 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.811002 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42p66\" (UniqueName: \"kubernetes.io/projected/de642c45-6d36-4387-9d15-d769a6e2ea31-kube-api-access-42p66\") pod \"kuadrant-console-plugin-66b5774985-kcf97\" (UID: \"de642c45-6d36-4387-9d15-d769a6e2ea31\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" Jul 01 16:47:19.811157 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.811081 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de642c45-6d36-4387-9d15-d769a6e2ea31-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kcf97\" (UID: \"de642c45-6d36-4387-9d15-d769a6e2ea31\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" Jul 01 16:47:19.911903 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.911861 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42p66\" (UniqueName: \"kubernetes.io/projected/de642c45-6d36-4387-9d15-d769a6e2ea31-kube-api-access-42p66\") pod \"kuadrant-console-plugin-66b5774985-kcf97\" (UID: \"de642c45-6d36-4387-9d15-d769a6e2ea31\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" Jul 01 16:47:19.912074 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.911925 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de642c45-6d36-4387-9d15-d769a6e2ea31-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kcf97\" (UID: \"de642c45-6d36-4387-9d15-d769a6e2ea31\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" Jul 01 16:47:19.912074 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.911971 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/de642c45-6d36-4387-9d15-d769a6e2ea31-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kcf97\" (UID: \"de642c45-6d36-4387-9d15-d769a6e2ea31\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" Jul 01 16:47:19.912074 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:47:19.912060 2552 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 01 16:47:19.912333 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:47:19.912111 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de642c45-6d36-4387-9d15-d769a6e2ea31-plugin-serving-cert podName:de642c45-6d36-4387-9d15-d769a6e2ea31 nodeName:}" failed. No retries permitted until 2026-07-01 16:47:20.412097084 +0000 UTC m=+521.785495249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/de642c45-6d36-4387-9d15-d769a6e2ea31-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-kcf97" (UID: "de642c45-6d36-4387-9d15-d769a6e2ea31") : secret "plugin-serving-cert" not found Jul 01 16:47:19.912666 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.912646 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de642c45-6d36-4387-9d15-d769a6e2ea31-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kcf97\" (UID: \"de642c45-6d36-4387-9d15-d769a6e2ea31\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" Jul 01 16:47:19.922407 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:19.922381 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42p66\" (UniqueName: \"kubernetes.io/projected/de642c45-6d36-4387-9d15-d769a6e2ea31-kube-api-access-42p66\") pod \"kuadrant-console-plugin-66b5774985-kcf97\" (UID: \"de642c45-6d36-4387-9d15-d769a6e2ea31\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" Jul 01 16:47:20.416287 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:20.416229 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/de642c45-6d36-4387-9d15-d769a6e2ea31-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kcf97\" (UID: \"de642c45-6d36-4387-9d15-d769a6e2ea31\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" Jul 01 16:47:20.418771 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:20.418749 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/de642c45-6d36-4387-9d15-d769a6e2ea31-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kcf97\" (UID: \"de642c45-6d36-4387-9d15-d769a6e2ea31\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" Jul 01 16:47:20.664085 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:20.664044 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" Jul 01 16:47:20.799235 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:20.799100 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97"] Jul 01 16:47:20.801297 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:47:20.801260 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde642c45_6d36_4387_9d15_d769a6e2ea31.slice/crio-db51f595811973b8b6bbddc8215d0575e17b7eadf30e742e13e67619a9fc2248 WatchSource:0}: Error finding container db51f595811973b8b6bbddc8215d0575e17b7eadf30e742e13e67619a9fc2248: Status 404 returned error can't find the container with id db51f595811973b8b6bbddc8215d0575e17b7eadf30e742e13e67619a9fc2248 Jul 01 16:47:21.052998 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:21.052960 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" event={"ID":"de642c45-6d36-4387-9d15-d769a6e2ea31","Type":"ContainerStarted","Data":"db51f595811973b8b6bbddc8215d0575e17b7eadf30e742e13e67619a9fc2248"} Jul 01 16:47:28.043241 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:28.043202 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:29.854501 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.854393 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q"] Jul 01 16:47:29.855068 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.854630 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" podUID="a31c6d94-039b-4227-9447-a5c016fff9c7" containerName="manager" containerID="cri-o://c5780647420bcff95336a4a3139c1dca979d691c719c6e3a3e52883c22b39aa0" gracePeriod=2 Jul 01 16:47:29.864946 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.864911 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q"] Jul 01 16:47:29.866254 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:47:29.866197 2552 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a31c6d94-039b-4227-9447-a5c016fff9c7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-nbd2q\": pods \"kuadrant-operator-controller-manager-8684c9ff49-nbd2q\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:29.879335 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.879107 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h"] Jul 01 16:47:29.879630 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.879583 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a31c6d94-039b-4227-9447-a5c016fff9c7" containerName="manager" Jul 01 16:47:29.879630 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.879603 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a31c6d94-039b-4227-9447-a5c016fff9c7" containerName="manager" Jul 01 16:47:29.879788 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.879696 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a31c6d94-039b-4227-9447-a5c016fff9c7" containerName="manager" Jul 01 16:47:29.882995 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.882969 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7"] Jul 01 16:47:29.883121 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.883093 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" Jul 01 16:47:29.883457 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.883251 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" podUID="80829ca0-62e2-4657-9df3-2d84e39f525a" containerName="manager" containerID="cri-o://8c08894a6697370685895dd173e53edd0db5c640b1d20b710c116734415b25d1" gracePeriod=2 Jul 01 16:47:29.889055 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.888983 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7"] Jul 01 16:47:29.898510 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.898435 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h"] Jul 01 16:47:29.905361 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.905328 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh"] Jul 01 16:47:29.905718 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.905700 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80829ca0-62e2-4657-9df3-2d84e39f525a" containerName="manager" Jul 01 16:47:29.905784 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.905723 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="80829ca0-62e2-4657-9df3-2d84e39f525a" containerName="manager" Jul 01 16:47:29.905837 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.905808 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="80829ca0-62e2-4657-9df3-2d84e39f525a" containerName="manager" Jul 01 16:47:29.908877 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.908852 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh" Jul 01 16:47:29.912011 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:47:29.911982 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbd2q\" is forbidden: User \"system:node:ip-10-0-130-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-152.ec2.internal' and this object" podUID="a31c6d94-039b-4227-9447-a5c016fff9c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:29.914169 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:47:29.914139 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4trd7\" is forbidden: User \"system:node:ip-10-0-130-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-152.ec2.internal' and this object" podUID="80829ca0-62e2-4657-9df3-2d84e39f525a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:29.916388 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:47:29.916364 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4trd7\" is forbidden: User \"system:node:ip-10-0-130-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-152.ec2.internal' and this object" podUID="80829ca0-62e2-4657-9df3-2d84e39f525a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:29.921150 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:29.921117 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh"] Jul 01 16:47:29.938907 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:47:29.938876 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbd2q\" is forbidden: User \"system:node:ip-10-0-130-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-152.ec2.internal' and this object" podUID="a31c6d94-039b-4227-9447-a5c016fff9c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:30.002681 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.002657 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1560e71-518f-40f6-a657-e9413ff85172-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q9c2h\" (UID: \"a1560e71-518f-40f6-a657-e9413ff85172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" Jul 01 16:47:30.002813 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.002709 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn4nh\" (UniqueName: \"kubernetes.io/projected/113035d2-32ed-432d-893f-f86975d3774e-kube-api-access-wn4nh\") pod \"limitador-operator-controller-manager-859d7b78bd-9mzdh\" (UID: \"113035d2-32ed-432d-893f-f86975d3774e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh" Jul 01 16:47:30.002879 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.002855 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c72lt\" (UniqueName: \"kubernetes.io/projected/a1560e71-518f-40f6-a657-e9413ff85172-kube-api-access-c72lt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q9c2h\" (UID: \"a1560e71-518f-40f6-a657-e9413ff85172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" Jul 01 16:47:30.100948 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.100895 2552 generic.go:356] "Generic (PLEG): container finished" podID="80829ca0-62e2-4657-9df3-2d84e39f525a" containerID="8c08894a6697370685895dd173e53edd0db5c640b1d20b710c116734415b25d1" exitCode=0 Jul 01 16:47:30.103668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.103557 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn4nh\" (UniqueName: \"kubernetes.io/projected/113035d2-32ed-432d-893f-f86975d3774e-kube-api-access-wn4nh\") pod \"limitador-operator-controller-manager-859d7b78bd-9mzdh\" (UID: \"113035d2-32ed-432d-893f-f86975d3774e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh" Jul 01 16:47:30.103668 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.103644 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c72lt\" (UniqueName: \"kubernetes.io/projected/a1560e71-518f-40f6-a657-e9413ff85172-kube-api-access-c72lt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q9c2h\" (UID: \"a1560e71-518f-40f6-a657-e9413ff85172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" Jul 01 16:47:30.103885 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.103714 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1560e71-518f-40f6-a657-e9413ff85172-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q9c2h\" (UID: \"a1560e71-518f-40f6-a657-e9413ff85172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" Jul 01 16:47:30.104291 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.104255 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1560e71-518f-40f6-a657-e9413ff85172-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q9c2h\" (UID: \"a1560e71-518f-40f6-a657-e9413ff85172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" Jul 01 16:47:30.104774 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.104712 2552 generic.go:356] "Generic (PLEG): container finished" podID="a31c6d94-039b-4227-9447-a5c016fff9c7" containerID="c5780647420bcff95336a4a3139c1dca979d691c719c6e3a3e52883c22b39aa0" exitCode=0 Jul 01 16:47:30.114931 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.114901 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c72lt\" (UniqueName: \"kubernetes.io/projected/a1560e71-518f-40f6-a657-e9413ff85172-kube-api-access-c72lt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q9c2h\" (UID: \"a1560e71-518f-40f6-a657-e9413ff85172\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" Jul 01 16:47:30.115902 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.115855 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn4nh\" (UniqueName: \"kubernetes.io/projected/113035d2-32ed-432d-893f-f86975d3774e-kube-api-access-wn4nh\") pod \"limitador-operator-controller-manager-859d7b78bd-9mzdh\" (UID: \"113035d2-32ed-432d-893f-f86975d3774e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh" Jul 01 16:47:30.149206 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.149176 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:30.152087 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.152044 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:30.152251 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:47:30.152099 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbd2q\" is forbidden: User \"system:node:ip-10-0-130-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-152.ec2.internal' and this object" podUID="a31c6d94-039b-4227-9447-a5c016fff9c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:30.155118 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:47:30.155086 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4trd7\" is forbidden: User \"system:node:ip-10-0-130-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-152.ec2.internal' and this object" podUID="80829ca0-62e2-4657-9df3-2d84e39f525a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:30.157614 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:47:30.157576 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbd2q\" is forbidden: User \"system:node:ip-10-0-130-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-152.ec2.internal' and this object" podUID="a31c6d94-039b-4227-9447-a5c016fff9c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:30.160640 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:47:30.160609 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4trd7\" is forbidden: User \"system:node:ip-10-0-130-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-152.ec2.internal' and this object" podUID="80829ca0-62e2-4657-9df3-2d84e39f525a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:30.204719 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.204685 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdpfw\" (UniqueName: \"kubernetes.io/projected/a31c6d94-039b-4227-9447-a5c016fff9c7-kube-api-access-vdpfw\") pod \"a31c6d94-039b-4227-9447-a5c016fff9c7\" (UID: \"a31c6d94-039b-4227-9447-a5c016fff9c7\") " Jul 01 16:47:30.204719 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.204729 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmvnj\" (UniqueName: \"kubernetes.io/projected/80829ca0-62e2-4657-9df3-2d84e39f525a-kube-api-access-tmvnj\") pod \"80829ca0-62e2-4657-9df3-2d84e39f525a\" (UID: \"80829ca0-62e2-4657-9df3-2d84e39f525a\") " Jul 01 16:47:30.204956 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.204776 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a31c6d94-039b-4227-9447-a5c016fff9c7-extensions-socket-volume\") pod \"a31c6d94-039b-4227-9447-a5c016fff9c7\" (UID: \"a31c6d94-039b-4227-9447-a5c016fff9c7\") " Jul 01 16:47:30.205508 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.205433 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31c6d94-039b-4227-9447-a5c016fff9c7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a31c6d94-039b-4227-9447-a5c016fff9c7" (UID: "a31c6d94-039b-4227-9447-a5c016fff9c7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:47:30.207314 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.207281 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80829ca0-62e2-4657-9df3-2d84e39f525a-kube-api-access-tmvnj" (OuterVolumeSpecName: "kube-api-access-tmvnj") pod "80829ca0-62e2-4657-9df3-2d84e39f525a" (UID: "80829ca0-62e2-4657-9df3-2d84e39f525a"). InnerVolumeSpecName "kube-api-access-tmvnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:47:30.207422 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.207337 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31c6d94-039b-4227-9447-a5c016fff9c7-kube-api-access-vdpfw" (OuterVolumeSpecName: "kube-api-access-vdpfw") pod "a31c6d94-039b-4227-9447-a5c016fff9c7" (UID: "a31c6d94-039b-4227-9447-a5c016fff9c7"). InnerVolumeSpecName "kube-api-access-vdpfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:47:30.305919 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.305878 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a31c6d94-039b-4227-9447-a5c016fff9c7-extensions-socket-volume\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:47:30.305919 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.305915 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdpfw\" (UniqueName: \"kubernetes.io/projected/a31c6d94-039b-4227-9447-a5c016fff9c7-kube-api-access-vdpfw\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:47:30.305919 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.305928 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmvnj\" (UniqueName: \"kubernetes.io/projected/80829ca0-62e2-4657-9df3-2d84e39f525a-kube-api-access-tmvnj\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:47:30.307857 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.307822 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" Jul 01 16:47:30.321022 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.320998 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh" Jul 01 16:47:30.472949 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.472807 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h"] Jul 01 16:47:30.476032 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:47:30.476001 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1560e71_518f_40f6_a657_e9413ff85172.slice/crio-83826d737fa34fcda096d0c0c82de28cad88094430f8266377781178e7a05665 WatchSource:0}: Error finding container 83826d737fa34fcda096d0c0c82de28cad88094430f8266377781178e7a05665: Status 404 returned error can't find the container with id 83826d737fa34fcda096d0c0c82de28cad88094430f8266377781178e7a05665 Jul 01 16:47:30.495606 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:30.495563 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh"] Jul 01 16:47:30.497885 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:47:30.497845 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113035d2_32ed_432d_893f_f86975d3774e.slice/crio-3d26cd2cf596470e8147a193ad901a4a9ce116d5f54fee4db6002cc20033a0b9 WatchSource:0}: Error finding container 3d26cd2cf596470e8147a193ad901a4a9ce116d5f54fee4db6002cc20033a0b9: Status 404 returned error can't find the container with id 3d26cd2cf596470e8147a193ad901a4a9ce116d5f54fee4db6002cc20033a0b9 Jul 01 16:47:31.007144 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.007107 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80829ca0-62e2-4657-9df3-2d84e39f525a" path="/var/lib/kubelet/pods/80829ca0-62e2-4657-9df3-2d84e39f525a/volumes" Jul 01 16:47:31.007630 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.007612 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a31c6d94-039b-4227-9447-a5c016fff9c7" path="/var/lib/kubelet/pods/a31c6d94-039b-4227-9447-a5c016fff9c7/volumes" Jul 01 16:47:31.112304 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.112259 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" event={"ID":"a1560e71-518f-40f6-a657-e9413ff85172","Type":"ContainerStarted","Data":"be90a85e951c066db6df8091359141f6ef96232f1c35da17416b8ece5b40a84a"} Jul 01 16:47:31.112511 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.112352 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" event={"ID":"a1560e71-518f-40f6-a657-e9413ff85172","Type":"ContainerStarted","Data":"83826d737fa34fcda096d0c0c82de28cad88094430f8266377781178e7a05665"} Jul 01 16:47:31.112511 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.112498 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" Jul 01 16:47:31.114104 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.114081 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbd2q" Jul 01 16:47:31.114104 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.114103 2552 scope.go:117] "RemoveContainer" containerID="c5780647420bcff95336a4a3139c1dca979d691c719c6e3a3e52883c22b39aa0" Jul 01 16:47:31.116974 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.116948 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh" event={"ID":"113035d2-32ed-432d-893f-f86975d3774e","Type":"ContainerStarted","Data":"c7a13a80739a0a8ded2e0acf9a7312c57deea3f8541232818bf548013105c8ca"} Jul 01 16:47:31.117105 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.116996 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh" event={"ID":"113035d2-32ed-432d-893f-f86975d3774e","Type":"ContainerStarted","Data":"3d26cd2cf596470e8147a193ad901a4a9ce116d5f54fee4db6002cc20033a0b9"} Jul 01 16:47:31.117105 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.117103 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh" Jul 01 16:47:31.118606 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.118589 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4trd7" Jul 01 16:47:31.204419 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.204306 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" podStartSLOduration=2.204283512 podStartE2EDuration="2.204283512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:47:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:47:31.200830389 +0000 UTC m=+532.574228579" watchObservedRunningTime="2026-07-01 16:47:31.204283512 +0000 UTC m=+532.577681699" Jul 01 16:47:31.244360 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:31.244299 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh" podStartSLOduration=2.24428161 podStartE2EDuration="2.24428161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:47:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:47:31.24391141 +0000 UTC m=+532.617309623" watchObservedRunningTime="2026-07-01 16:47:31.24428161 +0000 UTC m=+532.617679878" Jul 01 16:47:42.128303 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:42.128257 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9mzdh" Jul 01 16:47:42.128852 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:42.128347 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" Jul 01 16:47:45.105877 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:45.105652 2552 scope.go:117] "RemoveContainer" containerID="8c08894a6697370685895dd173e53edd0db5c640b1d20b710c116734415b25d1" Jul 01 16:47:45.988774 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:45.988714 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h"] Jul 01 16:47:45.989019 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:45.988991 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" podUID="a1560e71-518f-40f6-a657-e9413ff85172" containerName="manager" containerID="cri-o://be90a85e951c066db6df8091359141f6ef96232f1c35da17416b8ece5b40a84a" gracePeriod=10 Jul 01 16:47:46.217510 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:46.217470 2552 generic.go:356] "Generic (PLEG): container finished" podID="a1560e71-518f-40f6-a657-e9413ff85172" containerID="be90a85e951c066db6df8091359141f6ef96232f1c35da17416b8ece5b40a84a" exitCode=0 Jul 01 16:47:46.217989 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:46.217559 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" event={"ID":"a1560e71-518f-40f6-a657-e9413ff85172","Type":"ContainerDied","Data":"be90a85e951c066db6df8091359141f6ef96232f1c35da17416b8ece5b40a84a"} Jul 01 16:47:46.219288 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:46.219259 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" event={"ID":"de642c45-6d36-4387-9d15-d769a6e2ea31","Type":"ContainerStarted","Data":"f9e53c5675e4ca00320611cedc31210cb98ea0b4f0bace193c15021d3ca5c140"} Jul 01 16:47:46.242538 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:46.242455 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" Jul 01 16:47:46.244785 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:46.244732 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kcf97" podStartSLOduration=2.859271048 podStartE2EDuration="27.244713723s" totalImagesPullingTime="24.385442675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:47:46.244621004 +0000 UTC m=+547.618019191" watchObservedRunningTime="2026-07-01 16:47:46.244713723 +0000 UTC m=+547.618111910" Jul 01 16:47:46.357173 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:46.357134 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c72lt\" (UniqueName: \"kubernetes.io/projected/a1560e71-518f-40f6-a657-e9413ff85172-kube-api-access-c72lt\") pod \"a1560e71-518f-40f6-a657-e9413ff85172\" (UID: \"a1560e71-518f-40f6-a657-e9413ff85172\") " Jul 01 16:47:46.357351 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:46.357221 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1560e71-518f-40f6-a657-e9413ff85172-extensions-socket-volume\") pod \"a1560e71-518f-40f6-a657-e9413ff85172\" (UID: \"a1560e71-518f-40f6-a657-e9413ff85172\") " Jul 01 16:47:46.357724 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:46.357691 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1560e71-518f-40f6-a657-e9413ff85172-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a1560e71-518f-40f6-a657-e9413ff85172" (UID: "a1560e71-518f-40f6-a657-e9413ff85172"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:47:46.359550 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:46.359526 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1560e71-518f-40f6-a657-e9413ff85172-kube-api-access-c72lt" (OuterVolumeSpecName: "kube-api-access-c72lt") pod "a1560e71-518f-40f6-a657-e9413ff85172" (UID: "a1560e71-518f-40f6-a657-e9413ff85172"). InnerVolumeSpecName "kube-api-access-c72lt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:47:46.458635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:46.458588 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c72lt\" (UniqueName: \"kubernetes.io/projected/a1560e71-518f-40f6-a657-e9413ff85172-kube-api-access-c72lt\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:47:46.458635 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:46.458625 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1560e71-518f-40f6-a657-e9413ff85172-extensions-socket-volume\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:47:47.225509 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:47.225472 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" Jul 01 16:47:47.225509 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:47.225480 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h" event={"ID":"a1560e71-518f-40f6-a657-e9413ff85172","Type":"ContainerDied","Data":"83826d737fa34fcda096d0c0c82de28cad88094430f8266377781178e7a05665"} Jul 01 16:47:47.226013 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:47.225557 2552 scope.go:117] "RemoveContainer" containerID="be90a85e951c066db6df8091359141f6ef96232f1c35da17416b8ece5b40a84a" Jul 01 16:47:47.267404 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:47.267318 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h"] Jul 01 16:47:47.273556 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:47.273528 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9c2h"] Jul 01 16:47:49.008313 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:47:49.008278 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1560e71-518f-40f6-a657-e9413ff85172" path="/var/lib/kubelet/pods/a1560e71-518f-40f6-a657-e9413ff85172/volumes" Jul 01 16:48:02.359876 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.359842 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb"] Jul 01 16:48:02.360297 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.360147 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1560e71-518f-40f6-a657-e9413ff85172" containerName="manager" Jul 01 16:48:02.360297 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.360157 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1560e71-518f-40f6-a657-e9413ff85172" containerName="manager" Jul 01 16:48:02.360297 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.360220 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1560e71-518f-40f6-a657-e9413ff85172" containerName="manager" Jul 01 16:48:02.362937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.362918 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.365800 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.365782 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ngbwx\"" Jul 01 16:48:02.366252 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.366239 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 16:48:02.382949 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.382918 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb"] Jul 01 16:48:02.490798 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.490751 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.490982 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.490832 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kw8t\" (UniqueName: \"kubernetes.io/projected/3542905c-cfde-4b21-9d61-a54ec2692393-kube-api-access-4kw8t\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.490982 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.490864 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.490982 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.490888 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.490982 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.490926 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.490982 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.490942 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3542905c-cfde-4b21-9d61-a54ec2692393-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.490982 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.490957 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3542905c-cfde-4b21-9d61-a54ec2692393-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.491170 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.491012 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.491170 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.491080 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3542905c-cfde-4b21-9d61-a54ec2692393-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.591555 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.591508 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.591555 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.591551 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3542905c-cfde-4b21-9d61-a54ec2692393-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.591805 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.591573 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3542905c-cfde-4b21-9d61-a54ec2692393-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.591805 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.591600 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.591805 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.591624 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3542905c-cfde-4b21-9d61-a54ec2692393-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.591805 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.591656 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.591805 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.591734 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kw8t\" (UniqueName: \"kubernetes.io/projected/3542905c-cfde-4b21-9d61-a54ec2692393-kube-api-access-4kw8t\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.591805 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.591791 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.592087 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.591822 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.592087 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.592052 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.592191 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.592078 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.592259 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.592238 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.592259 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.592248 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.592902 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.592875 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3542905c-cfde-4b21-9d61-a54ec2692393-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.594254 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.594227 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3542905c-cfde-4b21-9d61-a54ec2692393-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.594358 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.594316 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3542905c-cfde-4b21-9d61-a54ec2692393-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.602096 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.602057 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3542905c-cfde-4b21-9d61-a54ec2692393-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.602774 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.602752 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kw8t\" (UniqueName: \"kubernetes.io/projected/3542905c-cfde-4b21-9d61-a54ec2692393-kube-api-access-4kw8t\") pod \"maas-default-gateway-openshift-default-56654dcf7-z9tsb\" (UID: \"3542905c-cfde-4b21-9d61-a54ec2692393\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.673363 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.673267 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:02.818222 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:02.818197 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb"] Jul 01 16:48:02.820708 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:48:02.820677 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3542905c_cfde_4b21_9d61_a54ec2692393.slice/crio-64c9c6904f94a25c48912b76d94605269b51712523b30a1a86b24e4880769bc1 WatchSource:0}: Error finding container 64c9c6904f94a25c48912b76d94605269b51712523b30a1a86b24e4880769bc1: Status 404 returned error can't find the container with id 64c9c6904f94a25c48912b76d94605269b51712523b30a1a86b24e4880769bc1 Jul 01 16:48:03.296462 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:03.296402 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" event={"ID":"3542905c-cfde-4b21-9d61-a54ec2692393","Type":"ContainerStarted","Data":"64c9c6904f94a25c48912b76d94605269b51712523b30a1a86b24e4880769bc1"} Jul 01 16:48:09.378609 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:09.378560 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 16:48:09.379003 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:09.378641 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 16:48:09.379003 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:09.378678 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 16:48:10.330541 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:10.330501 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" event={"ID":"3542905c-cfde-4b21-9d61-a54ec2692393","Type":"ContainerStarted","Data":"2e75374021dd9d3055fa73377b73e251333990ae1f63705a35c400c8a6889b9c"} Jul 01 16:48:10.674588 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:10.674506 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:10.679517 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:10.679492 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:10.703350 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:10.703295 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" podStartSLOduration=2.147618712 podStartE2EDuration="8.703277371s" totalImagesPullingTime="6.555658659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:48:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:48:10.353167242 +0000 UTC m=+571.726565430" watchObservedRunningTime="2026-07-01 16:48:10.703277371 +0000 UTC m=+572.076675558" Jul 01 16:48:11.335206 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:11.335173 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:11.336374 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:11.336356 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:48:14.916832 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:14.916795 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6zkn"] Jul 01 16:48:14.983294 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:14.983260 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6zkn"] Jul 01 16:48:14.983475 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:14.983390 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" Jul 01 16:48:14.984908 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:14.984873 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzg9v\" (UniqueName: \"kubernetes.io/projected/6902b1b5-8280-4f3f-b036-ee825982ee6a-kube-api-access-bzg9v\") pod \"limitador-limitador-64c94fd64f-h6zkn\" (UID: \"6902b1b5-8280-4f3f-b036-ee825982ee6a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" Jul 01 16:48:14.985060 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:14.984948 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6902b1b5-8280-4f3f-b036-ee825982ee6a-config-file\") pod \"limitador-limitador-64c94fd64f-h6zkn\" (UID: \"6902b1b5-8280-4f3f-b036-ee825982ee6a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" Jul 01 16:48:14.986540 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:14.986510 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 16:48:15.031760 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.031717 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6zkn"] Jul 01 16:48:15.086505 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.086431 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzg9v\" (UniqueName: \"kubernetes.io/projected/6902b1b5-8280-4f3f-b036-ee825982ee6a-kube-api-access-bzg9v\") pod \"limitador-limitador-64c94fd64f-h6zkn\" (UID: \"6902b1b5-8280-4f3f-b036-ee825982ee6a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" Jul 01 16:48:15.086680 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.086543 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6902b1b5-8280-4f3f-b036-ee825982ee6a-config-file\") pod \"limitador-limitador-64c94fd64f-h6zkn\" (UID: \"6902b1b5-8280-4f3f-b036-ee825982ee6a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" Jul 01 16:48:15.087191 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.087170 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6902b1b5-8280-4f3f-b036-ee825982ee6a-config-file\") pod \"limitador-limitador-64c94fd64f-h6zkn\" (UID: \"6902b1b5-8280-4f3f-b036-ee825982ee6a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" Jul 01 16:48:15.102230 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.102198 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzg9v\" (UniqueName: \"kubernetes.io/projected/6902b1b5-8280-4f3f-b036-ee825982ee6a-kube-api-access-bzg9v\") pod \"limitador-limitador-64c94fd64f-h6zkn\" (UID: \"6902b1b5-8280-4f3f-b036-ee825982ee6a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" Jul 01 16:48:15.296342 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.296303 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" Jul 01 16:48:15.466974 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.466947 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6zkn"] Jul 01 16:48:15.469687 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:48:15.469658 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6902b1b5_8280_4f3f_b036_ee825982ee6a.slice/crio-2b9c344b21d44ecace941e97361bbc970cb801060449a073c546b3cb1bb18c55 WatchSource:0}: Error finding container 2b9c344b21d44ecace941e97361bbc970cb801060449a073c546b3cb1bb18c55: Status 404 returned error can't find the container with id 2b9c344b21d44ecace941e97361bbc970cb801060449a073c546b3cb1bb18c55 Jul 01 16:48:15.868111 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.868073 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-pkcv6"] Jul 01 16:48:15.872937 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.872909 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pkcv6" Jul 01 16:48:15.875604 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.875583 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gbs6m\"" Jul 01 16:48:15.880893 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.880868 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-pkcv6"] Jul 01 16:48:15.891844 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.891799 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjtqm\" (UniqueName: \"kubernetes.io/projected/18f7b178-553c-49c3-9e14-ca26b8ee7b78-kube-api-access-vjtqm\") pod \"authorino-58cd955675-pkcv6\" (UID: \"18f7b178-553c-49c3-9e14-ca26b8ee7b78\") " pod="kuadrant-system/authorino-58cd955675-pkcv6" Jul 01 16:48:15.992193 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:15.992157 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtqm\" (UniqueName: \"kubernetes.io/projected/18f7b178-553c-49c3-9e14-ca26b8ee7b78-kube-api-access-vjtqm\") pod \"authorino-58cd955675-pkcv6\" (UID: \"18f7b178-553c-49c3-9e14-ca26b8ee7b78\") " pod="kuadrant-system/authorino-58cd955675-pkcv6" Jul 01 16:48:16.005602 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:16.005574 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjtqm\" (UniqueName: \"kubernetes.io/projected/18f7b178-553c-49c3-9e14-ca26b8ee7b78-kube-api-access-vjtqm\") pod \"authorino-58cd955675-pkcv6\" (UID: \"18f7b178-553c-49c3-9e14-ca26b8ee7b78\") " pod="kuadrant-system/authorino-58cd955675-pkcv6" Jul 01 16:48:16.182885 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:16.182797 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pkcv6" Jul 01 16:48:16.328700 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:16.328662 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-pkcv6"] Jul 01 16:48:16.360251 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:16.360208 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" event={"ID":"6902b1b5-8280-4f3f-b036-ee825982ee6a","Type":"ContainerStarted","Data":"2b9c344b21d44ecace941e97361bbc970cb801060449a073c546b3cb1bb18c55"} Jul 01 16:48:16.361395 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:16.361371 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pkcv6" event={"ID":"18f7b178-553c-49c3-9e14-ca26b8ee7b78","Type":"ContainerStarted","Data":"ea12ae05c6b76ece3ae5a7c4e8101c4fa85313fca0020212e37174559c8612c1"} Jul 01 16:48:21.225010 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:21.224925 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-pkcv6"] Jul 01 16:48:21.389881 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:21.389838 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pkcv6" event={"ID":"18f7b178-553c-49c3-9e14-ca26b8ee7b78","Type":"ContainerStarted","Data":"26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09"} Jul 01 16:48:21.391343 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:21.391318 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" event={"ID":"6902b1b5-8280-4f3f-b036-ee825982ee6a","Type":"ContainerStarted","Data":"69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270"} Jul 01 16:48:21.391502 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:21.391475 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" Jul 01 16:48:21.406987 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:21.406938 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-pkcv6" podStartSLOduration=1.92633342 podStartE2EDuration="6.406920443s" totalImagesPullingTime="4.480587023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:48:21.406596358 +0000 UTC m=+582.779994547" watchObservedRunningTime="2026-07-01 16:48:21.406920443 +0000 UTC m=+582.780318626" Jul 01 16:48:21.434741 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:21.434683 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" podStartSLOduration=2.091839915 podStartE2EDuration="7.434666752s" totalImagesPullingTime="5.342826837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:48:21.434333833 +0000 UTC m=+582.807732021" watchObservedRunningTime="2026-07-01 16:48:21.434666752 +0000 UTC m=+582.808064983" Jul 01 16:48:22.396023 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:22.395975 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-pkcv6" podUID="18f7b178-553c-49c3-9e14-ca26b8ee7b78" containerName="authorino" containerID="cri-o://26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09" gracePeriod=30 Jul 01 16:48:22.645578 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:22.645547 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pkcv6" Jul 01 16:48:22.743636 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:22.743607 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjtqm\" (UniqueName: \"kubernetes.io/projected/18f7b178-553c-49c3-9e14-ca26b8ee7b78-kube-api-access-vjtqm\") pod \"18f7b178-553c-49c3-9e14-ca26b8ee7b78\" (UID: \"18f7b178-553c-49c3-9e14-ca26b8ee7b78\") " Jul 01 16:48:22.745864 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:22.745830 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18f7b178-553c-49c3-9e14-ca26b8ee7b78-kube-api-access-vjtqm" (OuterVolumeSpecName: "kube-api-access-vjtqm") pod "18f7b178-553c-49c3-9e14-ca26b8ee7b78" (UID: "18f7b178-553c-49c3-9e14-ca26b8ee7b78"). InnerVolumeSpecName "kube-api-access-vjtqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:48:22.844871 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:22.844832 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjtqm\" (UniqueName: \"kubernetes.io/projected/18f7b178-553c-49c3-9e14-ca26b8ee7b78-kube-api-access-vjtqm\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:48:23.401105 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:23.401004 2552 generic.go:356] "Generic (PLEG): container finished" podID="18f7b178-553c-49c3-9e14-ca26b8ee7b78" containerID="26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09" exitCode=0 Jul 01 16:48:23.401105 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:23.401042 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pkcv6" Jul 01 16:48:23.401105 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:23.401088 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pkcv6" event={"ID":"18f7b178-553c-49c3-9e14-ca26b8ee7b78","Type":"ContainerDied","Data":"26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09"} Jul 01 16:48:23.401649 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:23.401135 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pkcv6" event={"ID":"18f7b178-553c-49c3-9e14-ca26b8ee7b78","Type":"ContainerDied","Data":"ea12ae05c6b76ece3ae5a7c4e8101c4fa85313fca0020212e37174559c8612c1"} Jul 01 16:48:23.401649 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:23.401151 2552 scope.go:117] "RemoveContainer" containerID="26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09" Jul 01 16:48:23.409725 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:23.409687 2552 scope.go:117] "RemoveContainer" containerID="26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09" Jul 01 16:48:23.410043 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:48:23.410019 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09\": container with ID starting with 26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09 not found: ID does not exist" containerID="26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09" Jul 01 16:48:23.410146 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:23.410050 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09"} err="failed to get container status \"26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09\": rpc error: code = NotFound desc = could not find container \"26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09\": container with ID starting with 26746ac3046147ed5edef7a485c2a82b33d4aad00960bb9e03ee9fde1dd44c09 not found: ID does not exist" Jul 01 16:48:23.420882 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:23.420855 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-pkcv6"] Jul 01 16:48:23.430135 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:23.430110 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-pkcv6"] Jul 01 16:48:25.004129 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:25.004092 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18f7b178-553c-49c3-9e14-ca26b8ee7b78" path="/var/lib/kubelet/pods/18f7b178-553c-49c3-9e14-ca26b8ee7b78/volumes" Jul 01 16:48:32.251292 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:32.251253 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6zkn"] Jul 01 16:48:32.251846 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:32.251478 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" podUID="6902b1b5-8280-4f3f-b036-ee825982ee6a" containerName="limitador" containerID="cri-o://69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270" gracePeriod=30 Jul 01 16:48:32.252205 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:32.252144 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" Jul 01 16:48:32.794371 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:32.794344 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" Jul 01 16:48:32.821293 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:32.821211 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzg9v\" (UniqueName: \"kubernetes.io/projected/6902b1b5-8280-4f3f-b036-ee825982ee6a-kube-api-access-bzg9v\") pod \"6902b1b5-8280-4f3f-b036-ee825982ee6a\" (UID: \"6902b1b5-8280-4f3f-b036-ee825982ee6a\") " Jul 01 16:48:32.821293 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:32.821291 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6902b1b5-8280-4f3f-b036-ee825982ee6a-config-file\") pod \"6902b1b5-8280-4f3f-b036-ee825982ee6a\" (UID: \"6902b1b5-8280-4f3f-b036-ee825982ee6a\") " Jul 01 16:48:32.821674 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:32.821654 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6902b1b5-8280-4f3f-b036-ee825982ee6a-config-file" (OuterVolumeSpecName: "config-file") pod "6902b1b5-8280-4f3f-b036-ee825982ee6a" (UID: "6902b1b5-8280-4f3f-b036-ee825982ee6a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:48:32.823812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:32.823786 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6902b1b5-8280-4f3f-b036-ee825982ee6a-kube-api-access-bzg9v" (OuterVolumeSpecName: "kube-api-access-bzg9v") pod "6902b1b5-8280-4f3f-b036-ee825982ee6a" (UID: "6902b1b5-8280-4f3f-b036-ee825982ee6a"). InnerVolumeSpecName "kube-api-access-bzg9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:48:32.922482 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:32.922421 2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6902b1b5-8280-4f3f-b036-ee825982ee6a-config-file\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:48:32.922482 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:32.922474 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzg9v\" (UniqueName: \"kubernetes.io/projected/6902b1b5-8280-4f3f-b036-ee825982ee6a-kube-api-access-bzg9v\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:48:33.446618 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:33.446582 2552 generic.go:356] "Generic (PLEG): container finished" podID="6902b1b5-8280-4f3f-b036-ee825982ee6a" containerID="69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270" exitCode=0 Jul 01 16:48:33.447062 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:33.446631 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" Jul 01 16:48:33.447062 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:33.446669 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" event={"ID":"6902b1b5-8280-4f3f-b036-ee825982ee6a","Type":"ContainerDied","Data":"69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270"} Jul 01 16:48:33.447062 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:33.446721 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h6zkn" event={"ID":"6902b1b5-8280-4f3f-b036-ee825982ee6a","Type":"ContainerDied","Data":"2b9c344b21d44ecace941e97361bbc970cb801060449a073c546b3cb1bb18c55"} Jul 01 16:48:33.447062 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:33.446745 2552 scope.go:117] "RemoveContainer" containerID="69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270" Jul 01 16:48:33.455190 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:33.455164 2552 scope.go:117] "RemoveContainer" containerID="69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270" Jul 01 16:48:33.455620 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:48:33.455597 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270\": container with ID starting with 69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270 not found: ID does not exist" containerID="69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270" Jul 01 16:48:33.455743 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:33.455628 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270"} err="failed to get container status \"69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270\": rpc error: code = NotFound desc = could not find container \"69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270\": container with ID starting with 69301c43ceead75a246a4879abac8033ed2fa8bced0888b92ffdef30373f1270 not found: ID does not exist" Jul 01 16:48:33.466801 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:33.466768 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6zkn"] Jul 01 16:48:33.472112 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:33.472079 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h6zkn"] Jul 01 16:48:35.003933 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:35.003898 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6902b1b5-8280-4f3f-b036-ee825982ee6a" path="/var/lib/kubelet/pods/6902b1b5-8280-4f3f-b036-ee825982ee6a/volumes" Jul 01 16:48:38.108155 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.108118 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-lkmdz"] Jul 01 16:48:38.108593 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.108492 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18f7b178-553c-49c3-9e14-ca26b8ee7b78" containerName="authorino" Jul 01 16:48:38.108593 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.108508 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="18f7b178-553c-49c3-9e14-ca26b8ee7b78" containerName="authorino" Jul 01 16:48:38.108593 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.108516 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6902b1b5-8280-4f3f-b036-ee825982ee6a" containerName="limitador" Jul 01 16:48:38.108593 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.108522 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6902b1b5-8280-4f3f-b036-ee825982ee6a" containerName="limitador" Jul 01 16:48:38.108593 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.108577 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="18f7b178-553c-49c3-9e14-ca26b8ee7b78" containerName="authorino" Jul 01 16:48:38.108593 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.108589 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6902b1b5-8280-4f3f-b036-ee825982ee6a" containerName="limitador" Jul 01 16:48:38.112902 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.112882 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lkmdz" Jul 01 16:48:38.115932 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.115905 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 01 16:48:38.116068 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.115936 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7gbbm\"" Jul 01 16:48:38.120707 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.120678 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lkmdz"] Jul 01 16:48:38.168477 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.168400 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c2400604-bfaf-4e66-8276-bd3173d11509-data\") pod \"postgres-69fb4594cf-lkmdz\" (UID: \"c2400604-bfaf-4e66-8276-bd3173d11509\") " pod="opendatahub/postgres-69fb4594cf-lkmdz" Jul 01 16:48:38.168642 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.168494 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxn4p\" (UniqueName: \"kubernetes.io/projected/c2400604-bfaf-4e66-8276-bd3173d11509-kube-api-access-zxn4p\") pod \"postgres-69fb4594cf-lkmdz\" (UID: \"c2400604-bfaf-4e66-8276-bd3173d11509\") " pod="opendatahub/postgres-69fb4594cf-lkmdz" Jul 01 16:48:38.269254 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.269217 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c2400604-bfaf-4e66-8276-bd3173d11509-data\") pod \"postgres-69fb4594cf-lkmdz\" (UID: \"c2400604-bfaf-4e66-8276-bd3173d11509\") " pod="opendatahub/postgres-69fb4594cf-lkmdz" Jul 01 16:48:38.269254 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.269254 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxn4p\" (UniqueName: \"kubernetes.io/projected/c2400604-bfaf-4e66-8276-bd3173d11509-kube-api-access-zxn4p\") pod \"postgres-69fb4594cf-lkmdz\" (UID: \"c2400604-bfaf-4e66-8276-bd3173d11509\") " pod="opendatahub/postgres-69fb4594cf-lkmdz" Jul 01 16:48:38.269665 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.269645 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c2400604-bfaf-4e66-8276-bd3173d11509-data\") pod \"postgres-69fb4594cf-lkmdz\" (UID: \"c2400604-bfaf-4e66-8276-bd3173d11509\") " pod="opendatahub/postgres-69fb4594cf-lkmdz" Jul 01 16:48:38.283686 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.283652 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxn4p\" (UniqueName: \"kubernetes.io/projected/c2400604-bfaf-4e66-8276-bd3173d11509-kube-api-access-zxn4p\") pod \"postgres-69fb4594cf-lkmdz\" (UID: \"c2400604-bfaf-4e66-8276-bd3173d11509\") " pod="opendatahub/postgres-69fb4594cf-lkmdz" Jul 01 16:48:38.423752 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.423661 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lkmdz" Jul 01 16:48:38.564693 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:38.564667 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lkmdz"] Jul 01 16:48:38.566769 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:48:38.566741 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2400604_bfaf_4e66_8276_bd3173d11509.slice/crio-684f508abaf195734032ba4240250e1ddc4bdbf4177b744118638be9321b8f75 WatchSource:0}: Error finding container 684f508abaf195734032ba4240250e1ddc4bdbf4177b744118638be9321b8f75: Status 404 returned error can't find the container with id 684f508abaf195734032ba4240250e1ddc4bdbf4177b744118638be9321b8f75 Jul 01 16:48:39.475350 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:39.475254 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lkmdz" event={"ID":"c2400604-bfaf-4e66-8276-bd3173d11509","Type":"ContainerStarted","Data":"684f508abaf195734032ba4240250e1ddc4bdbf4177b744118638be9321b8f75"} Jul 01 16:48:46.568364 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:46.568332 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 01 16:48:47.514311 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:47.514271 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lkmdz" event={"ID":"c2400604-bfaf-4e66-8276-bd3173d11509","Type":"ContainerStarted","Data":"0291d63e929eaa515c592855803621b2e9aff4fd6cced8d755849c63323afada"} Jul 01 16:48:47.514518 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:47.514378 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-lkmdz" Jul 01 16:48:47.533620 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:47.533536 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-lkmdz" podStartSLOduration=1.536748864 podStartE2EDuration="9.533517913s" totalImagesPullingTime="7.996769049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:48:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:48:47.532858541 +0000 UTC m=+608.906256727" watchObservedRunningTime="2026-07-01 16:48:47.533517913 +0000 UTC m=+608.906916099" Jul 01 16:48:53.548957 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:48:53.548925 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-lkmdz" Jul 01 16:49:08.037527 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:08.037424 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-2l6zm"] Jul 01 16:49:08.040750 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:08.040729 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-2l6zm" Jul 01 16:49:08.043987 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:08.043960 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 16:49:08.044127 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:08.043962 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 16:49:08.044127 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:08.044039 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-mrwjr\"" Jul 01 16:49:08.050756 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:08.050728 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-2l6zm"] Jul 01 16:49:08.124594 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:08.124548 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zv6j\" (UniqueName: \"kubernetes.io/projected/692cc293-d1f5-4c15-b5d1-2a6a1c53f4fc-kube-api-access-7zv6j\") pod \"keycloak-operator-d8b9d7b4d-2l6zm\" (UID: \"692cc293-d1f5-4c15-b5d1-2a6a1c53f4fc\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-2l6zm" Jul 01 16:49:08.225504 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:08.225466 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zv6j\" (UniqueName: \"kubernetes.io/projected/692cc293-d1f5-4c15-b5d1-2a6a1c53f4fc-kube-api-access-7zv6j\") pod \"keycloak-operator-d8b9d7b4d-2l6zm\" (UID: \"692cc293-d1f5-4c15-b5d1-2a6a1c53f4fc\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-2l6zm" Jul 01 16:49:08.236550 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:08.236521 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zv6j\" (UniqueName: \"kubernetes.io/projected/692cc293-d1f5-4c15-b5d1-2a6a1c53f4fc-kube-api-access-7zv6j\") pod \"keycloak-operator-d8b9d7b4d-2l6zm\" (UID: \"692cc293-d1f5-4c15-b5d1-2a6a1c53f4fc\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-2l6zm" Jul 01 16:49:08.351678 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:08.351591 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-2l6zm" Jul 01 16:49:08.490510 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:08.490481 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-2l6zm"] Jul 01 16:49:08.492733 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:49:08.492695 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692cc293_d1f5_4c15_b5d1_2a6a1c53f4fc.slice/crio-078b6a4b30e0496400aa92fc2b14413a310271d4ab29a86d0e3c4489d10f9415 WatchSource:0}: Error finding container 078b6a4b30e0496400aa92fc2b14413a310271d4ab29a86d0e3c4489d10f9415: Status 404 returned error can't find the container with id 078b6a4b30e0496400aa92fc2b14413a310271d4ab29a86d0e3c4489d10f9415 Jul 01 16:49:08.605287 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:08.605203 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-2l6zm" event={"ID":"692cc293-d1f5-4c15-b5d1-2a6a1c53f4fc","Type":"ContainerStarted","Data":"078b6a4b30e0496400aa92fc2b14413a310271d4ab29a86d0e3c4489d10f9415"} Jul 01 16:49:15.647496 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:15.647430 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-2l6zm" event={"ID":"692cc293-d1f5-4c15-b5d1-2a6a1c53f4fc","Type":"ContainerStarted","Data":"1ca20320b31443b47f2217e791e18ceb78322354071d20dfe8e2f910e0fbbc6f"} Jul 01 16:49:15.667255 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:15.667169 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-2l6zm" podStartSLOduration=1.487141583 podStartE2EDuration="7.667147859s" totalImagesPullingTime="6.180006276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:49:15.666080071 +0000 UTC m=+637.039478270" watchObservedRunningTime="2026-07-01 16:49:15.667147859 +0000 UTC m=+637.040546048" Jul 01 16:49:54.457168 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.457133 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qrszx"] Jul 01 16:49:54.463977 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.463946 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qrszx" Jul 01 16:49:54.467431 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.467402 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gbs6m\"" Jul 01 16:49:54.469509 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.469481 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qrszx"] Jul 01 16:49:54.514302 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.514260 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxn7l\" (UniqueName: \"kubernetes.io/projected/62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98-kube-api-access-sxn7l\") pod \"authorino-5d4b67c446-qrszx\" (UID: \"62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98\") " pod="kuadrant-system/authorino-5d4b67c446-qrszx" Jul 01 16:49:54.615210 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.615174 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxn7l\" (UniqueName: \"kubernetes.io/projected/62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98-kube-api-access-sxn7l\") pod \"authorino-5d4b67c446-qrszx\" (UID: \"62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98\") " pod="kuadrant-system/authorino-5d4b67c446-qrszx" Jul 01 16:49:54.625397 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.625355 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxn7l\" (UniqueName: \"kubernetes.io/projected/62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98-kube-api-access-sxn7l\") pod \"authorino-5d4b67c446-qrszx\" (UID: \"62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98\") " pod="kuadrant-system/authorino-5d4b67c446-qrszx" Jul 01 16:49:54.676325 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.676289 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qrszx"] Jul 01 16:49:54.676564 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.676550 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qrszx" Jul 01 16:49:54.705704 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.705670 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d8d57cd54-b88kb"] Jul 01 16:49:54.709073 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.709007 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d8d57cd54-b88kb" Jul 01 16:49:54.717975 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.717949 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d8d57cd54-b88kb"] Jul 01 16:49:54.815014 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.814984 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d8d57cd54-b88kb"] Jul 01 16:49:54.815264 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:49:54.815241 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2jv76], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7d8d57cd54-b88kb" podUID="7d3f884c-cc66-416a-b8ed-0f3348dae81c" Jul 01 16:49:54.816535 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.816509 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jv76\" (UniqueName: \"kubernetes.io/projected/7d3f884c-cc66-416a-b8ed-0f3348dae81c-kube-api-access-2jv76\") pod \"authorino-7d8d57cd54-b88kb\" (UID: \"7d3f884c-cc66-416a-b8ed-0f3348dae81c\") " pod="kuadrant-system/authorino-7d8d57cd54-b88kb" Jul 01 16:49:54.833018 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.832986 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qrszx"] Jul 01 16:49:54.837035 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:49:54.837005 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62a7c9f5_fa2c_4d71_afa9_4e9ec020cc98.slice/crio-051047e12b6621aba8745a3550f83c00c35d4ba78c9b348a59f1efbc9bf622c3 WatchSource:0}: Error finding container 051047e12b6621aba8745a3550f83c00c35d4ba78c9b348a59f1efbc9bf622c3: Status 404 returned error can't find the container with id 051047e12b6621aba8745a3550f83c00c35d4ba78c9b348a59f1efbc9bf622c3 Jul 01 16:49:54.838388 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.838369 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:49:54.846360 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.846328 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7569dc458-nng7p"] Jul 01 16:49:54.849665 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.849645 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7569dc458-nng7p" Jul 01 16:49:54.852531 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.852430 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 01 16:49:54.859717 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.859691 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7569dc458-nng7p"] Jul 01 16:49:54.917471 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.917402 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d021921-2095-413f-9692-a29d31547bc1-tls-cert\") pod \"authorino-7569dc458-nng7p\" (UID: \"4d021921-2095-413f-9692-a29d31547bc1\") " pod="kuadrant-system/authorino-7569dc458-nng7p" Jul 01 16:49:54.917726 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.917486 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jv76\" (UniqueName: \"kubernetes.io/projected/7d3f884c-cc66-416a-b8ed-0f3348dae81c-kube-api-access-2jv76\") pod \"authorino-7d8d57cd54-b88kb\" (UID: \"7d3f884c-cc66-416a-b8ed-0f3348dae81c\") " pod="kuadrant-system/authorino-7d8d57cd54-b88kb" Jul 01 16:49:54.917726 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.917517 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb2jw\" (UniqueName: \"kubernetes.io/projected/4d021921-2095-413f-9692-a29d31547bc1-kube-api-access-pb2jw\") pod \"authorino-7569dc458-nng7p\" (UID: \"4d021921-2095-413f-9692-a29d31547bc1\") " pod="kuadrant-system/authorino-7569dc458-nng7p" Jul 01 16:49:54.931595 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:54.931558 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jv76\" (UniqueName: \"kubernetes.io/projected/7d3f884c-cc66-416a-b8ed-0f3348dae81c-kube-api-access-2jv76\") pod \"authorino-7d8d57cd54-b88kb\" (UID: \"7d3f884c-cc66-416a-b8ed-0f3348dae81c\") " pod="kuadrant-system/authorino-7d8d57cd54-b88kb" Jul 01 16:49:55.018671 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.018634 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb2jw\" (UniqueName: \"kubernetes.io/projected/4d021921-2095-413f-9692-a29d31547bc1-kube-api-access-pb2jw\") pod \"authorino-7569dc458-nng7p\" (UID: \"4d021921-2095-413f-9692-a29d31547bc1\") " pod="kuadrant-system/authorino-7569dc458-nng7p" Jul 01 16:49:55.018870 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.018689 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d021921-2095-413f-9692-a29d31547bc1-tls-cert\") pod \"authorino-7569dc458-nng7p\" (UID: \"4d021921-2095-413f-9692-a29d31547bc1\") " pod="kuadrant-system/authorino-7569dc458-nng7p" Jul 01 16:49:55.021286 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.021261 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d021921-2095-413f-9692-a29d31547bc1-tls-cert\") pod \"authorino-7569dc458-nng7p\" (UID: \"4d021921-2095-413f-9692-a29d31547bc1\") " pod="kuadrant-system/authorino-7569dc458-nng7p" Jul 01 16:49:55.028108 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.028072 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb2jw\" (UniqueName: \"kubernetes.io/projected/4d021921-2095-413f-9692-a29d31547bc1-kube-api-access-pb2jw\") pod \"authorino-7569dc458-nng7p\" (UID: \"4d021921-2095-413f-9692-a29d31547bc1\") " pod="kuadrant-system/authorino-7569dc458-nng7p" Jul 01 16:49:55.160394 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.160354 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7569dc458-nng7p" Jul 01 16:49:55.311963 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.311816 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7569dc458-nng7p"] Jul 01 16:49:55.314126 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:49:55.314079 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d021921_2095_413f_9692_a29d31547bc1.slice/crio-341629f86be70c866d725461c715e704901e2091422002d1711eaa3de7428520 WatchSource:0}: Error finding container 341629f86be70c866d725461c715e704901e2091422002d1711eaa3de7428520: Status 404 returned error can't find the container with id 341629f86be70c866d725461c715e704901e2091422002d1711eaa3de7428520 Jul 01 16:49:55.822506 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.822475 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7569dc458-nng7p" event={"ID":"4d021921-2095-413f-9692-a29d31547bc1","Type":"ContainerStarted","Data":"341629f86be70c866d725461c715e704901e2091422002d1711eaa3de7428520"} Jul 01 16:49:55.824232 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.824195 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qrszx" event={"ID":"62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98","Type":"ContainerStarted","Data":"6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1"} Jul 01 16:49:55.824379 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.824235 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d8d57cd54-b88kb" Jul 01 16:49:55.824379 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.824245 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qrszx" event={"ID":"62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98","Type":"ContainerStarted","Data":"051047e12b6621aba8745a3550f83c00c35d4ba78c9b348a59f1efbc9bf622c3"} Jul 01 16:49:55.824379 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.824289 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-qrszx" podUID="62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98" containerName="authorino" containerID="cri-o://6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1" gracePeriod=30 Jul 01 16:49:55.833044 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.833021 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d8d57cd54-b88kb" Jul 01 16:49:55.840978 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.840934 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-qrszx" podStartSLOduration=1.417999982 podStartE2EDuration="1.84091568s" totalImagesPullingTime="422.915698ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:49:55.839931225 +0000 UTC m=+677.213329411" watchObservedRunningTime="2026-07-01 16:49:55.84091568 +0000 UTC m=+677.214313866" Jul 01 16:49:55.924914 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.924881 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jv76\" (UniqueName: \"kubernetes.io/projected/7d3f884c-cc66-416a-b8ed-0f3348dae81c-kube-api-access-2jv76\") pod \"7d3f884c-cc66-416a-b8ed-0f3348dae81c\" (UID: \"7d3f884c-cc66-416a-b8ed-0f3348dae81c\") " Jul 01 16:49:55.927215 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:55.927188 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3f884c-cc66-416a-b8ed-0f3348dae81c-kube-api-access-2jv76" (OuterVolumeSpecName: "kube-api-access-2jv76") pod "7d3f884c-cc66-416a-b8ed-0f3348dae81c" (UID: "7d3f884c-cc66-416a-b8ed-0f3348dae81c"). InnerVolumeSpecName "kube-api-access-2jv76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:49:56.026491 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.026429 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jv76\" (UniqueName: \"kubernetes.io/projected/7d3f884c-cc66-416a-b8ed-0f3348dae81c-kube-api-access-2jv76\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:49:56.072720 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.072693 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qrszx" Jul 01 16:49:56.127522 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.127484 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxn7l\" (UniqueName: \"kubernetes.io/projected/62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98-kube-api-access-sxn7l\") pod \"62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98\" (UID: \"62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98\") " Jul 01 16:49:56.129711 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.129690 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98-kube-api-access-sxn7l" (OuterVolumeSpecName: "kube-api-access-sxn7l") pod "62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98" (UID: "62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98"). InnerVolumeSpecName "kube-api-access-sxn7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:49:56.228085 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.228050 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxn7l\" (UniqueName: \"kubernetes.io/projected/62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98-kube-api-access-sxn7l\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:49:56.830167 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.830135 2552 generic.go:356] "Generic (PLEG): container finished" podID="62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98" containerID="6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1" exitCode=0 Jul 01 16:49:56.830631 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.830177 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qrszx" Jul 01 16:49:56.830631 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.830217 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qrszx" event={"ID":"62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98","Type":"ContainerDied","Data":"6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1"} Jul 01 16:49:56.830631 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.830257 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qrszx" event={"ID":"62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98","Type":"ContainerDied","Data":"051047e12b6621aba8745a3550f83c00c35d4ba78c9b348a59f1efbc9bf622c3"} Jul 01 16:49:56.830631 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.830280 2552 scope.go:117] "RemoveContainer" containerID="6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1" Jul 01 16:49:56.831907 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.831885 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7569dc458-nng7p" event={"ID":"4d021921-2095-413f-9692-a29d31547bc1","Type":"ContainerStarted","Data":"facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829"} Jul 01 16:49:56.832016 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.831893 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d8d57cd54-b88kb" Jul 01 16:49:56.839960 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.839938 2552 scope.go:117] "RemoveContainer" containerID="6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1" Jul 01 16:49:56.840319 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:49:56.840301 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1\": container with ID starting with 6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1 not found: ID does not exist" containerID="6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1" Jul 01 16:49:56.840383 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.840329 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1"} err="failed to get container status \"6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1\": rpc error: code = NotFound desc = could not find container \"6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1\": container with ID starting with 6645f14bf3a571f1712663506bd1624c2862dc301e6999716c218f5cf7da93e1 not found: ID does not exist" Jul 01 16:49:56.857671 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.857611 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7569dc458-nng7p" podStartSLOduration=2.39532112 podStartE2EDuration="2.857593169s" totalImagesPullingTime="462.272049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:49:56.856838587 +0000 UTC m=+678.230236775" watchObservedRunningTime="2026-07-01 16:49:56.857593169 +0000 UTC m=+678.230991356" Jul 01 16:49:56.873150 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.873108 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qrszx"] Jul 01 16:49:56.879132 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.879102 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qrszx"] Jul 01 16:49:56.905794 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.905720 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d8d57cd54-b88kb"] Jul 01 16:49:56.913173 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:56.913141 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d8d57cd54-b88kb"] Jul 01 16:49:57.005201 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:57.005165 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98" path="/var/lib/kubelet/pods/62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98/volumes" Jul 01 16:49:57.005546 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:49:57.005532 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d3f884c-cc66-416a-b8ed-0f3348dae81c" path="/var/lib/kubelet/pods/7d3f884c-cc66-416a-b8ed-0f3348dae81c/volumes" Jul 01 16:50:36.736801 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.736709 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-xbpkz"] Jul 01 16:50:36.737236 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.737069 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98" containerName="authorino" Jul 01 16:50:36.737236 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.737081 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98" containerName="authorino" Jul 01 16:50:36.737236 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.737145 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a7c9f5-fa2c-4d71-afa9-4e9ec020cc98" containerName="authorino" Jul 01 16:50:36.740094 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.740071 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:50:36.743135 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.743110 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 01 16:50:36.743274 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.743112 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gskxw\"" Jul 01 16:50:36.751750 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.751720 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-xbpkz"] Jul 01 16:50:36.780812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.780778 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40eba6a7-f73f-4006-adc0-5a35b351fb54-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-xbpkz\" (UID: \"40eba6a7-f73f-4006-adc0-5a35b351fb54\") " pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:50:36.780812 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.780815 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx7sl\" (UniqueName: \"kubernetes.io/projected/40eba6a7-f73f-4006-adc0-5a35b351fb54-kube-api-access-vx7sl\") pod \"payload-processing-7bbcb654f4-xbpkz\" (UID: \"40eba6a7-f73f-4006-adc0-5a35b351fb54\") " pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:50:36.881711 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.881672 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40eba6a7-f73f-4006-adc0-5a35b351fb54-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-xbpkz\" (UID: \"40eba6a7-f73f-4006-adc0-5a35b351fb54\") " pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:50:36.881891 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.881727 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx7sl\" (UniqueName: \"kubernetes.io/projected/40eba6a7-f73f-4006-adc0-5a35b351fb54-kube-api-access-vx7sl\") pod \"payload-processing-7bbcb654f4-xbpkz\" (UID: \"40eba6a7-f73f-4006-adc0-5a35b351fb54\") " pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:50:36.882384 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.882364 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40eba6a7-f73f-4006-adc0-5a35b351fb54-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-xbpkz\" (UID: \"40eba6a7-f73f-4006-adc0-5a35b351fb54\") " pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:50:36.891875 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:36.891843 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx7sl\" (UniqueName: \"kubernetes.io/projected/40eba6a7-f73f-4006-adc0-5a35b351fb54-kube-api-access-vx7sl\") pod \"payload-processing-7bbcb654f4-xbpkz\" (UID: \"40eba6a7-f73f-4006-adc0-5a35b351fb54\") " pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:50:37.052411 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:37.052321 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:50:37.201513 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:37.201480 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-xbpkz"] Jul 01 16:50:37.205198 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:50:37.205143 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40eba6a7_f73f_4006_adc0_5a35b351fb54.slice/crio-2b9a2157e0c99bf7b0d48c39ad4fc7003d5e1c76c4e295b1343c4e3a2219a7fd WatchSource:0}: Error finding container 2b9a2157e0c99bf7b0d48c39ad4fc7003d5e1c76c4e295b1343c4e3a2219a7fd: Status 404 returned error can't find the container with id 2b9a2157e0c99bf7b0d48c39ad4fc7003d5e1c76c4e295b1343c4e3a2219a7fd Jul 01 16:50:38.023711 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:38.023665 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" event={"ID":"40eba6a7-f73f-4006-adc0-5a35b351fb54","Type":"ContainerStarted","Data":"2b9a2157e0c99bf7b0d48c39ad4fc7003d5e1c76c4e295b1343c4e3a2219a7fd"} Jul 01 16:50:41.038917 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:41.038880 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" event={"ID":"40eba6a7-f73f-4006-adc0-5a35b351fb54","Type":"ContainerStarted","Data":"d12141297f6f19830abcb261d4cb26b2a00e7b2b875430479f6fcd5d6c904b16"} Jul 01 16:50:41.039321 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:41.038961 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:50:41.059056 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:41.057964 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" podStartSLOduration=2.225821625 podStartE2EDuration="5.057943281s" totalImagesPullingTime="2.832121656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:50:41.057612211 +0000 UTC m=+722.431010417" watchObservedRunningTime="2026-07-01 16:50:41.057943281 +0000 UTC m=+722.431341469" Jul 01 16:50:45.060896 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:45.060863 2552 generic.go:356] "Generic (PLEG): container finished" podID="3542905c-cfde-4b21-9d61-a54ec2692393" containerID="2e75374021dd9d3055fa73377b73e251333990ae1f63705a35c400c8a6889b9c" exitCode=0 Jul 01 16:50:45.061314 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:45.060928 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" event={"ID":"3542905c-cfde-4b21-9d61-a54ec2692393","Type":"ContainerDied","Data":"2e75374021dd9d3055fa73377b73e251333990ae1f63705a35c400c8a6889b9c"} Jul 01 16:50:45.061314 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:45.061274 2552 scope.go:117] "RemoveContainer" containerID="2e75374021dd9d3055fa73377b73e251333990ae1f63705a35c400c8a6889b9c" Jul 01 16:50:45.062221 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:45.062192 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 16:50:45.062280 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:45.062264 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 16:50:45.062326 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:45.062295 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 01 16:50:46.067595 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:46.067561 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" event={"ID":"3542905c-cfde-4b21-9d61-a54ec2692393","Type":"ContainerStarted","Data":"b5a339ff2652c38fe565d7a144cdfaad472aac9d120d79684c3127de42f97b10"} Jul 01 16:50:46.674040 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:46.674002 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:50:46.674282 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:46.674255 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-z9tsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 01 16:50:46.674367 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:46.674327 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" podUID="3542905c-cfde-4b21-9d61-a54ec2692393" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 01 16:50:47.674652 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:47.674613 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-z9tsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 01 16:50:47.675058 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:47.674683 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" podUID="3542905c-cfde-4b21-9d61-a54ec2692393" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 01 16:50:48.673833 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:48.673788 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-z9tsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 01 16:50:48.674026 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:48.673841 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" podUID="3542905c-cfde-4b21-9d61-a54ec2692393" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 01 16:50:49.674083 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:49.674046 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-z9tsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 01 16:50:49.674533 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:49.674131 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" podUID="3542905c-cfde-4b21-9d61-a54ec2692393" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 01 16:50:50.678643 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:50.678614 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:50:50.679065 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:50.678914 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:50:50.679753 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:50.679732 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z9tsb" Jul 01 16:50:52.046839 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:50:52.046803 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:51:26.355501 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.355456 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-648f55b6b8-t946f"] Jul 01 16:51:26.358935 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.358911 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:51:26.362491 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.362465 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 01 16:51:26.367698 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.367672 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-648f55b6b8-t946f"] Jul 01 16:51:26.435384 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.435346 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4a4762ae-d4f2-46c3-a7cd-be48084c8221-oidc-ca\") pod \"authorino-648f55b6b8-t946f\" (UID: \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\") " pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:51:26.435618 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.435405 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a4762ae-d4f2-46c3-a7cd-be48084c8221-tls-cert\") pod \"authorino-648f55b6b8-t946f\" (UID: \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\") " pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:51:26.435618 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.435538 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6rqq\" (UniqueName: \"kubernetes.io/projected/4a4762ae-d4f2-46c3-a7cd-be48084c8221-kube-api-access-n6rqq\") pod \"authorino-648f55b6b8-t946f\" (UID: \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\") " pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:51:26.536619 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.536522 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a4762ae-d4f2-46c3-a7cd-be48084c8221-tls-cert\") pod \"authorino-648f55b6b8-t946f\" (UID: \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\") " pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:51:26.536820 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.536704 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6rqq\" (UniqueName: \"kubernetes.io/projected/4a4762ae-d4f2-46c3-a7cd-be48084c8221-kube-api-access-n6rqq\") pod \"authorino-648f55b6b8-t946f\" (UID: \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\") " pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:51:26.536820 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.536750 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4a4762ae-d4f2-46c3-a7cd-be48084c8221-oidc-ca\") pod \"authorino-648f55b6b8-t946f\" (UID: \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\") " pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:51:26.537363 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.537343 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4a4762ae-d4f2-46c3-a7cd-be48084c8221-oidc-ca\") pod \"authorino-648f55b6b8-t946f\" (UID: \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\") " pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:51:26.539077 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.539056 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a4762ae-d4f2-46c3-a7cd-be48084c8221-tls-cert\") pod \"authorino-648f55b6b8-t946f\" (UID: \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\") " pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:51:26.548840 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.548814 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6rqq\" (UniqueName: \"kubernetes.io/projected/4a4762ae-d4f2-46c3-a7cd-be48084c8221-kube-api-access-n6rqq\") pod \"authorino-648f55b6b8-t946f\" (UID: \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\") " pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:51:26.669509 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.669394 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:51:26.810557 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:26.810528 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-648f55b6b8-t946f"] Jul 01 16:51:26.813113 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:51:26.813086 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a4762ae_d4f2_46c3_a7cd_be48084c8221.slice/crio-e47695fa804d782da2f2cb733e54a484d02a1b3b92e14a2f966f2ee1698cb1d0 WatchSource:0}: Error finding container e47695fa804d782da2f2cb733e54a484d02a1b3b92e14a2f966f2ee1698cb1d0: Status 404 returned error can't find the container with id e47695fa804d782da2f2cb733e54a484d02a1b3b92e14a2f966f2ee1698cb1d0 Jul 01 16:51:27.253304 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:27.253268 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-648f55b6b8-t946f" event={"ID":"4a4762ae-d4f2-46c3-a7cd-be48084c8221","Type":"ContainerStarted","Data":"e47695fa804d782da2f2cb733e54a484d02a1b3b92e14a2f966f2ee1698cb1d0"} Jul 01 16:51:28.260183 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:28.260148 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-648f55b6b8-t946f" event={"ID":"4a4762ae-d4f2-46c3-a7cd-be48084c8221","Type":"ContainerStarted","Data":"adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775"} Jul 01 16:51:28.280292 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:28.280237 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-648f55b6b8-t946f" podStartSLOduration=1.452595441 podStartE2EDuration="2.280220748s" totalImagesPullingTime="827.625307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:51:28.279619697 +0000 UTC m=+769.653017884" watchObservedRunningTime="2026-07-01 16:51:28.280220748 +0000 UTC m=+769.653618932" Jul 01 16:51:28.314620 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:28.314584 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7569dc458-nng7p"] Jul 01 16:51:28.314831 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:28.314805 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7569dc458-nng7p" podUID="4d021921-2095-413f-9692-a29d31547bc1" containerName="authorino" containerID="cri-o://facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829" gracePeriod=30 Jul 01 16:51:28.566723 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:28.566692 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7569dc458-nng7p" Jul 01 16:51:28.653622 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:28.653591 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d021921-2095-413f-9692-a29d31547bc1-tls-cert\") pod \"4d021921-2095-413f-9692-a29d31547bc1\" (UID: \"4d021921-2095-413f-9692-a29d31547bc1\") " Jul 01 16:51:28.653772 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:28.653679 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb2jw\" (UniqueName: \"kubernetes.io/projected/4d021921-2095-413f-9692-a29d31547bc1-kube-api-access-pb2jw\") pod \"4d021921-2095-413f-9692-a29d31547bc1\" (UID: \"4d021921-2095-413f-9692-a29d31547bc1\") " Jul 01 16:51:28.655845 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:28.655806 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d021921-2095-413f-9692-a29d31547bc1-kube-api-access-pb2jw" (OuterVolumeSpecName: "kube-api-access-pb2jw") pod "4d021921-2095-413f-9692-a29d31547bc1" (UID: "4d021921-2095-413f-9692-a29d31547bc1"). InnerVolumeSpecName "kube-api-access-pb2jw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:51:28.664465 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:28.664416 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d021921-2095-413f-9692-a29d31547bc1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4d021921-2095-413f-9692-a29d31547bc1" (UID: "4d021921-2095-413f-9692-a29d31547bc1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:51:28.754792 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:28.754752 2552 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d021921-2095-413f-9692-a29d31547bc1-tls-cert\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:51:28.754792 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:28.754788 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb2jw\" (UniqueName: \"kubernetes.io/projected/4d021921-2095-413f-9692-a29d31547bc1-kube-api-access-pb2jw\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:51:29.265880 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:29.265781 2552 generic.go:356] "Generic (PLEG): container finished" podID="4d021921-2095-413f-9692-a29d31547bc1" containerID="facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829" exitCode=0 Jul 01 16:51:29.265880 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:29.265825 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7569dc458-nng7p" Jul 01 16:51:29.266361 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:29.265876 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7569dc458-nng7p" event={"ID":"4d021921-2095-413f-9692-a29d31547bc1","Type":"ContainerDied","Data":"facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829"} Jul 01 16:51:29.266361 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:29.265923 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7569dc458-nng7p" event={"ID":"4d021921-2095-413f-9692-a29d31547bc1","Type":"ContainerDied","Data":"341629f86be70c866d725461c715e704901e2091422002d1711eaa3de7428520"} Jul 01 16:51:29.266361 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:29.265948 2552 scope.go:117] "RemoveContainer" containerID="facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829" Jul 01 16:51:29.274729 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:29.274706 2552 scope.go:117] "RemoveContainer" containerID="facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829" Jul 01 16:51:29.275033 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:51:29.275007 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829\": container with ID starting with facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829 not found: ID does not exist" containerID="facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829" Jul 01 16:51:29.275079 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:29.275045 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829"} err="failed to get container status \"facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829\": rpc error: code = NotFound desc = could not find container \"facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829\": container with ID starting with facf15c6967bfa96cbab4aad2ffb37328348a5ff5b194753ba7fe36901289829 not found: ID does not exist" Jul 01 16:51:29.285234 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:29.285201 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7569dc458-nng7p"] Jul 01 16:51:29.290161 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:29.290132 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7569dc458-nng7p"] Jul 01 16:51:31.003753 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:31.003711 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d021921-2095-413f-9692-a29d31547bc1" path="/var/lib/kubelet/pods/4d021921-2095-413f-9692-a29d31547bc1/volumes" Jul 01 16:51:40.146934 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.146895 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8"] Jul 01 16:51:40.147337 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.147261 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d021921-2095-413f-9692-a29d31547bc1" containerName="authorino" Jul 01 16:51:40.147337 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.147273 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d021921-2095-413f-9692-a29d31547bc1" containerName="authorino" Jul 01 16:51:40.147337 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.147339 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d021921-2095-413f-9692-a29d31547bc1" containerName="authorino" Jul 01 16:51:40.151795 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.151770 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.155986 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.155930 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 01 16:51:40.155986 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.155959 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5ml5b\"" Jul 01 16:51:40.156216 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.155989 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 16:51:40.156216 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.156005 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 16:51:40.169599 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.169565 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8"] Jul 01 16:51:40.237965 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.237873 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.237965 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.237915 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.238154 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.237976 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.238154 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.238032 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgvqq\" (UniqueName: \"kubernetes.io/projected/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-kube-api-access-jgvqq\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.238154 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.238053 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.339312 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.339275 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.339312 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.339313 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.339550 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.339334 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.339550 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.339371 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgvqq\" (UniqueName: \"kubernetes.io/projected/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-kube-api-access-jgvqq\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.339550 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.339397 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.339770 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.339749 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.339857 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.339840 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.341904 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.341879 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.342056 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.342039 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.349873 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.349849 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgvqq\" (UniqueName: \"kubernetes.io/projected/6af04d11-f522-4dbf-b740-c9d5c2bb8a9d-kube-api-access-jgvqq\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-rp5f8\" (UID: \"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.463068 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.463020 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:40.606862 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:40.606754 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8"] Jul 01 16:51:40.609280 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:51:40.609249 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af04d11_f522_4dbf_b740_c9d5c2bb8a9d.slice/crio-8be45cc1d9bae6f3f5571fe4a8ff8a0278edc6317357804819f9d458d1692ff8 WatchSource:0}: Error finding container 8be45cc1d9bae6f3f5571fe4a8ff8a0278edc6317357804819f9d458d1692ff8: Status 404 returned error can't find the container with id 8be45cc1d9bae6f3f5571fe4a8ff8a0278edc6317357804819f9d458d1692ff8 Jul 01 16:51:41.323911 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:41.323876 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" event={"ID":"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d","Type":"ContainerStarted","Data":"8be45cc1d9bae6f3f5571fe4a8ff8a0278edc6317357804819f9d458d1692ff8"} Jul 01 16:51:42.330458 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:42.330419 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" event={"ID":"6af04d11-f522-4dbf-b740-c9d5c2bb8a9d","Type":"ContainerStarted","Data":"7d8e9e54cea65187c0f73797d16d01a3a5455d3cffdcd32c5a9afe4f3dbffda4"} Jul 01 16:51:42.351343 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:42.351288 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" podStartSLOduration=1.170172039 podStartE2EDuration="2.351271749s" totalImagesPullingTime="1.18109971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:51:42.350773467 +0000 UTC m=+783.724171656" watchObservedRunningTime="2026-07-01 16:51:42.351271749 +0000 UTC m=+783.724669989" Jul 01 16:51:50.463620 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:50.463583 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:50.464004 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:50.463641 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:50.476257 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:50.476226 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:51.382503 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:51.382473 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-rp5f8" Jul 01 16:51:55.248232 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.248188 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h"] Jul 01 16:51:55.251362 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.251345 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.258821 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.258796 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 01 16:51:55.274252 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.274220 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h"] Jul 01 16:51:55.373626 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.373588 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf79b38e-5ad8-4316-82c8-2254d018780e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.373810 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.373656 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf79b38e-5ad8-4316-82c8-2254d018780e-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.373810 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.373679 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf79b38e-5ad8-4316-82c8-2254d018780e-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.373810 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.373696 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw8hf\" (UniqueName: \"kubernetes.io/projected/bf79b38e-5ad8-4316-82c8-2254d018780e-kube-api-access-hw8hf\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.373810 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.373720 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf79b38e-5ad8-4316-82c8-2254d018780e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.474435 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.474397 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf79b38e-5ad8-4316-82c8-2254d018780e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.474676 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.474501 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf79b38e-5ad8-4316-82c8-2254d018780e-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.474676 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.474520 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf79b38e-5ad8-4316-82c8-2254d018780e-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.474676 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.474536 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw8hf\" (UniqueName: \"kubernetes.io/projected/bf79b38e-5ad8-4316-82c8-2254d018780e-kube-api-access-hw8hf\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.474676 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.474554 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf79b38e-5ad8-4316-82c8-2254d018780e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.474972 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.474946 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf79b38e-5ad8-4316-82c8-2254d018780e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.475094 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.475023 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf79b38e-5ad8-4316-82c8-2254d018780e-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.476934 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.476912 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf79b38e-5ad8-4316-82c8-2254d018780e-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.477228 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.477209 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf79b38e-5ad8-4316-82c8-2254d018780e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.488002 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.487969 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw8hf\" (UniqueName: \"kubernetes.io/projected/bf79b38e-5ad8-4316-82c8-2254d018780e-kube-api-access-hw8hf\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h\" (UID: \"bf79b38e-5ad8-4316-82c8-2254d018780e\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.562768 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.562677 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:51:55.725703 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:55.725670 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h"] Jul 01 16:51:55.729666 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:51:55.729630 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf79b38e_5ad8_4316_82c8_2254d018780e.slice/crio-669037af4664ce46cdf8cafee47b0fb89e85b221c9514aeb4118e1d38ffa1862 WatchSource:0}: Error finding container 669037af4664ce46cdf8cafee47b0fb89e85b221c9514aeb4118e1d38ffa1862: Status 404 returned error can't find the container with id 669037af4664ce46cdf8cafee47b0fb89e85b221c9514aeb4118e1d38ffa1862 Jul 01 16:51:56.402070 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:56.402029 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" event={"ID":"bf79b38e-5ad8-4316-82c8-2254d018780e","Type":"ContainerStarted","Data":"e47ca3a44592c99ea6aeecd299661fc9b976b9256cd65d36c027f3d2de843f98"} Jul 01 16:51:56.402570 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:56.402126 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" event={"ID":"bf79b38e-5ad8-4316-82c8-2254d018780e","Type":"ContainerStarted","Data":"669037af4664ce46cdf8cafee47b0fb89e85b221c9514aeb4118e1d38ffa1862"} Jul 01 16:51:56.423671 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:51:56.423620 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" podStartSLOduration=1.22480916 podStartE2EDuration="1.423604435s" totalImagesPullingTime="198.795275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:51:56.422158481 +0000 UTC m=+797.795556668" watchObservedRunningTime="2026-07-01 16:51:56.423604435 +0000 UTC m=+797.797002636" Jul 01 16:52:05.563030 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:52:05.562928 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:52:05.563423 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:52:05.563033 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:52:05.575868 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:52:05.575845 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:52:06.458190 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:52:06.458161 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h" Jul 01 16:53:14.567041 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.566999 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59cc778b69-bnx9v"] Jul 01 16:53:14.570738 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.570699 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59cc778b69-bnx9v" Jul 01 16:53:14.581562 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.581538 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59cc778b69-bnx9v"] Jul 01 16:53:14.583270 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.583245 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4blbh\" (UniqueName: \"kubernetes.io/projected/98053fad-7cef-4c04-afb1-2f20f9e3c1c3-kube-api-access-4blbh\") pod \"authorino-59cc778b69-bnx9v\" (UID: \"98053fad-7cef-4c04-afb1-2f20f9e3c1c3\") " pod="kuadrant-system/authorino-59cc778b69-bnx9v" Jul 01 16:53:14.583379 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.583295 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/98053fad-7cef-4c04-afb1-2f20f9e3c1c3-oidc-ca\") pod \"authorino-59cc778b69-bnx9v\" (UID: \"98053fad-7cef-4c04-afb1-2f20f9e3c1c3\") " pod="kuadrant-system/authorino-59cc778b69-bnx9v" Jul 01 16:53:14.583465 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.583378 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98053fad-7cef-4c04-afb1-2f20f9e3c1c3-tls-cert\") pod \"authorino-59cc778b69-bnx9v\" (UID: \"98053fad-7cef-4c04-afb1-2f20f9e3c1c3\") " pod="kuadrant-system/authorino-59cc778b69-bnx9v" Jul 01 16:53:14.684611 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.684566 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/98053fad-7cef-4c04-afb1-2f20f9e3c1c3-oidc-ca\") pod \"authorino-59cc778b69-bnx9v\" (UID: \"98053fad-7cef-4c04-afb1-2f20f9e3c1c3\") " pod="kuadrant-system/authorino-59cc778b69-bnx9v" Jul 01 16:53:14.684821 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.684623 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98053fad-7cef-4c04-afb1-2f20f9e3c1c3-tls-cert\") pod \"authorino-59cc778b69-bnx9v\" (UID: \"98053fad-7cef-4c04-afb1-2f20f9e3c1c3\") " pod="kuadrant-system/authorino-59cc778b69-bnx9v" Jul 01 16:53:14.684821 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.684696 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4blbh\" (UniqueName: \"kubernetes.io/projected/98053fad-7cef-4c04-afb1-2f20f9e3c1c3-kube-api-access-4blbh\") pod \"authorino-59cc778b69-bnx9v\" (UID: \"98053fad-7cef-4c04-afb1-2f20f9e3c1c3\") " pod="kuadrant-system/authorino-59cc778b69-bnx9v" Jul 01 16:53:14.685305 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.685279 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/98053fad-7cef-4c04-afb1-2f20f9e3c1c3-oidc-ca\") pod \"authorino-59cc778b69-bnx9v\" (UID: \"98053fad-7cef-4c04-afb1-2f20f9e3c1c3\") " pod="kuadrant-system/authorino-59cc778b69-bnx9v" Jul 01 16:53:14.687307 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.687281 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98053fad-7cef-4c04-afb1-2f20f9e3c1c3-tls-cert\") pod \"authorino-59cc778b69-bnx9v\" (UID: \"98053fad-7cef-4c04-afb1-2f20f9e3c1c3\") " pod="kuadrant-system/authorino-59cc778b69-bnx9v" Jul 01 16:53:14.695604 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.695577 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4blbh\" (UniqueName: \"kubernetes.io/projected/98053fad-7cef-4c04-afb1-2f20f9e3c1c3-kube-api-access-4blbh\") pod \"authorino-59cc778b69-bnx9v\" (UID: \"98053fad-7cef-4c04-afb1-2f20f9e3c1c3\") " pod="kuadrant-system/authorino-59cc778b69-bnx9v" Jul 01 16:53:14.880807 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:14.880717 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59cc778b69-bnx9v" Jul 01 16:53:15.041571 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:15.041459 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59cc778b69-bnx9v"] Jul 01 16:53:15.043909 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:53:15.043876 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98053fad_7cef_4c04_afb1_2f20f9e3c1c3.slice/crio-7daa45020ab496e15a40d5a2d6eb1d5eaee27608496c686e2020bfb47ab169b8 WatchSource:0}: Error finding container 7daa45020ab496e15a40d5a2d6eb1d5eaee27608496c686e2020bfb47ab169b8: Status 404 returned error can't find the container with id 7daa45020ab496e15a40d5a2d6eb1d5eaee27608496c686e2020bfb47ab169b8 Jul 01 16:53:15.772912 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:15.772867 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59cc778b69-bnx9v" event={"ID":"98053fad-7cef-4c04-afb1-2f20f9e3c1c3","Type":"ContainerStarted","Data":"06c9065b05a077bb436b16f8d10818c88f14e3abd02e40ccea9ef915d0bbde31"} Jul 01 16:53:15.773307 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:15.772922 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59cc778b69-bnx9v" event={"ID":"98053fad-7cef-4c04-afb1-2f20f9e3c1c3","Type":"ContainerStarted","Data":"7daa45020ab496e15a40d5a2d6eb1d5eaee27608496c686e2020bfb47ab169b8"} Jul 01 16:53:15.794630 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:15.794562 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59cc778b69-bnx9v" podStartSLOduration=1.418381291 podStartE2EDuration="1.794520014s" totalImagesPullingTime="376.138723ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:53:15.793648036 +0000 UTC m=+877.167046223" watchObservedRunningTime="2026-07-01 16:53:15.794520014 +0000 UTC m=+877.167918201" Jul 01 16:53:15.846321 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:15.846284 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-648f55b6b8-t946f"] Jul 01 16:53:15.846784 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:15.846753 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-648f55b6b8-t946f" podUID="4a4762ae-d4f2-46c3-a7cd-be48084c8221" containerName="authorino" containerID="cri-o://adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775" gracePeriod=30 Jul 01 16:53:16.116403 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.116373 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:53:16.196703 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.196669 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a4762ae-d4f2-46c3-a7cd-be48084c8221-tls-cert\") pod \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\" (UID: \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\") " Jul 01 16:53:16.196703 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.196711 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6rqq\" (UniqueName: \"kubernetes.io/projected/4a4762ae-d4f2-46c3-a7cd-be48084c8221-kube-api-access-n6rqq\") pod \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\" (UID: \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\") " Jul 01 16:53:16.196966 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.196782 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4a4762ae-d4f2-46c3-a7cd-be48084c8221-oidc-ca\") pod \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\" (UID: \"4a4762ae-d4f2-46c3-a7cd-be48084c8221\") " Jul 01 16:53:16.198959 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.198923 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a4762ae-d4f2-46c3-a7cd-be48084c8221-kube-api-access-n6rqq" (OuterVolumeSpecName: "kube-api-access-n6rqq") pod "4a4762ae-d4f2-46c3-a7cd-be48084c8221" (UID: "4a4762ae-d4f2-46c3-a7cd-be48084c8221"). InnerVolumeSpecName "kube-api-access-n6rqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:53:16.201651 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.201626 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a4762ae-d4f2-46c3-a7cd-be48084c8221-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "4a4762ae-d4f2-46c3-a7cd-be48084c8221" (UID: "4a4762ae-d4f2-46c3-a7cd-be48084c8221"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:53:16.206940 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.206914 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a4762ae-d4f2-46c3-a7cd-be48084c8221-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4a4762ae-d4f2-46c3-a7cd-be48084c8221" (UID: "4a4762ae-d4f2-46c3-a7cd-be48084c8221"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:53:16.297719 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.297674 2552 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a4762ae-d4f2-46c3-a7cd-be48084c8221-tls-cert\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:53:16.297719 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.297715 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6rqq\" (UniqueName: \"kubernetes.io/projected/4a4762ae-d4f2-46c3-a7cd-be48084c8221-kube-api-access-n6rqq\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:53:16.297719 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.297729 2552 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4a4762ae-d4f2-46c3-a7cd-be48084c8221-oidc-ca\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 01 16:53:16.779101 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.779069 2552 generic.go:356] "Generic (PLEG): container finished" podID="4a4762ae-d4f2-46c3-a7cd-be48084c8221" containerID="adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775" exitCode=0 Jul 01 16:53:16.779595 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.779122 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-648f55b6b8-t946f" Jul 01 16:53:16.779595 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.779153 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-648f55b6b8-t946f" event={"ID":"4a4762ae-d4f2-46c3-a7cd-be48084c8221","Type":"ContainerDied","Data":"adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775"} Jul 01 16:53:16.779595 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.779199 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-648f55b6b8-t946f" event={"ID":"4a4762ae-d4f2-46c3-a7cd-be48084c8221","Type":"ContainerDied","Data":"e47695fa804d782da2f2cb733e54a484d02a1b3b92e14a2f966f2ee1698cb1d0"} Jul 01 16:53:16.779595 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.779225 2552 scope.go:117] "RemoveContainer" containerID="adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775" Jul 01 16:53:16.789279 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.789258 2552 scope.go:117] "RemoveContainer" containerID="adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775" Jul 01 16:53:16.789651 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:53:16.789626 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775\": container with ID starting with adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775 not found: ID does not exist" containerID="adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775" Jul 01 16:53:16.789702 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.789669 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775"} err="failed to get container status \"adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775\": rpc error: code = NotFound desc = could not find container \"adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775\": container with ID starting with adfdced45abb10ade620d1a90714524c514928099c946179c99c14c782b78775 not found: ID does not exist" Jul 01 16:53:16.808353 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.808311 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-648f55b6b8-t946f"] Jul 01 16:53:16.813298 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:16.813270 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-648f55b6b8-t946f"] Jul 01 16:53:17.004514 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:17.004473 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a4762ae-d4f2-46c3-a7cd-be48084c8221" path="/var/lib/kubelet/pods/4a4762ae-d4f2-46c3-a7cd-be48084c8221/volumes" Jul 01 16:53:21.805021 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:21.804989 2552 generic.go:356] "Generic (PLEG): container finished" podID="40eba6a7-f73f-4006-adc0-5a35b351fb54" containerID="d12141297f6f19830abcb261d4cb26b2a00e7b2b875430479f6fcd5d6c904b16" exitCode=2 Jul 01 16:53:21.805384 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:21.805056 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" event={"ID":"40eba6a7-f73f-4006-adc0-5a35b351fb54","Type":"ContainerDied","Data":"d12141297f6f19830abcb261d4cb26b2a00e7b2b875430479f6fcd5d6c904b16"} Jul 01 16:53:21.805425 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:21.805388 2552 scope.go:117] "RemoveContainer" containerID="d12141297f6f19830abcb261d4cb26b2a00e7b2b875430479f6fcd5d6c904b16" Jul 01 16:53:22.044503 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:22.044467 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:53:22.812324 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:22.812285 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" event={"ID":"40eba6a7-f73f-4006-adc0-5a35b351fb54","Type":"ContainerStarted","Data":"5ea38168a2bb56fb31f90be1a3e15e04d65c79b4bba7e23cfca31db97ced001a"} Jul 01 16:53:22.812728 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:22.812453 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:53:33.819200 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:33.819107 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:53:54.522562 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:54.522532 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59cc778b69-bnx9v_98053fad-7cef-4c04-afb1-2f20f9e3c1c3/authorino/0.log" Jul 01 16:53:54.962747 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:54.962658 2552 generic.go:356] "Generic (PLEG): container finished" podID="40eba6a7-f73f-4006-adc0-5a35b351fb54" containerID="5ea38168a2bb56fb31f90be1a3e15e04d65c79b4bba7e23cfca31db97ced001a" exitCode=2 Jul 01 16:53:54.962747 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:54.962732 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" event={"ID":"40eba6a7-f73f-4006-adc0-5a35b351fb54","Type":"ContainerDied","Data":"5ea38168a2bb56fb31f90be1a3e15e04d65c79b4bba7e23cfca31db97ced001a"} Jul 01 16:53:54.962950 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:54.962792 2552 scope.go:117] "RemoveContainer" containerID="d12141297f6f19830abcb261d4cb26b2a00e7b2b875430479f6fcd5d6c904b16" Jul 01 16:53:54.963120 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:54.963103 2552 scope.go:117] "RemoveContainer" containerID="5ea38168a2bb56fb31f90be1a3e15e04d65c79b4bba7e23cfca31db97ced001a" Jul 01 16:53:54.963326 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:53:54.963305 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-xbpkz_openshift-ingress(40eba6a7-f73f-4006-adc0-5a35b351fb54)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" podUID="40eba6a7-f73f-4006-adc0-5a35b351fb54" Jul 01 16:53:57.052837 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:57.052798 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:53:57.053239 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:57.053161 2552 scope.go:117] "RemoveContainer" containerID="5ea38168a2bb56fb31f90be1a3e15e04d65c79b4bba7e23cfca31db97ced001a" Jul 01 16:53:57.053355 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:53:57.053332 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-xbpkz_openshift-ingress(40eba6a7-f73f-4006-adc0-5a35b351fb54)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" podUID="40eba6a7-f73f-4006-adc0-5a35b351fb54" Jul 01 16:53:59.334811 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:59.334781 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-hjdhk_fccc6fb3-9689-487d-8ba3-36246ad3086d/manager/0.log" Jul 01 16:53:59.451951 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:59.451922 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-z74vb_21e7b05b-e4c2-4064-9cf7-ca030fe40ad7/manager/0.log" Jul 01 16:53:59.826141 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:59.826108 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-w9lt2_d4096a77-bcc8-4224-a181-97edaced1e9c/server/0.log" Jul 01 16:53:59.943956 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:53:59.943927 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-dfztg_8d5fb676-e97b-45e6-a228-578180012c2a/manager/0.log" Jul 01 16:54:00.202710 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:00.202630 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579557fd58-jbt2d_eb90a035-24fb-490e-9aed-51b03a2ebab8/copy-manifests/0.log" Jul 01 16:54:00.223855 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:00.223824 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579557fd58-jbt2d_eb90a035-24fb-490e-9aed-51b03a2ebab8/manager/0.log" Jul 01 16:54:00.464064 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:00.463984 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lkmdz_c2400604-bfaf-4e66-8276-bd3173d11509/postgres/0.log" Jul 01 16:54:01.749267 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:01.749237 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59cc778b69-bnx9v_98053fad-7cef-4c04-afb1-2f20f9e3c1c3/authorino/0.log" Jul 01 16:54:01.863458 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:01.863413 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-q95kv_1b9c9dec-9819-4f1a-97ee-6cc824226779/manager/0.log" Jul 01 16:54:01.976123 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:01.976095 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hqznd_86e098d9-8d9e-48eb-83f6-760cf409240b/manager/0.log" Jul 01 16:54:02.086065 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:02.085989 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-kcf97_de642c45-6d36-4387-9d15-d769a6e2ea31/kuadrant-console-plugin/0.log" Jul 01 16:54:02.200249 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:02.200214 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4h7ft_9f557893-781c-468d-b164-3da5910e74c6/registry-server/0.log" Jul 01 16:54:02.562335 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:02.562292 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9mzdh_113035d2-32ed-432d-893f-f86975d3774e/manager/0.log" Jul 01 16:54:03.154528 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:03.154499 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64c6c96ddc-4psd6_69c5995f-976a-4f6f-812b-52dadd8c54b3/kube-auth-proxy/0.log" Jul 01 16:54:03.389297 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:03.389264 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z9tsb_3542905c-cfde-4b21-9d61-a54ec2692393/istio-proxy/1.log" Jul 01 16:54:03.624398 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:03.624349 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-xbpkz_40eba6a7-f73f-4006-adc0-5a35b351fb54/payload-processing/1.log" Jul 01 16:54:03.817752 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:03.817713 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:54:03.818097 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:03.818084 2552 scope.go:117] "RemoveContainer" containerID="5ea38168a2bb56fb31f90be1a3e15e04d65c79b4bba7e23cfca31db97ced001a" Jul 01 16:54:03.818274 ip-10-0-130-152 kubenswrapper[2552]: E0701 16:54:03.818255 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-xbpkz_openshift-ingress(40eba6a7-f73f-4006-adc0-5a35b351fb54)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" podUID="40eba6a7-f73f-4006-adc0-5a35b351fb54" Jul 01 16:54:04.092195 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:04.092155 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-74f954f784-rp5f8_6af04d11-f522-4dbf-b740-c9d5c2bb8a9d/main/0.log" Jul 01 16:54:04.328883 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:04.328848 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-74dcdbf7f6-vnt2h_bf79b38e-5ad8-4316-82c8-2254d018780e/main/0.log" Jul 01 16:54:08.660059 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.660019 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4sr87/must-gather-d5qpm"] Jul 01 16:54:08.660475 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.660408 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a4762ae-d4f2-46c3-a7cd-be48084c8221" containerName="authorino" Jul 01 16:54:08.660475 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.660419 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a4762ae-d4f2-46c3-a7cd-be48084c8221" containerName="authorino" Jul 01 16:54:08.660555 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.660505 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a4762ae-d4f2-46c3-a7cd-be48084c8221" containerName="authorino" Jul 01 16:54:08.663592 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.663573 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sr87/must-gather-d5qpm" Jul 01 16:54:08.668362 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.668335 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4sr87\"/\"default-dockercfg-q4lsd\"" Jul 01 16:54:08.668509 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.668335 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4sr87\"/\"openshift-service-ca.crt\"" Jul 01 16:54:08.668734 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.668718 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4sr87\"/\"kube-root-ca.crt\"" Jul 01 16:54:08.672782 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.672759 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4sr87/must-gather-d5qpm"] Jul 01 16:54:08.849915 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.849874 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdxrd\" (UniqueName: \"kubernetes.io/projected/dd88ce0d-06d0-4bdb-8d2f-d664b78abb03-kube-api-access-mdxrd\") pod \"must-gather-d5qpm\" (UID: \"dd88ce0d-06d0-4bdb-8d2f-d664b78abb03\") " pod="openshift-must-gather-4sr87/must-gather-d5qpm" Jul 01 16:54:08.849915 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.849925 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dd88ce0d-06d0-4bdb-8d2f-d664b78abb03-must-gather-output\") pod \"must-gather-d5qpm\" (UID: \"dd88ce0d-06d0-4bdb-8d2f-d664b78abb03\") " pod="openshift-must-gather-4sr87/must-gather-d5qpm" Jul 01 16:54:08.951325 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.951225 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdxrd\" (UniqueName: \"kubernetes.io/projected/dd88ce0d-06d0-4bdb-8d2f-d664b78abb03-kube-api-access-mdxrd\") pod \"must-gather-d5qpm\" (UID: \"dd88ce0d-06d0-4bdb-8d2f-d664b78abb03\") " pod="openshift-must-gather-4sr87/must-gather-d5qpm" Jul 01 16:54:08.951325 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.951293 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dd88ce0d-06d0-4bdb-8d2f-d664b78abb03-must-gather-output\") pod \"must-gather-d5qpm\" (UID: \"dd88ce0d-06d0-4bdb-8d2f-d664b78abb03\") " pod="openshift-must-gather-4sr87/must-gather-d5qpm" Jul 01 16:54:08.951682 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.951660 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dd88ce0d-06d0-4bdb-8d2f-d664b78abb03-must-gather-output\") pod \"must-gather-d5qpm\" (UID: \"dd88ce0d-06d0-4bdb-8d2f-d664b78abb03\") " pod="openshift-must-gather-4sr87/must-gather-d5qpm" Jul 01 16:54:08.968816 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.968782 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdxrd\" (UniqueName: \"kubernetes.io/projected/dd88ce0d-06d0-4bdb-8d2f-d664b78abb03-kube-api-access-mdxrd\") pod \"must-gather-d5qpm\" (UID: \"dd88ce0d-06d0-4bdb-8d2f-d664b78abb03\") " pod="openshift-must-gather-4sr87/must-gather-d5qpm" Jul 01 16:54:08.973722 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:08.973695 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sr87/must-gather-d5qpm" Jul 01 16:54:09.118931 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:09.118904 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4sr87/must-gather-d5qpm"] Jul 01 16:54:09.121963 ip-10-0-130-152 kubenswrapper[2552]: W0701 16:54:09.121932 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd88ce0d_06d0_4bdb_8d2f_d664b78abb03.slice/crio-4152151fb5c424b63cd38c01925c3040a74d645875e3979bc3ac25de5d50fb0f WatchSource:0}: Error finding container 4152151fb5c424b63cd38c01925c3040a74d645875e3979bc3ac25de5d50fb0f: Status 404 returned error can't find the container with id 4152151fb5c424b63cd38c01925c3040a74d645875e3979bc3ac25de5d50fb0f Jul 01 16:54:10.039854 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:10.039804 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sr87/must-gather-d5qpm" event={"ID":"dd88ce0d-06d0-4bdb-8d2f-d664b78abb03","Type":"ContainerStarted","Data":"4152151fb5c424b63cd38c01925c3040a74d645875e3979bc3ac25de5d50fb0f"} Jul 01 16:54:11.046924 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:11.046878 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sr87/must-gather-d5qpm" event={"ID":"dd88ce0d-06d0-4bdb-8d2f-d664b78abb03","Type":"ContainerStarted","Data":"3fac1e64320e9808f2aefeddc1f87ae069e885e593d3d123d95166ad2b24e0cf"} Jul 01 16:54:11.047319 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:11.046937 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sr87/must-gather-d5qpm" event={"ID":"dd88ce0d-06d0-4bdb-8d2f-d664b78abb03","Type":"ContainerStarted","Data":"f0bf43c5f72681e1e0c17dcf9e2f2e35f7c7df8c538e7f7509740eec3e16b450"} Jul 01 16:54:11.066788 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:11.066722 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4sr87/must-gather-d5qpm" podStartSLOduration=2.111177116 podStartE2EDuration="3.066699799s" totalImagesPullingTime="955.522683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:54:11.065969221 +0000 UTC m=+932.439367410" watchObservedRunningTime="2026-07-01 16:54:11.066699799 +0000 UTC m=+932.440097989" Jul 01 16:54:11.971839 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:11.971806 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z2z9q_6896b426-88bd-47d9-a32a-ef5a2cd56373/global-pull-secret-syncer/0.log" Jul 01 16:54:12.242955 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:12.242925 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9qmt5_db80e063-ddfc-48ae-b2f0-90358a53d4ff/konnectivity-agent/0.log" Jul 01 16:54:12.334237 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:12.334203 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-152.ec2.internal_057e5ae913964739cd5e8d17aa1ccb4e/haproxy/0.log" Jul 01 16:54:17.477072 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:17.477030 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59cc778b69-bnx9v_98053fad-7cef-4c04-afb1-2f20f9e3c1c3/authorino/0.log" Jul 01 16:54:17.519804 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:17.519763 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-q95kv_1b9c9dec-9819-4f1a-97ee-6cc824226779/manager/0.log" Jul 01 16:54:17.550033 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:17.549994 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hqznd_86e098d9-8d9e-48eb-83f6-760cf409240b/manager/0.log" Jul 01 16:54:17.591639 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:17.591602 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-kcf97_de642c45-6d36-4387-9d15-d769a6e2ea31/kuadrant-console-plugin/0.log" Jul 01 16:54:17.630196 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:17.630155 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4h7ft_9f557893-781c-468d-b164-3da5910e74c6/registry-server/0.log" Jul 01 16:54:17.745243 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:17.745151 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9mzdh_113035d2-32ed-432d-893f-f86975d3774e/manager/0.log" Jul 01 16:54:19.005678 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:19.005640 2552 scope.go:117] "RemoveContainer" containerID="5ea38168a2bb56fb31f90be1a3e15e04d65c79b4bba7e23cfca31db97ced001a" Jul 01 16:54:20.113691 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:20.113648 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" event={"ID":"40eba6a7-f73f-4006-adc0-5a35b351fb54","Type":"ContainerStarted","Data":"50e78f42f485fecaeeab978d2f715e90a517225878212e1b715afb48d64fac35"} Jul 01 16:54:20.114562 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:20.114535 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:54:20.140843 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:20.140806 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6685_2fdc4341-98c4-4fc5-8dc6-2b15d126891f/node-exporter/0.log" Jul 01 16:54:20.168105 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:20.168074 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6685_2fdc4341-98c4-4fc5-8dc6-2b15d126891f/kube-rbac-proxy/0.log" Jul 01 16:54:20.192646 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:20.192615 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6685_2fdc4341-98c4-4fc5-8dc6-2b15d126891f/init-textfile/0.log" Jul 01 16:54:22.584965 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.584921 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk"] Jul 01 16:54:22.593919 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.593880 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.601044 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.601007 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk"] Jul 01 16:54:22.713934 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.713888 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a2c08f7-7e3d-493b-9359-57f67fabeb38-sys\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.713934 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.713936 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a2c08f7-7e3d-493b-9359-57f67fabeb38-proc\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.714188 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.714054 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a2c08f7-7e3d-493b-9359-57f67fabeb38-lib-modules\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.714188 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.714080 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb7rl\" (UniqueName: \"kubernetes.io/projected/8a2c08f7-7e3d-493b-9359-57f67fabeb38-kube-api-access-kb7rl\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.714188 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.714102 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a2c08f7-7e3d-493b-9359-57f67fabeb38-podres\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.815722 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.815647 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a2c08f7-7e3d-493b-9359-57f67fabeb38-lib-modules\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.815920 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.815746 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7rl\" (UniqueName: \"kubernetes.io/projected/8a2c08f7-7e3d-493b-9359-57f67fabeb38-kube-api-access-kb7rl\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.815920 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.815772 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a2c08f7-7e3d-493b-9359-57f67fabeb38-podres\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.815920 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.815864 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a2c08f7-7e3d-493b-9359-57f67fabeb38-sys\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.815920 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.815871 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a2c08f7-7e3d-493b-9359-57f67fabeb38-lib-modules\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.815920 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.815889 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a2c08f7-7e3d-493b-9359-57f67fabeb38-proc\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.816220 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.815960 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a2c08f7-7e3d-493b-9359-57f67fabeb38-proc\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.816220 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.815975 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a2c08f7-7e3d-493b-9359-57f67fabeb38-sys\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.816220 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.816065 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a2c08f7-7e3d-493b-9359-57f67fabeb38-podres\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.825509 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.825481 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb7rl\" (UniqueName: \"kubernetes.io/projected/8a2c08f7-7e3d-493b-9359-57f67fabeb38-kube-api-access-kb7rl\") pod \"perf-node-gather-daemonset-2fksk\" (UID: \"8a2c08f7-7e3d-493b-9359-57f67fabeb38\") " pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:22.912141 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:22.912090 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:23.098664 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:23.098631 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk"] Jul 01 16:54:23.136600 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:23.136425 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" event={"ID":"8a2c08f7-7e3d-493b-9359-57f67fabeb38","Type":"ContainerStarted","Data":"27f4dde0a36d14de71c160e18ac0a5806acfe210bce46e7e83211a3f71751414"} Jul 01 16:54:24.144894 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:24.144852 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" event={"ID":"8a2c08f7-7e3d-493b-9359-57f67fabeb38","Type":"ContainerStarted","Data":"3e0bc9f9e7278abaa5f170d0faac4c254abdcec96bb1889e67fe219a920935c6"} Jul 01 16:54:24.145478 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:24.145015 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:24.168990 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:24.168914 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" podStartSLOduration=2.168890707 podStartE2EDuration="2.168890707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:54:24.167027276 +0000 UTC m=+945.540425463" watchObservedRunningTime="2026-07-01 16:54:24.168890707 +0000 UTC m=+945.542288893" Jul 01 16:54:25.295061 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:25.295034 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8lfxr_ac4efdc8-0c68-4c92-9811-a6cd246757b6/dns/0.log" Jul 01 16:54:25.320554 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:25.320526 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8lfxr_ac4efdc8-0c68-4c92-9811-a6cd246757b6/kube-rbac-proxy/0.log" Jul 01 16:54:25.449696 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:25.449669 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhm6n_8f95b035-879b-41d8-a6e6-b4767b52f3ca/dns-node-resolver/0.log" Jul 01 16:54:26.028110 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:26.028076 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-26zzp_ca7dc41b-5b77-4ffd-9d75-6e40a2cb6a65/node-ca/0.log" Jul 01 16:54:27.197602 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:27.197565 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64c6c96ddc-4psd6_69c5995f-976a-4f6f-812b-52dadd8c54b3/kube-auth-proxy/0.log" Jul 01 16:54:27.261038 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:27.261004 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z9tsb_3542905c-cfde-4b21-9d61-a54ec2692393/istio-proxy/1.log" Jul 01 16:54:27.261208 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:27.261054 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z9tsb_3542905c-cfde-4b21-9d61-a54ec2692393/istio-proxy/0.log" Jul 01 16:54:27.315741 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:27.315710 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-xbpkz_40eba6a7-f73f-4006-adc0-5a35b351fb54/payload-processing/2.log" Jul 01 16:54:27.316320 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:27.316295 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-xbpkz_40eba6a7-f73f-4006-adc0-5a35b351fb54/payload-processing/1.log" Jul 01 16:54:27.997420 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:27.997388 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sg7zv_32dd7a3b-a849-4339-9822-8599d954dc7a/serve-healthcheck-canary/0.log" Jul 01 16:54:28.854853 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:28.854826 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ft7l_2b8e4441-41ed-4265-a895-07a6fafb769f/kube-rbac-proxy/0.log" Jul 01 16:54:28.878663 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:28.878635 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ft7l_2b8e4441-41ed-4265-a895-07a6fafb769f/exporter/0.log" Jul 01 16:54:28.904465 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:28.904420 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ft7l_2b8e4441-41ed-4265-a895-07a6fafb769f/extractor/0.log" Jul 01 16:54:30.166138 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:30.166097 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4sr87/perf-node-gather-daemonset-2fksk" Jul 01 16:54:31.122541 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:31.122505 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-xbpkz" Jul 01 16:54:31.331432 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:31.331405 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-hjdhk_fccc6fb3-9689-487d-8ba3-36246ad3086d/manager/0.log" Jul 01 16:54:31.374013 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:31.373927 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-z74vb_21e7b05b-e4c2-4064-9cf7-ca030fe40ad7/manager/0.log" Jul 01 16:54:31.459366 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:31.459326 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-w9lt2_d4096a77-bcc8-4224-a181-97edaced1e9c/server/0.log" Jul 01 16:54:31.525326 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:31.525289 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-dfztg_8d5fb676-e97b-45e6-a228-578180012c2a/manager/0.log" Jul 01 16:54:31.664072 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:31.663983 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579557fd58-jbt2d_eb90a035-24fb-490e-9aed-51b03a2ebab8/manager/0.log" Jul 01 16:54:31.684709 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:31.684681 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579557fd58-jbt2d_eb90a035-24fb-490e-9aed-51b03a2ebab8/copy-manifests/0.log" Jul 01 16:54:31.775480 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:31.775428 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lkmdz_c2400604-bfaf-4e66-8276-bd3173d11509/postgres/0.log" Jul 01 16:54:33.001374 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:33.001337 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64c6c96ddc-4psd6_69c5995f-976a-4f6f-812b-52dadd8c54b3/kube-auth-proxy/0.log" Jul 01 16:54:33.037170 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:33.037125 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z9tsb_3542905c-cfde-4b21-9d61-a54ec2692393/istio-proxy/1.log" Jul 01 16:54:33.037502 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:33.037484 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z9tsb_3542905c-cfde-4b21-9d61-a54ec2692393/istio-proxy/0.log" Jul 01 16:54:33.061966 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:33.061919 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-xbpkz_40eba6a7-f73f-4006-adc0-5a35b351fb54/payload-processing/2.log" Jul 01 16:54:33.062711 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:33.062687 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-xbpkz_40eba6a7-f73f-4006-adc0-5a35b351fb54/payload-processing/1.log" Jul 01 16:54:34.295855 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:34.295769 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64c6c96ddc-4psd6_69c5995f-976a-4f6f-812b-52dadd8c54b3/kube-auth-proxy/0.log" Jul 01 16:54:34.343052 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:34.343019 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z9tsb_3542905c-cfde-4b21-9d61-a54ec2692393/istio-proxy/0.log" Jul 01 16:54:34.343299 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:34.343281 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z9tsb_3542905c-cfde-4b21-9d61-a54ec2692393/istio-proxy/1.log" Jul 01 16:54:34.388272 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:34.388235 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-xbpkz_40eba6a7-f73f-4006-adc0-5a35b351fb54/payload-processing/2.log" Jul 01 16:54:34.389244 ip-10-0-130-152 kubenswrapper[2552]: I0701 16:54:34.389214 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-xbpkz_40eba6a7-f73f-4006-adc0-5a35b351fb54/payload-processing/1.log"