Jul 01 22:11:36.811954 ip-10-0-133-116 systemd[1]: Starting Kubernetes Kubelet... Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.244809 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251367 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251382 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251385 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251391 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251395 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251404 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251407 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:11:38.259646 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251410 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251413 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251416 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251419 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251422 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251425 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251428 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251430 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251434 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251436 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251439 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251442 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251445 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251448 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251451 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251454 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251457 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251460 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251464 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:11:38.262295 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251467 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251470 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251473 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251477 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251482 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251485 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251488 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251490 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251493 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251496 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251499 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251502 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251506 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251509 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251512 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251516 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251519 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251521 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251524 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251527 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:11:38.262947 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251530 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251532 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251535 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251538 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251541 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251544 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251547 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251550 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251553 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251557 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251560 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251563 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251566 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251568 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251571 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251576 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251580 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251583 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251586 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:11:38.263810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251589 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251593 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251596 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251600 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251603 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251606 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251609 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251612 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251614 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251618 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251620 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251623 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251626 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251628 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251631 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251634 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251637 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251639 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251642 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251645 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251647 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:11:38.264355 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251650 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251654 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251657 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251661 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251665 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251669 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251672 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251675 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251678 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251681 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251684 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251687 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.251690 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252511 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252518 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252521 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252524 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252527 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252531 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252534 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:11:38.388210 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252539 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:11:38.322859 ip-10-0-133-116 systemd[1]: Started Kubernetes Kubelet. Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252543 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252546 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252550 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252553 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252556 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252560 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252563 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252567 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252571 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252574 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252577 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252580 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252583 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252586 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252590 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252592 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252597 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252601 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252604 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:11:38.389768 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252607 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252611 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252614 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252617 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252620 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252623 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252626 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252629 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252631 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252634 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252637 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252640 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252643 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252646 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252649 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252651 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252654 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252657 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252664 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252667 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:11:38.390550 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252670 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252672 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252676 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252679 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252682 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252685 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252688 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252690 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252693 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252697 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252699 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252702 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252705 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252708 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252710 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252713 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252716 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252719 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252722 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:11:38.392120 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252724 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252728 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252754 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252757 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252760 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252764 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252767 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252770 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252773 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252775 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252778 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252782 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252785 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252788 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252791 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252795 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252798 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252801 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252803 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252806 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:11:38.392928 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252809 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252811 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252814 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252817 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252820 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252823 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252825 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252828 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252830 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252833 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252838 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252842 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.252845 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253334 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253343 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253347 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253350 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253354 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253359 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:11:38.394106 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253363 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253366 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253369 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253373 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253377 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253380 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253383 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253386 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253389 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253391 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253394 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253397 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253400 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253402 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253405 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253408 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253411 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253414 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253416 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253419 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:11:38.394904 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253422 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253425 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253427 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253430 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253433 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253436 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253439 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253443 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253446 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253449 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253452 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253456 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253458 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253461 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253464 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253467 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253471 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253474 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253476 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253479 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:11:38.396066 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253482 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253484 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253487 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253490 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253492 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253495 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253499 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253503 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253507 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253510 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253513 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253516 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253519 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253522 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253524 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253527 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253530 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253533 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253535 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:11:38.398021 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253540 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253543 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253545 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253548 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253551 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253554 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253557 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253559 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253562 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253566 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253569 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253571 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253574 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253578 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253581 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253584 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253587 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253589 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253592 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253595 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:11:38.398612 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253597 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253600 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253603 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253616 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253619 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253622 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253625 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253628 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253632 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253636 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253639 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253642 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253646 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.253648 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253725 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253749 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253757 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253762 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253767 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253771 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253776 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 22:11:38.399143 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253782 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253786 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253789 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253793 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253797 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253801 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253804 2568 flags.go:64] FLAG: --cgroup-root="" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253807 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253810 2568 flags.go:64] FLAG: --client-ca-file="" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253814 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253817 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253822 2568 flags.go:64] FLAG: --cluster-domain="" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253825 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253828 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253832 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253835 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253839 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253843 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253846 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253850 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253853 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253856 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253860 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253865 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 22:11:38.399685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253868 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253873 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253877 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253880 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253883 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253886 2568 flags.go:64] FLAG: --enable-server="true" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253891 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253896 2568 flags.go:64] FLAG: --event-burst="100" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253901 2568 flags.go:64] FLAG: --event-qps="50" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253904 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253907 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253910 2568 flags.go:64] FLAG: --eviction-hard="" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253914 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253918 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253921 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253924 2568 flags.go:64] FLAG: --eviction-soft="" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253928 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253931 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253934 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253937 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253940 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253943 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253946 2568 flags.go:64] FLAG: --feature-gates="" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253951 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253954 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 22:11:38.400378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253957 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253960 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253966 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253969 2568 flags.go:64] FLAG: --help="false" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253973 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253976 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253981 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253984 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253988 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253992 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253995 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.253998 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254002 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254005 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254009 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254015 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254018 2568 flags.go:64] FLAG: --kube-reserved="" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254022 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254025 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254028 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254032 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254035 2568 flags.go:64] FLAG: --lock-file="" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254038 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254041 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 22:11:38.401067 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254044 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254050 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254053 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254056 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254059 2568 flags.go:64] FLAG: --logging-format="text" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254062 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254066 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254070 2568 flags.go:64] FLAG: --manifest-url="" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254073 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254078 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254081 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254086 2568 flags.go:64] FLAG: --max-pods="110" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254089 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254092 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254097 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254100 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254103 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254107 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254110 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254121 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254124 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254127 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254131 2568 flags.go:64] FLAG: --pod-cidr="" Jul 01 22:11:38.401679 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254137 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254143 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254146 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254149 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254152 2568 flags.go:64] FLAG: --port="10250" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254156 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254159 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-068a6803619bdd834" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254162 2568 flags.go:64] FLAG: --qos-reserved="" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254166 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254169 2568 flags.go:64] FLAG: --register-node="true" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254172 2568 flags.go:64] FLAG: --register-with-taints="" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254176 2568 flags.go:64] FLAG: --registry-burst="10" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254179 2568 flags.go:64] FLAG: --registry-qps="5" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254182 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254185 2568 flags.go:64] FLAG: --reserved-memory="" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254189 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254193 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254196 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254199 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254202 2568 flags.go:64] FLAG: --runonce="false" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254205 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254209 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254212 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254215 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254220 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254223 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 22:11:38.402283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254226 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254230 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254233 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254236 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254239 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254241 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254246 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254250 2568 flags.go:64] FLAG: --system-cgroups="" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254253 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254259 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254262 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254265 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254269 2568 flags.go:64] FLAG: --tls-min-version="" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254272 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254275 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254278 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254281 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254285 2568 flags.go:64] FLAG: --v="2" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254289 2568 flags.go:64] FLAG: --version="false" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254293 2568 flags.go:64] FLAG: --vmodule="" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254297 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.254300 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254451 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254454 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:11:38.402959 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254457 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254460 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254463 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254466 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254469 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254472 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254476 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254479 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254482 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254485 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254488 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254491 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254494 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254497 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254501 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254503 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254507 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254509 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254512 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254515 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:11:38.403607 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254518 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254520 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254523 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254526 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254528 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254531 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254534 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254536 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254539 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254542 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254544 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254547 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254550 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254553 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254555 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254558 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254561 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254564 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254568 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254571 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:11:38.404139 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254573 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254576 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254579 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254582 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254585 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254588 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254592 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254594 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254597 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254600 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254603 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254607 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254611 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254614 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254617 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254620 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254623 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254626 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254629 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254632 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:11:38.404652 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254634 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254637 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254640 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254643 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254646 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254648 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254651 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254654 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254656 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254659 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254665 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254669 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254672 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254675 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254678 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254681 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254684 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254686 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254691 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254693 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:11:38.405190 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254696 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254699 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254702 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254705 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254708 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254711 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254713 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254716 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254719 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254723 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254727 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254744 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254747 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254750 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254753 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254756 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:11:38.405715 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.254759 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.255354 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.269836 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.269856 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.269878 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.269889 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269953 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269959 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269964 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269967 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269970 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269973 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269976 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269979 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:11:38.406141 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269982 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269985 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269988 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269991 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269994 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269996 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.269999 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270002 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270005 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270008 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270011 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270014 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270017 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270020 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270023 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270026 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270028 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270032 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270035 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270039 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:11:38.406523 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270042 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270045 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270048 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270052 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270054 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270057 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270060 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270063 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270065 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270068 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270071 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270075 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270080 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270084 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270087 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270089 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270092 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270095 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270099 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:11:38.407050 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270102 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270104 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270107 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270110 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270113 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270115 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270118 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270121 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270124 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270127 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270130 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270133 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270135 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270139 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270143 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270145 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270148 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270151 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270154 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270158 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:11:38.407534 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270162 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270165 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270168 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270171 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270174 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270178 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270181 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270184 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270187 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270190 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270193 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270196 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270200 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270205 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270208 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270212 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270215 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270218 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270221 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:11:38.408081 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270225 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270229 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270233 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270236 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270239 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270241 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270244 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270248 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270251 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270254 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270257 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270260 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270262 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.270268 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270394 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 22:11:38.408580 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270400 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270403 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270406 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270409 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270413 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270416 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270419 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270421 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270424 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270427 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270430 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270435 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270438 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270442 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270446 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270449 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270452 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270455 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270458 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270461 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 22:11:38.408996 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270464 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270466 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270469 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270472 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270475 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270478 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270481 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270483 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270486 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270489 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270492 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270495 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270497 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270500 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270503 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270506 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270508 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270511 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270514 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270517 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 22:11:38.409513 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270520 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270523 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270525 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270528 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270531 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270534 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270537 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270540 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270543 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270545 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270548 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270551 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270553 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270556 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270559 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270561 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270564 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270567 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270570 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270573 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 22:11:38.410068 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270576 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270585 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270588 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270591 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270594 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270596 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270600 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270603 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270605 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270608 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270612 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270616 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270620 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270622 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270626 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270629 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270632 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270637 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270641 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 22:11:38.410592 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270644 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270647 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270650 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270653 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270655 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270658 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270661 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270664 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270666 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270669 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270672 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270675 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270678 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270681 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270685 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270689 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270692 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270694 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 22:11:38.411101 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:38.270697 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 22:11:38.411557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.270703 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 22:11:38.411557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.270849 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 22:11:38.411557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.273923 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 22:11:38.411557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.275163 2568 server.go:1019] "Starting client certificate rotation" Jul 01 22:11:38.411557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.275278 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 22:11:38.411557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.275314 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 22:11:38.411557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.277442 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 22:11:38.411557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.278761 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 22:11:38.411557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.288889 2568 log.go:25] "Validated CRI v1 runtime API" Jul 01 22:11:38.411557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.293143 2568 log.go:25] "Validated CRI v1 image API" Jul 01 22:11:38.411557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.294714 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 22:11:38.411557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.297003 2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 803d74aa-56ed-4157-acaa-f4a5f56a7e7f:/dev/nvme0n1p4 be29c835-8afc-4e47-a90e-fad561fb8e29:/dev/nvme0n1p3] Jul 01 22:11:38.411898 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.297019 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 22:11:38.411934 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.302752 2568 manager.go:216] Machine: {Timestamp:2026-07-01 22:11:38.301169682 +0000 UTC m=+1.388447161 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097094 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f66db1ae1109be885dcb64604dad2 SystemUUID:ec2f66db-1ae1-109b-e885-dcb64604dad2 BootID:ab8a2fd6-d3f7-47c3-a257-150c35cbbb80 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fe:62:8e:e9:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fe:62:8e:e9:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:98:76:94:29:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 22:11:38.411934 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.303193 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 22:11:38.411934 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.303341 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 22:11:38.411934 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.304809 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 22:11:38.411934 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.306056 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 22:11:38.411934 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.306089 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 22:11:38.411934 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.306786 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.306796 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.306804 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.307614 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.308562 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.312679 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.312832 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.312865 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.312877 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.312890 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.312902 2568 kubelet.go:398] "Adding apiserver pod source" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.312913 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.313341 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.313358 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.315254 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.316790 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.316820 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.317012 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.317029 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.317036 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.317042 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.317051 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.317057 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.317450 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.317460 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.317467 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.317473 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.317484 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.317493 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.318203 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.318213 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.321886 2568 server.go:1268] "Started kubelet" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.321962 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.322051 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.322535 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.323158 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.324629 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.326800 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.326802 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 22:11:38.412164 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.326802 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.327491 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.326919 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-116.ec2.internal.18be4a0771ec90b4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-116.ec2.internal,UID:ip-10-0-133-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-116.ec2.internal,},FirstTimestamp:2026-07-01 22:11:38.321850548 +0000 UTC m=+1.409128099,LastTimestamp:2026-07-01 22:11:38.321850548 +0000 UTC m=+1.409128099,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-116.ec2.internal,}" Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.329796 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.329809 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.329856 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.330388 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.330404 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.330421 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.330504 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.330512 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.330627 2568 factory.go:55] Registering systemd factory Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.330665 2568 factory.go:223] Registration of the systemd container factory successfully Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.330964 2568 factory.go:153] Registering CRI-O factory Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.330977 2568 factory.go:223] Registration of the crio container factory successfully Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.331048 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.331074 2568 factory.go:103] Registering Raw factory Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.331090 2568 manager.go:1196] Started watching for new ooms in manager Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.331506 2568 manager.go:349] Starting recovery of all containers Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.333327 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 22:11:38.413199 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.333423 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 22:11:38.496207 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.495892 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:38.496453 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.496420 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jgwzz" Jul 01 22:11:38.496453 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.496447 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jgwzz" Jul 01 22:11:38.499697 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.499663 2568 manager.go:354] Recovery completed Jul 01 22:11:38.506393 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.506375 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:11:38.508873 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.508853 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:11:38.508970 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.508891 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:11:38.508970 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.508907 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:11:38.509562 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.509546 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 22:11:38.509611 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.509564 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 22:11:38.509611 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.509585 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 01 22:11:38.509611 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.509583 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:11:38.510579 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.510562 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:11:38.510657 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.510589 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:11:38.510657 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.510605 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:11:38.511481 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.511409 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-116.ec2.internal.18be4a077d124dd2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-116.ec2.internal,UID:ip-10-0-133-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-116.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-116.ec2.internal,},FirstTimestamp:2026-07-01 22:11:38.50887317 +0000 UTC m=+1.596150652,LastTimestamp:2026-07-01 22:11:38.50887317 +0000 UTC m=+1.596150652,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-116.ec2.internal,}" Jul 01 22:11:38.512066 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.512053 2568 policy_none.go:49] "None policy: Start" Jul 01 22:11:38.512123 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.512073 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 22:11:38.512123 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.512089 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 22:11:38.514331 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.514318 2568 policy_none.go:47] "Start" Jul 01 22:11:38.538933 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.538785 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-116.ec2.internal\" not found" node="ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.556109 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.557317 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.557358 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.557385 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.557427 2568 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.559398 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.561478 2568 manager.go:337] "Starting Device Plugin manager" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.561531 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.561544 2568 server.go:87] "Starting device plugin registration server" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.561816 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.561827 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.561936 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.562029 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.562040 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.562521 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 22:11:38.566513 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.562566 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:38.659214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.659110 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-116.ec2.internal"] Jul 01 22:11:38.659214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.659207 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:11:38.660279 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.660258 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:11:38.660395 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.660291 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:11:38.660395 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.660302 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:11:38.662528 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.662512 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:11:38.662606 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.662583 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:11:38.662764 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.662751 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.662814 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.662779 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:11:38.663423 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.663404 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:11:38.663423 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.663418 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:11:38.663555 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.663432 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:11:38.663555 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.663411 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:11:38.663555 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.663476 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:11:38.663555 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.663446 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:11:38.663555 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.663503 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:11:38.663555 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.663487 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:11:38.663792 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.663448 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:11:38.663792 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.663598 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.665692 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.665676 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.665765 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.665701 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 22:11:38.666468 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.666453 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientMemory" Jul 01 22:11:38.666531 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.666481 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 22:11:38.666531 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.666493 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeHasSufficientPID" Jul 01 22:11:38.674340 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.674324 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.674405 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.674348 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-116.ec2.internal\": node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:38.690730 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.690705 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-116.ec2.internal\" not found" node="ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.695514 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.695498 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-116.ec2.internal\" not found" node="ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.709954 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.709930 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:38.797894 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.797857 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e1608fae24a0b4f4e56d62a3705730b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal\" (UID: \"3e1608fae24a0b4f4e56d62a3705730b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.798016 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.797899 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e1608fae24a0b4f4e56d62a3705730b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal\" (UID: \"3e1608fae24a0b4f4e56d62a3705730b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.798016 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.797919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ce2be86fb4a38cffeeb63b45a890e95-config\") pod \"kube-apiserver-proxy-ip-10-0-133-116.ec2.internal\" (UID: \"2ce2be86fb4a38cffeeb63b45a890e95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.810802 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.810776 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:38.899244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.899195 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e1608fae24a0b4f4e56d62a3705730b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal\" (UID: \"3e1608fae24a0b4f4e56d62a3705730b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.899333 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.899252 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e1608fae24a0b4f4e56d62a3705730b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal\" (UID: \"3e1608fae24a0b4f4e56d62a3705730b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.899333 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.899294 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ce2be86fb4a38cffeeb63b45a890e95-config\") pod \"kube-apiserver-proxy-ip-10-0-133-116.ec2.internal\" (UID: \"2ce2be86fb4a38cffeeb63b45a890e95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.899333 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.899285 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e1608fae24a0b4f4e56d62a3705730b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal\" (UID: \"3e1608fae24a0b4f4e56d62a3705730b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.899333 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.899325 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ce2be86fb4a38cffeeb63b45a890e95-config\") pod \"kube-apiserver-proxy-ip-10-0-133-116.ec2.internal\" (UID: \"2ce2be86fb4a38cffeeb63b45a890e95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.899470 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.899359 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e1608fae24a0b4f4e56d62a3705730b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal\" (UID: \"3e1608fae24a0b4f4e56d62a3705730b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.911213 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:38.911147 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:38.994318 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.994267 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" Jul 01 22:11:38.998112 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:38.998093 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-116.ec2.internal" Jul 01 22:11:39.011823 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:39.011797 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:39.112805 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:39.112749 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:39.213920 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:39.213877 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:39.274629 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:39.274598 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 22:11:39.275151 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:39.274815 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 22:11:39.314161 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:39.314108 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:39.414838 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:39.414785 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:39.424519 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:39.424495 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:11:39.503288 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:39.503191 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 22:06:39 +0000 UTC" deadline="2028-01-06 03:43:17.164351684 +0000 UTC" Jul 01 22:11:39.503288 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:39.503230 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13277h31m37.661125056s" Jul 01 22:11:39.515161 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:39.515134 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:39.615616 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:39.615581 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-116.ec2.internal\" not found" Jul 01 22:11:39.645919 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:39.645878 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e1608fae24a0b4f4e56d62a3705730b.slice/crio-fa63b2a96c77ec183e98795651eb3eb8784dfde218d6982a525887fd70631bd1 WatchSource:0}: Error finding container fa63b2a96c77ec183e98795651eb3eb8784dfde218d6982a525887fd70631bd1: Status 404 returned error can't find the container with id fa63b2a96c77ec183e98795651eb3eb8784dfde218d6982a525887fd70631bd1 Jul 01 22:11:39.646171 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:39.646147 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce2be86fb4a38cffeeb63b45a890e95.slice/crio-993c994032bf927c0eba65d561f03d4ff73fc36c73896ba336db4f8e0c288b7e WatchSource:0}: Error finding container 993c994032bf927c0eba65d561f03d4ff73fc36c73896ba336db4f8e0c288b7e: Status 404 returned error can't find the container with id 993c994032bf927c0eba65d561f03d4ff73fc36c73896ba336db4f8e0c288b7e Jul 01 22:11:39.650529 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:39.650508 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 22:11:39.651631 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:39.651616 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:11:39.697355 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:39.697320 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:11:39.730181 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:39.730136 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" Jul 01 22:11:39.747127 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:39.747107 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 22:11:39.747971 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:39.747956 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-116.ec2.internal" Jul 01 22:11:39.757419 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:39.757365 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 22:11:40.102983 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.102895 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 22:11:40.314215 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.314184 2568 apiserver.go:52] "Watching apiserver" Jul 01 22:11:40.324199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.323963 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 22:11:40.325618 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.325072 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-g9wk5","openshift-dns/node-resolver-6q954","openshift-image-registry/node-ca-6fgns","openshift-multus/multus-96n9s","openshift-multus/network-metrics-daemon-qtm74","openshift-ovn-kubernetes/ovnkube-node-wt7qw","kube-system/global-pull-secret-syncer-nj76z","kube-system/konnectivity-agent-fc8gq","kube-system/kube-apiserver-proxy-ip-10-0-133-116.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal","openshift-multus/multus-additional-cni-plugins-5b5p2","openshift-network-diagnostics/network-check-target-76hn9","openshift-network-operator/iptables-alerter-m59vn"] Jul 01 22:11:40.328099 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.328062 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:40.328259 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:40.328147 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:11:40.330203 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.330181 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:40.330327 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:40.330246 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:11:40.331106 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.331082 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 22:11:40.332583 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.332565 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6fgns" Jul 01 22:11:40.334885 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.334862 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.335804 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.335778 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 22:11:40.335913 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.335893 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hpmxv\"" Jul 01 22:11:40.336013 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.336000 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 22:11:40.336130 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.336101 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 22:11:40.337311 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.337280 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:40.337423 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:40.337343 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:11:40.338819 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.338793 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 22:11:40.340037 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.339382 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 22:11:40.340037 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.339640 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 22:11:40.340037 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.339875 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 22:11:40.340037 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.339961 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bvfn8\"" Jul 01 22:11:40.340229 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.340043 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.342868 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.342827 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8sr22\"" Jul 01 22:11:40.343125 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.343104 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 22:11:40.343366 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.343347 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 22:11:40.343887 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.343864 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 22:11:40.344122 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.344102 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 22:11:40.344516 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.344488 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 22:11:40.344925 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.344709 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 22:11:40.345038 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.345016 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 22:11:40.345727 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.345469 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m59vn" Jul 01 22:11:40.346409 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.345901 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.347764 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.347743 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6q954" Jul 01 22:11:40.348902 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.348878 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 22:11:40.349020 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.349001 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:11:40.349087 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.349011 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 22:11:40.349145 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.349118 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gwc48\"" Jul 01 22:11:40.349273 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.349256 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tr7jc\"" Jul 01 22:11:40.349336 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.349316 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 22:11:40.349459 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.349444 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:11:40.350363 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.350344 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.351400 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.350878 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 22:11:40.351400 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.351236 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 22:11:40.351400 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.351301 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lp28n\"" Jul 01 22:11:40.353161 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.353086 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fc8gq" Jul 01 22:11:40.353251 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.353192 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 22:11:40.353780 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.353759 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5k9gg\"" Jul 01 22:11:40.354075 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.354053 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 22:11:40.354500 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.354478 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 22:11:40.356194 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.356047 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 22:11:40.356294 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.356248 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ctjvw\"" Jul 01 22:11:40.356294 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.356267 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 22:11:40.356544 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.356510 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.359311 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.359288 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 22:11:40.359732 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.359713 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bwqh7\"" Jul 01 22:11:40.359828 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.359812 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 22:11:40.368365 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.368341 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nwxcm" Jul 01 22:11:40.378006 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.377983 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nwxcm" Jul 01 22:11:40.421585 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.421558 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/873029f8-0544-4b82-9ee1-c84e63aa34f7-host\") pod \"node-ca-6fgns\" (UID: \"873029f8-0544-4b82-9ee1-c84e63aa34f7\") " pod="openshift-image-registry/node-ca-6fgns" Jul 01 22:11:40.421751 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.421605 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/873029f8-0544-4b82-9ee1-c84e63aa34f7-serviceca\") pod \"node-ca-6fgns\" (UID: \"873029f8-0544-4b82-9ee1-c84e63aa34f7\") " pod="openshift-image-registry/node-ca-6fgns" Jul 01 22:11:40.421751 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.421678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d65a4b07-191f-4737-93c7-d08be8e1794e-dbus\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:40.421751 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.421730 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qdz8\" (UniqueName: \"kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8\") pod \"network-check-target-76hn9\" (UID: \"7593af7d-a289-49ad-96da-d36d890ee899\") " pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:40.421920 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.421761 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l8nw\" (UniqueName: \"kubernetes.io/projected/873029f8-0544-4b82-9ee1-c84e63aa34f7-kube-api-access-2l8nw\") pod \"node-ca-6fgns\" (UID: \"873029f8-0544-4b82-9ee1-c84e63aa34f7\") " pod="openshift-image-registry/node-ca-6fgns" Jul 01 22:11:40.421920 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.421783 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d65a4b07-191f-4737-93c7-d08be8e1794e-kubelet-config\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:40.421920 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.421818 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:40.432138 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.432063 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 22:11:40.522388 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522357 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.522563 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522398 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-os-release\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.522563 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522424 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-var-lib-cni-bin\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.522563 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-etc-kubernetes\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.522563 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522471 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/852c4923-fad2-40f7-a57c-3c4674890b1f-os-release\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.522563 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522515 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-var-lib-openvswitch\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.522806 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522583 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.522806 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522625 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-cnibin\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.522806 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522676 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l8nw\" (UniqueName: \"kubernetes.io/projected/873029f8-0544-4b82-9ee1-c84e63aa34f7-kube-api-access-2l8nw\") pod \"node-ca-6fgns\" (UID: \"873029f8-0544-4b82-9ee1-c84e63aa34f7\") " pod="openshift-image-registry/node-ca-6fgns" Jul 01 22:11:40.522806 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522738 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-etc-openvswitch\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.522806 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522766 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-node-log\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.522806 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522790 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d622528-2d95-481d-9508-3595a7394ef6-host-slash\") pod \"iptables-alerter-m59vn\" (UID: \"8d622528-2d95-481d-9508-3595a7394ef6\") " pod="openshift-network-operator/iptables-alerter-m59vn" Jul 01 22:11:40.523062 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522815 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md4k2\" (UniqueName: \"kubernetes.io/projected/b0231217-a98e-4172-9544-84462de6618e-kube-api-access-md4k2\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.523062 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522844 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-var-lib-cni-multus\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.523062 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522876 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw6pz\" (UniqueName: \"kubernetes.io/projected/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-kube-api-access-kw6pz\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.523062 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522913 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-run\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.523062 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.522964 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d65a4b07-191f-4737-93c7-d08be8e1794e-dbus\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:40.523062 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523013 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-log-socket\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.523310 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523065 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-env-overrides\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.523310 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523090 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-lib-modules\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.523310 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523115 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-var-lib-kubelet\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.523310 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523155 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdc4d51c-db3d-4a64-bd97-74bf81067492-konnectivity-ca\") pod \"konnectivity-agent-fc8gq\" (UID: \"bdc4d51c-db3d-4a64-bd97-74bf81067492\") " pod="kube-system/konnectivity-agent-fc8gq" Jul 01 22:11:40.523310 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523194 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:40.523310 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523220 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-run-ovn\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.523310 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523232 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d65a4b07-191f-4737-93c7-d08be8e1794e-dbus\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:40.523310 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523237 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-cni-netd\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.523310 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-device-dir\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.523310 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:40.523295 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:11:40.523714 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523297 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/852c4923-fad2-40f7-a57c-3c4674890b1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.523714 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:40.523373 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret podName:d65a4b07-191f-4737-93c7-d08be8e1794e nodeName:}" failed. No retries permitted until 2026-07-01 22:11:41.02334845 +0000 UTC m=+4.110625920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret") pod "global-pull-secret-syncer-nj76z" (UID: "d65a4b07-191f-4737-93c7-d08be8e1794e") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:11:40.523714 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523395 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbjh9\" (UniqueName: \"kubernetes.io/projected/852c4923-fad2-40f7-a57c-3c4674890b1f-kube-api-access-sbjh9\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.523714 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523428 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/873029f8-0544-4b82-9ee1-c84e63aa34f7-host\") pod \"node-ca-6fgns\" (UID: \"873029f8-0544-4b82-9ee1-c84e63aa34f7\") " pod="openshift-image-registry/node-ca-6fgns" Jul 01 22:11:40.523714 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523491 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/873029f8-0544-4b82-9ee1-c84e63aa34f7-host\") pod \"node-ca-6fgns\" (UID: \"873029f8-0544-4b82-9ee1-c84e63aa34f7\") " pod="openshift-image-registry/node-ca-6fgns" Jul 01 22:11:40.523714 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523522 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdz8\" (UniqueName: \"kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8\") pod \"network-check-target-76hn9\" (UID: \"7593af7d-a289-49ad-96da-d36d890ee899\") " pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:40.523714 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523551 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-kubelet\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.523714 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523578 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-registration-dir\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.523714 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523618 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-system-cni-dir\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.523714 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523643 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-multus-daemon-config\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.523714 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523684 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-sys\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523732 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnntl\" (UniqueName: \"kubernetes.io/projected/c6bec832-936a-42f3-ad72-6033f2ba11ec-kube-api-access-gnntl\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-cni-bin\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523783 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523819 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-var-lib-kubelet\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523887 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-run-multus-certs\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523921 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-kubernetes\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523948 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-etc-selinux\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523973 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-sys-fs\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.523990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-cni-binary-copy\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524007 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdc4d51c-db3d-4a64-bd97-74bf81067492-agent-certs\") pod \"konnectivity-agent-fc8gq\" (UID: \"bdc4d51c-db3d-4a64-bd97-74bf81067492\") " pod="kube-system/konnectivity-agent-fc8gq" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-ovnkube-script-lib\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524059 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8jjj\" (UniqueName: \"kubernetes.io/projected/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-kube-api-access-l8jjj\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524104 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-multus-cni-dir\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.524214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524138 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-multus-conf-dir\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524170 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-sysctl-d\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524195 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476-hosts-file\") pod \"node-resolver-6q954\" (UID: \"c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476\") " pod="openshift-dns/node-resolver-6q954" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524228 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/873029f8-0544-4b82-9ee1-c84e63aa34f7-serviceca\") pod \"node-ca-6fgns\" (UID: \"873029f8-0544-4b82-9ee1-c84e63aa34f7\") " pod="openshift-image-registry/node-ca-6fgns" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524292 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-run-systemd\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524394 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-modprobe-d\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524424 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476-tmp-dir\") pod \"node-resolver-6q954\" (UID: \"c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476\") " pod="openshift-dns/node-resolver-6q954" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524456 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgsmr\" (UniqueName: \"kubernetes.io/projected/c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476-kube-api-access-vgsmr\") pod \"node-resolver-6q954\" (UID: \"c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476\") " pod="openshift-dns/node-resolver-6q954" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524481 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/852c4923-fad2-40f7-a57c-3c4674890b1f-cnibin\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524530 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/852c4923-fad2-40f7-a57c-3c4674890b1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524557 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-systemd-units\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524617 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-slash\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524644 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7g7s\" (UniqueName: \"kubernetes.io/projected/8d622528-2d95-481d-9508-3595a7394ef6-kube-api-access-s7g7s\") pod \"iptables-alerter-m59vn\" (UID: \"8d622528-2d95-481d-9508-3595a7394ef6\") " pod="openshift-network-operator/iptables-alerter-m59vn" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524674 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-run-netns\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.524854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524720 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-host\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524737 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/873029f8-0544-4b82-9ee1-c84e63aa34f7-serviceca\") pod \"node-ca-6fgns\" (UID: \"873029f8-0544-4b82-9ee1-c84e63aa34f7\") " pod="openshift-image-registry/node-ca-6fgns" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524744 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6bec832-936a-42f3-ad72-6033f2ba11ec-tmp\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524770 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/852c4923-fad2-40f7-a57c-3c4674890b1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524797 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6qrk\" (UniqueName: \"kubernetes.io/projected/7f8c06d2-2093-4cf2-9461-9accbc6ed553-kube-api-access-w6qrk\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524843 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-run-netns\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524868 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-ovnkube-config\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524904 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-hostroot\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524933 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-tuned\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.524975 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525037 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d65a4b07-191f-4737-93c7-d08be8e1794e-kubelet-config\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d65a4b07-191f-4737-93c7-d08be8e1794e-kubelet-config\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525101 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-ovn-node-metrics-cert\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-run-k8s-cni-cncf-io\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.525434 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525142 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-run-openvswitch\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.526005 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525164 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-systemd\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.526005 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/852c4923-fad2-40f7-a57c-3c4674890b1f-system-cni-dir\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.526005 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525206 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/852c4923-fad2-40f7-a57c-3c4674890b1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.526005 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8d622528-2d95-481d-9508-3595a7394ef6-iptables-alerter-script\") pod \"iptables-alerter-m59vn\" (UID: \"8d622528-2d95-481d-9508-3595a7394ef6\") " pod="openshift-network-operator/iptables-alerter-m59vn" Jul 01 22:11:40.526005 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525251 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-socket-dir\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.526005 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525275 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-sysconfig\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.526005 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525299 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-sysctl-conf\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.526005 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.525332 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-multus-socket-dir-parent\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.530635 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.530607 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 22:11:40.530925 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:40.530899 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:11:40.530925 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:40.530927 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:11:40.531084 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:40.530944 2568 projected.go:196] Error preparing data for projected volume kube-api-access-6qdz8 for pod openshift-network-diagnostics/network-check-target-76hn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:11:40.531084 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:40.531027 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8 podName:7593af7d-a289-49ad-96da-d36d890ee899 nodeName:}" failed. No retries permitted until 2026-07-01 22:11:41.031006258 +0000 UTC m=+4.118283725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6qdz8" (UniqueName: "kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8") pod "network-check-target-76hn9" (UID: "7593af7d-a289-49ad-96da-d36d890ee899") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:11:40.534919 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.534885 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l8nw\" (UniqueName: \"kubernetes.io/projected/873029f8-0544-4b82-9ee1-c84e63aa34f7-kube-api-access-2l8nw\") pod \"node-ca-6fgns\" (UID: \"873029f8-0544-4b82-9ee1-c84e63aa34f7\") " pod="openshift-image-registry/node-ca-6fgns" Jul 01 22:11:40.562608 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.562534 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-116.ec2.internal" event={"ID":"2ce2be86fb4a38cffeeb63b45a890e95","Type":"ContainerStarted","Data":"993c994032bf927c0eba65d561f03d4ff73fc36c73896ba336db4f8e0c288b7e"} Jul 01 22:11:40.563960 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.563933 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" event={"ID":"3e1608fae24a0b4f4e56d62a3705730b","Type":"ContainerStarted","Data":"fa63b2a96c77ec183e98795651eb3eb8784dfde218d6982a525887fd70631bd1"} Jul 01 22:11:40.626098 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626004 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d622528-2d95-481d-9508-3595a7394ef6-host-slash\") pod \"iptables-alerter-m59vn\" (UID: \"8d622528-2d95-481d-9508-3595a7394ef6\") " pod="openshift-network-operator/iptables-alerter-m59vn" Jul 01 22:11:40.626098 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626049 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md4k2\" (UniqueName: \"kubernetes.io/projected/b0231217-a98e-4172-9544-84462de6618e-kube-api-access-md4k2\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.626098 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626076 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-var-lib-cni-multus\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.626379 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626128 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-var-lib-cni-multus\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.626379 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626138 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d622528-2d95-481d-9508-3595a7394ef6-host-slash\") pod \"iptables-alerter-m59vn\" (UID: \"8d622528-2d95-481d-9508-3595a7394ef6\") " pod="openshift-network-operator/iptables-alerter-m59vn" Jul 01 22:11:40.626379 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6pz\" (UniqueName: \"kubernetes.io/projected/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-kube-api-access-kw6pz\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.626379 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-run\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.626379 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-log-socket\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.626379 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626325 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-env-overrides\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.626379 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626349 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-lib-modules\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.626379 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626373 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-var-lib-kubelet\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdc4d51c-db3d-4a64-bd97-74bf81067492-konnectivity-ca\") pod \"konnectivity-agent-fc8gq\" (UID: \"bdc4d51c-db3d-4a64-bd97-74bf81067492\") " pod="kube-system/konnectivity-agent-fc8gq" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626433 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-run\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626440 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-run-ovn\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626477 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-log-socket\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626499 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-cni-netd\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626516 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-lib-modules\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626528 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-device-dir\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626569 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-cni-netd\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/852c4923-fad2-40f7-a57c-3c4674890b1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626503 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-var-lib-kubelet\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626535 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-run-ovn\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626570 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-device-dir\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626609 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbjh9\" (UniqueName: \"kubernetes.io/projected/852c4923-fad2-40f7-a57c-3c4674890b1f-kube-api-access-sbjh9\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.626810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-kubelet\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626680 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-registration-dir\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626723 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-system-cni-dir\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626744 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-kubelet\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626747 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/852c4923-fad2-40f7-a57c-3c4674890b1f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626778 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-system-cni-dir\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626802 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-registration-dir\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626878 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-multus-daemon-config\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626895 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-env-overrides\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626902 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-sys\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626933 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-sys\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626956 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnntl\" (UniqueName: \"kubernetes.io/projected/c6bec832-936a-42f3-ad72-6033f2ba11ec-kube-api-access-gnntl\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.626993 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-cni-bin\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627040 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.627486 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627066 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-var-lib-kubelet\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627090 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-run-multus-certs\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627115 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-kubernetes\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627141 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-etc-selinux\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627154 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdc4d51c-db3d-4a64-bd97-74bf81067492-konnectivity-ca\") pod \"konnectivity-agent-fc8gq\" (UID: \"bdc4d51c-db3d-4a64-bd97-74bf81067492\") " pod="kube-system/konnectivity-agent-fc8gq" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627172 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-run-multus-certs\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627174 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-sys-fs\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627138 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627178 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-cni-bin\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-cni-binary-copy\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627219 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-var-lib-kubelet\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627224 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-kubernetes\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627230 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdc4d51c-db3d-4a64-bd97-74bf81067492-agent-certs\") pod \"konnectivity-agent-fc8gq\" (UID: \"bdc4d51c-db3d-4a64-bd97-74bf81067492\") " pod="kube-system/konnectivity-agent-fc8gq" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627278 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-etc-selinux\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.628200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627286 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-ovnkube-script-lib\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627319 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8jjj\" (UniqueName: \"kubernetes.io/projected/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-kube-api-access-l8jjj\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627248 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-sys-fs\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627347 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-multus-cni-dir\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-multus-conf-dir\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627402 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-sysctl-d\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627433 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476-hosts-file\") pod \"node-resolver-6q954\" (UID: \"c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476\") " pod="openshift-dns/node-resolver-6q954" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627463 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-run-systemd\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627487 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-modprobe-d\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627509 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476-tmp-dir\") pod \"node-resolver-6q954\" (UID: \"c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476\") " pod="openshift-dns/node-resolver-6q954" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627518 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-multus-daemon-config\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627535 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgsmr\" (UniqueName: \"kubernetes.io/projected/c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476-kube-api-access-vgsmr\") pod \"node-resolver-6q954\" (UID: \"c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476\") " pod="openshift-dns/node-resolver-6q954" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627563 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/852c4923-fad2-40f7-a57c-3c4674890b1f-cnibin\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627590 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/852c4923-fad2-40f7-a57c-3c4674890b1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627601 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-multus-cni-dir\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.628952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627617 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-systemd-units\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627645 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-multus-conf-dir\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627645 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-slash\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627689 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-slash\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627685 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7g7s\" (UniqueName: \"kubernetes.io/projected/8d622528-2d95-481d-9508-3595a7394ef6-kube-api-access-s7g7s\") pod \"iptables-alerter-m59vn\" (UID: \"8d622528-2d95-481d-9508-3595a7394ef6\") " pod="openshift-network-operator/iptables-alerter-m59vn" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-run-netns\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627793 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-host\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6bec832-936a-42f3-ad72-6033f2ba11ec-tmp\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627823 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-ovnkube-script-lib\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627819 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-cni-binary-copy\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627865 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-run-systemd\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627889 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-systemd-units\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627901 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/852c4923-fad2-40f7-a57c-3c4674890b1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627910 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-sysctl-d\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627912 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476-tmp-dir\") pod \"node-resolver-6q954\" (UID: \"c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476\") " pod="openshift-dns/node-resolver-6q954" Jul 01 22:11:40.629716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627928 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476-hosts-file\") pod \"node-resolver-6q954\" (UID: \"c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476\") " pod="openshift-dns/node-resolver-6q954" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627934 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6qrk\" (UniqueName: \"kubernetes.io/projected/7f8c06d2-2093-4cf2-9461-9accbc6ed553-kube-api-access-w6qrk\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627967 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-run-netns\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627979 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/852c4923-fad2-40f7-a57c-3c4674890b1f-cnibin\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.627994 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-ovnkube-config\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628007 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-host\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628018 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-hostroot\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628009 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-modprobe-d\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628048 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-tuned\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628054 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-run-netns\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628060 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-run-netns\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628076 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-hostroot\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628076 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:40.628151 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628166 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-ovn-node-metrics-cert\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.630478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-run-k8s-cni-cncf-io\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:40.628221 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs podName:7f8c06d2-2093-4cf2-9461-9accbc6ed553 nodeName:}" failed. No retries permitted until 2026-07-01 22:11:41.128204143 +0000 UTC m=+4.215481627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs") pod "network-metrics-daemon-qtm74" (UID: "7f8c06d2-2093-4cf2-9461-9accbc6ed553") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628236 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-run-k8s-cni-cncf-io\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628253 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-run-openvswitch\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628295 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-systemd\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628323 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/852c4923-fad2-40f7-a57c-3c4674890b1f-system-cni-dir\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628356 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/852c4923-fad2-40f7-a57c-3c4674890b1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628386 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8d622528-2d95-481d-9508-3595a7394ef6-iptables-alerter-script\") pod \"iptables-alerter-m59vn\" (UID: \"8d622528-2d95-481d-9508-3595a7394ef6\") " pod="openshift-network-operator/iptables-alerter-m59vn" Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628410 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-socket-dir\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628433 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-sysconfig\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628457 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-sysctl-conf\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628482 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-multus-socket-dir-parent\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628505 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.631244 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628534 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-os-release\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628559 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-var-lib-cni-bin\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628584 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-etc-kubernetes\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628605 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/852c4923-fad2-40f7-a57c-3c4674890b1f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628615 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-ovnkube-config\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628611 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/852c4923-fad2-40f7-a57c-3c4674890b1f-os-release\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628677 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-var-lib-openvswitch\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628679 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/852c4923-fad2-40f7-a57c-3c4674890b1f-system-cni-dir\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628697 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/852c4923-fad2-40f7-a57c-3c4674890b1f-os-release\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628707 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628723 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-sysconfig\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-cnibin\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628786 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-run-openvswitch\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628790 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-etc-openvswitch\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.631915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628838 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-node-log\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628836 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-etc-openvswitch\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.628994 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-sysctl-conf\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629056 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-multus-socket-dir-parent\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629142 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/852c4923-fad2-40f7-a57c-3c4674890b1f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629251 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-socket-dir\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629302 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-node-log\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629326 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/852c4923-fad2-40f7-a57c-3c4674890b1f-cni-binary-copy\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629344 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-systemd\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629346 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-host-var-lib-cni-bin\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629382 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-var-lib-openvswitch\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629382 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629396 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-os-release\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629419 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0231217-a98e-4172-9544-84462de6618e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629430 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-etc-kubernetes\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.632698 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629488 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8d622528-2d95-481d-9508-3595a7394ef6-iptables-alerter-script\") pod \"iptables-alerter-m59vn\" (UID: \"8d622528-2d95-481d-9508-3595a7394ef6\") " pod="openshift-network-operator/iptables-alerter-m59vn" Jul 01 22:11:40.633276 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.629645 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-cnibin\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.633276 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.631567 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c6bec832-936a-42f3-ad72-6033f2ba11ec-etc-tuned\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.633276 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.631619 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6bec832-936a-42f3-ad72-6033f2ba11ec-tmp\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.633276 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.632748 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdc4d51c-db3d-4a64-bd97-74bf81067492-agent-certs\") pod \"konnectivity-agent-fc8gq\" (UID: \"bdc4d51c-db3d-4a64-bd97-74bf81067492\") " pod="kube-system/konnectivity-agent-fc8gq" Jul 01 22:11:40.633276 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.633141 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-ovn-node-metrics-cert\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.638036 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.637993 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw6pz\" (UniqueName: \"kubernetes.io/projected/a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8-kube-api-access-kw6pz\") pod \"multus-96n9s\" (UID: \"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8\") " pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.638036 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.637991 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnntl\" (UniqueName: \"kubernetes.io/projected/c6bec832-936a-42f3-ad72-6033f2ba11ec-kube-api-access-gnntl\") pod \"tuned-g9wk5\" (UID: \"c6bec832-936a-42f3-ad72-6033f2ba11ec\") " pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.638316 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.638261 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md4k2\" (UniqueName: \"kubernetes.io/projected/b0231217-a98e-4172-9544-84462de6618e-kube-api-access-md4k2\") pod \"aws-ebs-csi-driver-node-2qp4s\" (UID: \"b0231217-a98e-4172-9544-84462de6618e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.640155 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.640129 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8jjj\" (UniqueName: \"kubernetes.io/projected/7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4-kube-api-access-l8jjj\") pod \"ovnkube-node-wt7qw\" (UID: \"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.640707 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.640557 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbjh9\" (UniqueName: \"kubernetes.io/projected/852c4923-fad2-40f7-a57c-3c4674890b1f-kube-api-access-sbjh9\") pod \"multus-additional-cni-plugins-5b5p2\" (UID: \"852c4923-fad2-40f7-a57c-3c4674890b1f\") " pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:40.640707 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.640664 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgsmr\" (UniqueName: \"kubernetes.io/projected/c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476-kube-api-access-vgsmr\") pod \"node-resolver-6q954\" (UID: \"c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476\") " pod="openshift-dns/node-resolver-6q954" Jul 01 22:11:40.640995 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.640945 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6qrk\" (UniqueName: \"kubernetes.io/projected/7f8c06d2-2093-4cf2-9461-9accbc6ed553-kube-api-access-w6qrk\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:40.641222 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.641204 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7g7s\" (UniqueName: \"kubernetes.io/projected/8d622528-2d95-481d-9508-3595a7394ef6-kube-api-access-s7g7s\") pod \"iptables-alerter-m59vn\" (UID: \"8d622528-2d95-481d-9508-3595a7394ef6\") " pod="openshift-network-operator/iptables-alerter-m59vn" Jul 01 22:11:40.651935 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.651909 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6fgns" Jul 01 22:11:40.659868 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.659850 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-96n9s" Jul 01 22:11:40.671873 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.671848 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:11:40.677825 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.677805 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m59vn" Jul 01 22:11:40.686777 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.686754 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" Jul 01 22:11:40.694702 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.694681 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6q954" Jul 01 22:11:40.702737 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.702716 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" Jul 01 22:11:40.711689 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.711652 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fc8gq" Jul 01 22:11:40.719591 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:40.719572 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5b5p2" Jul 01 22:11:41.032259 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:41.032217 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:41.032259 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:41.032267 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdz8\" (UniqueName: \"kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8\") pod \"network-check-target-76hn9\" (UID: \"7593af7d-a289-49ad-96da-d36d890ee899\") " pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:41.032515 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:41.032399 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:11:41.032515 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:41.032447 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:11:41.032515 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:41.032467 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:11:41.032515 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:41.032480 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret podName:d65a4b07-191f-4737-93c7-d08be8e1794e nodeName:}" failed. No retries permitted until 2026-07-01 22:11:42.032462116 +0000 UTC m=+5.119739581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret") pod "global-pull-secret-syncer-nj76z" (UID: "d65a4b07-191f-4737-93c7-d08be8e1794e") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:11:41.032515 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:41.032481 2568 projected.go:196] Error preparing data for projected volume kube-api-access-6qdz8 for pod openshift-network-diagnostics/network-check-target-76hn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:11:41.032515 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:41.032515 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8 podName:7593af7d-a289-49ad-96da-d36d890ee899 nodeName:}" failed. No retries permitted until 2026-07-01 22:11:42.032508712 +0000 UTC m=+5.119786176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6qdz8" (UniqueName: "kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8") pod "network-check-target-76hn9" (UID: "7593af7d-a289-49ad-96da-d36d890ee899") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:11:41.132715 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:41.132653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:41.132918 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:41.132798 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:11:41.132918 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:41.132861 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs podName:7f8c06d2-2093-4cf2-9461-9accbc6ed553 nodeName:}" failed. No retries permitted until 2026-07-01 22:11:42.132843532 +0000 UTC m=+5.220120997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs") pod "network-metrics-daemon-qtm74" (UID: "7f8c06d2-2093-4cf2-9461-9accbc6ed553") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:11:41.382572 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:41.382469 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 22:06:40 +0000 UTC" deadline="2028-02-22 04:24:57.025742161 +0000 UTC" Jul 01 22:11:41.382572 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:41.382507 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14406h13m15.64323925s" Jul 01 22:11:41.557950 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:41.557915 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:41.558112 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:41.558018 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:11:41.630654 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:41.630601 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0231217_a98e_4172_9544_84462de6618e.slice/crio-692db60f531404f13429ca611f114f8f12bc08ba92448d34c5b007e9e186b5dd WatchSource:0}: Error finding container 692db60f531404f13429ca611f114f8f12bc08ba92448d34c5b007e9e186b5dd: Status 404 returned error can't find the container with id 692db60f531404f13429ca611f114f8f12bc08ba92448d34c5b007e9e186b5dd Jul 01 22:11:41.632354 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:41.632292 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d622528_2d95_481d_9508_3595a7394ef6.slice/crio-d3f96513d15532d02254679890e96d26bf1a2672a9959341ec0fc689789c349d WatchSource:0}: Error finding container d3f96513d15532d02254679890e96d26bf1a2672a9959341ec0fc689789c349d: Status 404 returned error can't find the container with id d3f96513d15532d02254679890e96d26bf1a2672a9959341ec0fc689789c349d Jul 01 22:11:41.635697 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:41.635677 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873029f8_0544_4b82_9ee1_c84e63aa34f7.slice/crio-45ffaa9d766be9a8d309aeeb998645360d4a521598c9c98907e5ea1bebc26ab9 WatchSource:0}: Error finding container 45ffaa9d766be9a8d309aeeb998645360d4a521598c9c98907e5ea1bebc26ab9: Status 404 returned error can't find the container with id 45ffaa9d766be9a8d309aeeb998645360d4a521598c9c98907e5ea1bebc26ab9 Jul 01 22:11:41.637156 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:41.637129 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c0f7ce9_5bc1_4ba7_aa72_cda48f6af5b4.slice/crio-2305c0ccdac9f6f30dbe4678d5fba816c6c82f1481b04284b1850e6711d33d0a WatchSource:0}: Error finding container 2305c0ccdac9f6f30dbe4678d5fba816c6c82f1481b04284b1850e6711d33d0a: Status 404 returned error can't find the container with id 2305c0ccdac9f6f30dbe4678d5fba816c6c82f1481b04284b1850e6711d33d0a Jul 01 22:11:41.638046 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:41.638019 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852c4923_fad2_40f7_a57c_3c4674890b1f.slice/crio-dbdba98e99a77fcbe1d214bff2262e560c260f8990b2f17f34cd9cf14a36eeea WatchSource:0}: Error finding container dbdba98e99a77fcbe1d214bff2262e560c260f8990b2f17f34cd9cf14a36eeea: Status 404 returned error can't find the container with id dbdba98e99a77fcbe1d214bff2262e560c260f8990b2f17f34cd9cf14a36eeea Jul 01 22:11:41.640097 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:41.639870 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc4d51c_db3d_4a64_bd97_74bf81067492.slice/crio-be3a19eb4b0bcf248817c2f38bdadebc10d0266d5f54213d8044c7dbc5cd980f WatchSource:0}: Error finding container be3a19eb4b0bcf248817c2f38bdadebc10d0266d5f54213d8044c7dbc5cd980f: Status 404 returned error can't find the container with id be3a19eb4b0bcf248817c2f38bdadebc10d0266d5f54213d8044c7dbc5cd980f Jul 01 22:11:41.640662 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:41.640638 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f38a5a_299f_4ec2_9b52_d4fc37dee6a8.slice/crio-e338ed450f705a44a55022874d89099e5350e98d546ec0ec6693a90a1565b7de WatchSource:0}: Error finding container e338ed450f705a44a55022874d89099e5350e98d546ec0ec6693a90a1565b7de: Status 404 returned error can't find the container with id e338ed450f705a44a55022874d89099e5350e98d546ec0ec6693a90a1565b7de Jul 01 22:11:41.642386 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:41.641881 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bec832_936a_42f3_ad72_6033f2ba11ec.slice/crio-6c55da66b002aae72fe433748bb1323b578a1a563317f40c985d7322464b71b0 WatchSource:0}: Error finding container 6c55da66b002aae72fe433748bb1323b578a1a563317f40c985d7322464b71b0: Status 404 returned error can't find the container with id 6c55da66b002aae72fe433748bb1323b578a1a563317f40c985d7322464b71b0 Jul 01 22:11:41.643410 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:11:41.643385 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76adfcf_f1a2_4fb9_8e7c_e0a2d68b4476.slice/crio-64d97b705f5a3185631c7ca254bcb369cfa3be8f29e5d0f0e349f30f676ac5f4 WatchSource:0}: Error finding container 64d97b705f5a3185631c7ca254bcb369cfa3be8f29e5d0f0e349f30f676ac5f4: Status 404 returned error can't find the container with id 64d97b705f5a3185631c7ca254bcb369cfa3be8f29e5d0f0e349f30f676ac5f4 Jul 01 22:11:42.039050 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.038766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:42.039274 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.039079 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdz8\" (UniqueName: \"kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8\") pod \"network-check-target-76hn9\" (UID: \"7593af7d-a289-49ad-96da-d36d890ee899\") " pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:42.039274 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:42.038948 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:11:42.039274 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:42.039210 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret podName:d65a4b07-191f-4737-93c7-d08be8e1794e nodeName:}" failed. No retries permitted until 2026-07-01 22:11:44.039190372 +0000 UTC m=+7.126467846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret") pod "global-pull-secret-syncer-nj76z" (UID: "d65a4b07-191f-4737-93c7-d08be8e1794e") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:11:42.039274 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:42.039264 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:11:42.039450 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:42.039282 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:11:42.039450 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:42.039296 2568 projected.go:196] Error preparing data for projected volume kube-api-access-6qdz8 for pod openshift-network-diagnostics/network-check-target-76hn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:11:42.039450 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:42.039355 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8 podName:7593af7d-a289-49ad-96da-d36d890ee899 nodeName:}" failed. No retries permitted until 2026-07-01 22:11:44.039337249 +0000 UTC m=+7.126614719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6qdz8" (UniqueName: "kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8") pod "network-check-target-76hn9" (UID: "7593af7d-a289-49ad-96da-d36d890ee899") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:11:42.139979 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.139891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:42.140153 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:42.140077 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:11:42.140233 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:42.140159 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs podName:7f8c06d2-2093-4cf2-9461-9accbc6ed553 nodeName:}" failed. No retries permitted until 2026-07-01 22:11:44.140133871 +0000 UTC m=+7.227411345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs") pod "network-metrics-daemon-qtm74" (UID: "7f8c06d2-2093-4cf2-9461-9accbc6ed553") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:11:42.383474 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.383403 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 22:06:40 +0000 UTC" deadline="2027-12-12 06:53:08.262853039 +0000 UTC" Jul 01 22:11:42.383474 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.383472 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12680h41m25.879384978s" Jul 01 22:11:42.560891 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.560852 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:42.561116 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:42.561007 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:11:42.561116 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.561018 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:42.561253 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:42.561119 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:11:42.577768 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.577614 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" event={"ID":"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4","Type":"ContainerStarted","Data":"2305c0ccdac9f6f30dbe4678d5fba816c6c82f1481b04284b1850e6711d33d0a"} Jul 01 22:11:42.581627 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.581586 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6fgns" event={"ID":"873029f8-0544-4b82-9ee1-c84e63aa34f7","Type":"ContainerStarted","Data":"45ffaa9d766be9a8d309aeeb998645360d4a521598c9c98907e5ea1bebc26ab9"} Jul 01 22:11:42.600989 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.600634 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m59vn" event={"ID":"8d622528-2d95-481d-9508-3595a7394ef6","Type":"ContainerStarted","Data":"d3f96513d15532d02254679890e96d26bf1a2672a9959341ec0fc689789c349d"} Jul 01 22:11:42.630076 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.630029 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-116.ec2.internal" event={"ID":"2ce2be86fb4a38cffeeb63b45a890e95","Type":"ContainerStarted","Data":"ffcef6c54ba717d703950ddf5e7d7a66ceb92b7c35b3bd516b71bc6f5d8f6e41"} Jul 01 22:11:42.638629 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.638589 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6q954" event={"ID":"c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476","Type":"ContainerStarted","Data":"64d97b705f5a3185631c7ca254bcb369cfa3be8f29e5d0f0e349f30f676ac5f4"} Jul 01 22:11:42.643526 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.643495 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" event={"ID":"c6bec832-936a-42f3-ad72-6033f2ba11ec","Type":"ContainerStarted","Data":"6c55da66b002aae72fe433748bb1323b578a1a563317f40c985d7322464b71b0"} Jul 01 22:11:42.649386 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.649323 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-116.ec2.internal" podStartSLOduration=2.649305446 podStartE2EDuration="2.649305446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:11:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:11:42.648395763 +0000 UTC m=+5.735673252" watchObservedRunningTime="2026-07-01 22:11:42.649305446 +0000 UTC m=+5.736582938" Jul 01 22:11:42.649863 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.649835 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b5p2" event={"ID":"852c4923-fad2-40f7-a57c-3c4674890b1f","Type":"ContainerStarted","Data":"dbdba98e99a77fcbe1d214bff2262e560c260f8990b2f17f34cd9cf14a36eeea"} Jul 01 22:11:42.652211 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.652106 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" event={"ID":"b0231217-a98e-4172-9544-84462de6618e","Type":"ContainerStarted","Data":"692db60f531404f13429ca611f114f8f12bc08ba92448d34c5b007e9e186b5dd"} Jul 01 22:11:42.661718 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.660894 2568 generic.go:356] "Generic (PLEG): container finished" podID="3e1608fae24a0b4f4e56d62a3705730b" containerID="bf62c6d36d88b523ccd66129541d1b8be806be54932b8fe2fc4545c052e6be76" exitCode=0 Jul 01 22:11:42.661718 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.660981 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" event={"ID":"3e1608fae24a0b4f4e56d62a3705730b","Type":"ContainerDied","Data":"bf62c6d36d88b523ccd66129541d1b8be806be54932b8fe2fc4545c052e6be76"} Jul 01 22:11:42.682805 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.682752 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-96n9s" event={"ID":"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8","Type":"ContainerStarted","Data":"e338ed450f705a44a55022874d89099e5350e98d546ec0ec6693a90a1565b7de"} Jul 01 22:11:42.698399 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:42.698358 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fc8gq" event={"ID":"bdc4d51c-db3d-4a64-bd97-74bf81067492","Type":"ContainerStarted","Data":"be3a19eb4b0bcf248817c2f38bdadebc10d0266d5f54213d8044c7dbc5cd980f"} Jul 01 22:11:43.558754 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:43.558228 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:43.558754 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:43.558532 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:11:43.705778 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:43.705725 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" event={"ID":"3e1608fae24a0b4f4e56d62a3705730b","Type":"ContainerStarted","Data":"3c6f7fd6cfce3c900303299d5925287671fc27971d9f1f940d53171c3323f163"} Jul 01 22:11:44.056827 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:44.056785 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:44.057022 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:44.056847 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdz8\" (UniqueName: \"kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8\") pod \"network-check-target-76hn9\" (UID: \"7593af7d-a289-49ad-96da-d36d890ee899\") " pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:44.057022 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:44.056995 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:11:44.057022 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:44.057018 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:11:44.057294 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:44.057031 2568 projected.go:196] Error preparing data for projected volume kube-api-access-6qdz8 for pod openshift-network-diagnostics/network-check-target-76hn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:11:44.057294 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:44.057093 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8 podName:7593af7d-a289-49ad-96da-d36d890ee899 nodeName:}" failed. No retries permitted until 2026-07-01 22:11:48.057074103 +0000 UTC m=+11.144351572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6qdz8" (UniqueName: "kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8") pod "network-check-target-76hn9" (UID: "7593af7d-a289-49ad-96da-d36d890ee899") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:11:44.058069 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:44.057491 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:11:44.058069 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:44.057548 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret podName:d65a4b07-191f-4737-93c7-d08be8e1794e nodeName:}" failed. No retries permitted until 2026-07-01 22:11:48.057530427 +0000 UTC m=+11.144807897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret") pod "global-pull-secret-syncer-nj76z" (UID: "d65a4b07-191f-4737-93c7-d08be8e1794e") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:11:44.157394 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:44.157344 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:44.157590 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:44.157548 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:11:44.158045 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:44.157650 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs podName:7f8c06d2-2093-4cf2-9461-9accbc6ed553 nodeName:}" failed. No retries permitted until 2026-07-01 22:11:48.157617923 +0000 UTC m=+11.244895387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs") pod "network-metrics-daemon-qtm74" (UID: "7f8c06d2-2093-4cf2-9461-9accbc6ed553") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:11:44.564211 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:44.564179 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:44.564993 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:44.564961 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:11:44.565666 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:44.565638 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:44.565968 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:44.565945 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:11:45.558195 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:45.558106 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:45.558386 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:45.558242 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:11:46.558511 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:46.558003 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:46.558511 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:46.558168 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:11:46.558511 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:46.558185 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:46.558511 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:46.558268 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:11:47.558049 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:47.558014 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:47.558243 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:47.558145 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:11:48.096709 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:48.096457 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:48.096709 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:48.096507 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdz8\" (UniqueName: \"kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8\") pod \"network-check-target-76hn9\" (UID: \"7593af7d-a289-49ad-96da-d36d890ee899\") " pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:48.096709 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:48.096673 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:11:48.096709 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:48.096686 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:11:48.097340 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:48.096762 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret podName:d65a4b07-191f-4737-93c7-d08be8e1794e nodeName:}" failed. No retries permitted until 2026-07-01 22:11:56.096741247 +0000 UTC m=+19.184018713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret") pod "global-pull-secret-syncer-nj76z" (UID: "d65a4b07-191f-4737-93c7-d08be8e1794e") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:11:48.097340 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:48.096691 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:11:48.097340 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:48.096812 2568 projected.go:196] Error preparing data for projected volume kube-api-access-6qdz8 for pod openshift-network-diagnostics/network-check-target-76hn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:11:48.097340 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:48.096916 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8 podName:7593af7d-a289-49ad-96da-d36d890ee899 nodeName:}" failed. No retries permitted until 2026-07-01 22:11:56.096898972 +0000 UTC m=+19.184176449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6qdz8" (UniqueName: "kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8") pod "network-check-target-76hn9" (UID: "7593af7d-a289-49ad-96da-d36d890ee899") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:11:48.197539 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:48.197503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:48.197742 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:48.197635 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:11:48.197742 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:48.197714 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs podName:7f8c06d2-2093-4cf2-9461-9accbc6ed553 nodeName:}" failed. No retries permitted until 2026-07-01 22:11:56.197694676 +0000 UTC m=+19.284972138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs") pod "network-metrics-daemon-qtm74" (UID: "7f8c06d2-2093-4cf2-9461-9accbc6ed553") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:11:48.559468 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:48.559434 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:48.559629 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:48.559610 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:11:48.559713 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:48.559675 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:48.559818 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:48.559796 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:11:49.558063 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:49.557959 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:49.558540 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:49.558151 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:11:50.558518 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:50.558485 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:50.558969 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:50.558627 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:11:50.558969 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:50.558679 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:50.558969 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:50.558770 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:11:51.558328 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:51.558295 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:51.558508 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:51.558409 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:11:52.558078 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:52.558038 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:52.558457 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:52.558175 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:11:52.558457 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:52.558240 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:52.558457 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:52.558380 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:11:53.558050 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:53.558017 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:53.558214 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:53.558151 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:11:54.558495 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:54.558463 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:54.559060 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:54.558462 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:54.559060 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:54.558595 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:11:54.559060 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:54.558706 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:11:55.557723 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:55.557690 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:55.557939 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:55.557817 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:11:56.157014 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:56.156979 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:56.157014 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:56.157031 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdz8\" (UniqueName: \"kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8\") pod \"network-check-target-76hn9\" (UID: \"7593af7d-a289-49ad-96da-d36d890ee899\") " pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:56.157540 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:56.157159 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:11:56.157540 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:56.157220 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:11:56.157540 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:56.157239 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret podName:d65a4b07-191f-4737-93c7-d08be8e1794e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:12.157217407 +0000 UTC m=+35.244494875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret") pod "global-pull-secret-syncer-nj76z" (UID: "d65a4b07-191f-4737-93c7-d08be8e1794e") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:11:56.157540 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:56.157240 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:11:56.157540 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:56.157260 2568 projected.go:196] Error preparing data for projected volume kube-api-access-6qdz8 for pod openshift-network-diagnostics/network-check-target-76hn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:11:56.157540 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:56.157305 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8 podName:7593af7d-a289-49ad-96da-d36d890ee899 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:12.157285118 +0000 UTC m=+35.244562584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6qdz8" (UniqueName: "kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8") pod "network-check-target-76hn9" (UID: "7593af7d-a289-49ad-96da-d36d890ee899") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:11:56.257607 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:56.257569 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:56.257790 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:56.257738 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:11:56.257856 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:56.257822 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs podName:7f8c06d2-2093-4cf2-9461-9accbc6ed553 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:12.257799544 +0000 UTC m=+35.345077027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs") pod "network-metrics-daemon-qtm74" (UID: "7f8c06d2-2093-4cf2-9461-9accbc6ed553") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:11:56.558171 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:56.558138 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:56.558355 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:56.558138 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:56.558355 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:56.558268 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:11:56.558460 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:56.558348 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:11:57.557557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:57.557525 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:57.558028 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:57.557665 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:11:58.559224 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:58.559187 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:11:58.559672 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:58.559273 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:11:58.559672 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:58.559296 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:11:58.559672 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:58.559403 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:11:59.557867 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:11:59.557823 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:11:59.558022 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:11:59.557930 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:12:00.558445 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:00.558416 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:12:00.558894 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:00.558417 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:12:00.558894 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:00.558517 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:12:00.558894 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:00.558589 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:12:01.558036 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.557714 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:01.558247 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:01.558165 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:12:01.753076 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.753042 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-96n9s" event={"ID":"a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8","Type":"ContainerStarted","Data":"7c410b7eec11897b1b24305bb036128b165b616bb054c0ae7899ee585f299203"} Jul 01 22:12:01.754541 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.754504 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fc8gq" event={"ID":"bdc4d51c-db3d-4a64-bd97-74bf81067492","Type":"ContainerStarted","Data":"5e3161f2b9419891ca99c33e058840e7aec7ea59dd381e54da52d966b4ee96a5"} Jul 01 22:12:01.757302 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.757276 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" event={"ID":"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4","Type":"ContainerStarted","Data":"9603d98b29425873a19a1e665b75e4be107a838bf996dcb0ef294ad0c3c5460b"} Jul 01 22:12:01.757421 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.757353 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" event={"ID":"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4","Type":"ContainerStarted","Data":"1685aabcca6571bd1e231a76e7fa4dcb9776053487ed55f96e644d599e4b1710"} Jul 01 22:12:01.757421 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.757405 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" event={"ID":"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4","Type":"ContainerStarted","Data":"0a06e55d2fc93028c537c028f192b7bdebaf3d634aeb285ea8886420b22e0565"} Jul 01 22:12:01.757534 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.757452 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" event={"ID":"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4","Type":"ContainerStarted","Data":"b52a766214705fd373fd7a6689fb8fb764f8959bfeb1253deae134dbac41bbe9"} Jul 01 22:12:01.757534 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.757499 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" event={"ID":"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4","Type":"ContainerStarted","Data":"becb7bf7f713c3652f1c35592ba1501d68e548640e92fe40ab19023fe9bc8935"} Jul 01 22:12:01.757627 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.757547 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" event={"ID":"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4","Type":"ContainerStarted","Data":"4fdf981a690d2bde7f2ad6903e439f89e092c86ffb375899463b05eef1fb7487"} Jul 01 22:12:01.758686 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.758648 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6fgns" event={"ID":"873029f8-0544-4b82-9ee1-c84e63aa34f7","Type":"ContainerStarted","Data":"975ceb9ef3d566f20cb240467a070c0da4b079d8bbf8564acea3470afbffcdf1"} Jul 01 22:12:01.759898 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.759876 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6q954" event={"ID":"c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476","Type":"ContainerStarted","Data":"8974ee8fd6d011bc2605997dc273120b3b66bf31d8a7744dde5609022276292a"} Jul 01 22:12:01.761129 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.761109 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" event={"ID":"c6bec832-936a-42f3-ad72-6033f2ba11ec","Type":"ContainerStarted","Data":"dc08ee80666ee1c63586e6ccbd4a59dc2966cdd319e9a8030818677cae6ab0c2"} Jul 01 22:12:01.762485 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.762465 2568 generic.go:356] "Generic (PLEG): container finished" podID="852c4923-fad2-40f7-a57c-3c4674890b1f" containerID="4ffad0f2135cc8ebae3b953918329c6f34dfbef64f48814efed12fea8dfb4c64" exitCode=0 Jul 01 22:12:01.762564 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.762527 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b5p2" event={"ID":"852c4923-fad2-40f7-a57c-3c4674890b1f","Type":"ContainerDied","Data":"4ffad0f2135cc8ebae3b953918329c6f34dfbef64f48814efed12fea8dfb4c64"} Jul 01 22:12:01.763883 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.763867 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" event={"ID":"b0231217-a98e-4172-9544-84462de6618e","Type":"ContainerStarted","Data":"5eb48e1ebde239c88866b1ffb55c3635d926eac8c8648635c266cff2c8c12714"} Jul 01 22:12:01.772836 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.772796 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-116.ec2.internal" podStartSLOduration=21.772767577 podStartE2EDuration="21.772767577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:11:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:11:43.72365937 +0000 UTC m=+6.810936859" watchObservedRunningTime="2026-07-01 22:12:01.772767577 +0000 UTC m=+24.860045058" Jul 01 22:12:01.773170 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.773148 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-96n9s" podStartSLOduration=3.74199699 podStartE2EDuration="22.77314217s" totalImagesPullingTime="19.03114518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:01.772738883 +0000 UTC m=+24.860016366" watchObservedRunningTime="2026-07-01 22:12:01.77314217 +0000 UTC m=+24.860419654" Jul 01 22:12:01.788257 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.788211 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6q954" podStartSLOduration=3.824480262 podStartE2EDuration="22.788194959s" totalImagesPullingTime="18.963714697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:01.787644763 +0000 UTC m=+24.874922248" watchObservedRunningTime="2026-07-01 22:12:01.788194959 +0000 UTC m=+24.875472442" Jul 01 22:12:01.803543 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.803500 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fc8gq" podStartSLOduration=3.9074731849999997 podStartE2EDuration="22.80348705s" totalImagesPullingTime="18.896013865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:01.803328415 +0000 UTC m=+24.890605899" watchObservedRunningTime="2026-07-01 22:12:01.80348705 +0000 UTC m=+24.890764534" Jul 01 22:12:01.824356 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.824318 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g9wk5" podStartSLOduration=3.84322893 podStartE2EDuration="22.824303081s" totalImagesPullingTime="18.981074151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:01.8241935 +0000 UTC m=+24.911470983" watchObservedRunningTime="2026-07-01 22:12:01.824303081 +0000 UTC m=+24.911580558" Jul 01 22:12:01.867451 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.867407 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6fgns" podStartSLOduration=3.895665515 podStartE2EDuration="22.867390468s" totalImagesPullingTime="18.971724953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:01.86719748 +0000 UTC m=+24.954474964" watchObservedRunningTime="2026-07-01 22:12:01.867390468 +0000 UTC m=+24.954667951" Jul 01 22:12:01.918593 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:01.918564 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 22:12:02.558477 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:02.558441 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:12:02.558782 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:02.558643 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:12:02.558782 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:02.558644 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:12:02.558893 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:02.558776 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:12:02.577402 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:02.577309 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T22:12:01.918584549Z","UUID":"57be59b5-f2ee-4399-902a-02042513c3aa","Handler":null,"Name":"","Endpoint":""} Jul 01 22:12:02.579103 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:02.579076 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 22:12:02.579235 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:02.579123 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 22:12:02.769252 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:02.769218 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" event={"ID":"b0231217-a98e-4172-9544-84462de6618e","Type":"ContainerStarted","Data":"91781699de3587894f54862106b80ded204918d46ae81fcae030901a133abfa6"} Jul 01 22:12:02.771323 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:02.771287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m59vn" event={"ID":"8d622528-2d95-481d-9508-3595a7394ef6","Type":"ContainerStarted","Data":"44d563e0a02bc6ffa878875b051fc4881d1b90faf4637e281954f02293b24cdb"} Jul 01 22:12:02.787512 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:02.787466 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m59vn" podStartSLOduration=4.806591976 podStartE2EDuration="23.787447264s" totalImagesPullingTime="18.980855288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:02.78681064 +0000 UTC m=+25.874088125" watchObservedRunningTime="2026-07-01 22:12:02.787447264 +0000 UTC m=+25.874724747" Jul 01 22:12:03.521462 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:03.521432 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fc8gq" Jul 01 22:12:03.522111 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:03.522091 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fc8gq" Jul 01 22:12:03.557693 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:03.557652 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:03.557822 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:03.557769 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:12:03.775634 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:03.775507 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" event={"ID":"b0231217-a98e-4172-9544-84462de6618e","Type":"ContainerStarted","Data":"43fb3a015fefa496822459759f0853fe26d787e95491cdf5ea7d00168001917e"} Jul 01 22:12:03.780608 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:03.780191 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" event={"ID":"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4","Type":"ContainerStarted","Data":"3c4af3d95c0328a68560eee2ad63927ee0b3e185cce0f0626f783a2bed18f477"} Jul 01 22:12:03.782704 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:03.780930 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fc8gq" Jul 01 22:12:03.782704 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:03.781381 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fc8gq" Jul 01 22:12:03.798424 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:03.798371 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qp4s" podStartSLOduration=3.597038547 podStartE2EDuration="24.798353492s" totalImagesPullingTime="21.201314945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:03.797988663 +0000 UTC m=+26.885266148" watchObservedRunningTime="2026-07-01 22:12:03.798353492 +0000 UTC m=+26.885630974" Jul 01 22:12:04.557933 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:04.557899 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:12:04.558116 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:04.557945 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:12:04.558116 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:04.558039 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:12:04.558230 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:04.558156 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:12:05.558405 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:05.558156 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:05.558836 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:05.558509 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:12:06.558246 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:06.558217 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:12:06.558444 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:06.558217 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:12:06.558444 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:06.558318 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:12:06.558444 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:06.558399 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:12:06.786804 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:06.786771 2568 generic.go:356] "Generic (PLEG): container finished" podID="852c4923-fad2-40f7-a57c-3c4674890b1f" containerID="0c36acaf7553a417f7d1471a03931711e54e1b500811037b0a60ad53a8f08269" exitCode=0 Jul 01 22:12:06.786988 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:06.786867 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b5p2" event={"ID":"852c4923-fad2-40f7-a57c-3c4674890b1f","Type":"ContainerDied","Data":"0c36acaf7553a417f7d1471a03931711e54e1b500811037b0a60ad53a8f08269"} Jul 01 22:12:06.790669 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:06.790631 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" event={"ID":"7c0f7ce9-5bc1-4ba7-aa72-cda48f6af5b4","Type":"ContainerStarted","Data":"bc0092bf808595e27d6eb8c7e84751cdf6d10bb959e38b60a8d3ea79e57f9e32"} Jul 01 22:12:06.790942 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:06.790917 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:12:06.791031 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:06.790988 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:12:06.806200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:06.806177 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:12:06.854944 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:06.854852 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" podStartSLOduration=8.798478495 podStartE2EDuration="27.854836934s" totalImagesPullingTime="19.056358439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:06.854394566 +0000 UTC m=+29.941672050" watchObservedRunningTime="2026-07-01 22:12:06.854836934 +0000 UTC m=+29.942114418" Jul 01 22:12:07.558258 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:07.558227 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:07.558504 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:07.558350 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:12:07.794031 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:07.794004 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:12:07.809674 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:07.809576 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:12:08.015478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:08.015442 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qtm74"] Jul 01 22:12:08.015702 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:08.015589 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:12:08.015772 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:08.015723 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:12:08.019239 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:08.019212 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nj76z"] Jul 01 22:12:08.019395 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:08.019321 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:12:08.019460 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:08.019415 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:12:08.019840 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:08.019821 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-76hn9"] Jul 01 22:12:08.019935 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:08.019901 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:08.020009 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:08.019990 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:12:08.798123 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:08.798089 2568 generic.go:356] "Generic (PLEG): container finished" podID="852c4923-fad2-40f7-a57c-3c4674890b1f" containerID="ed711c14497cfb719f84e14a462c70c8bd654fb6480c47a421aa2bd987411891" exitCode=0 Jul 01 22:12:08.798566 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:08.798175 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b5p2" event={"ID":"852c4923-fad2-40f7-a57c-3c4674890b1f","Type":"ContainerDied","Data":"ed711c14497cfb719f84e14a462c70c8bd654fb6480c47a421aa2bd987411891"} Jul 01 22:12:09.558326 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:09.558298 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:12:09.558489 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:09.558310 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:12:09.558489 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:09.558412 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:09.558489 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:09.558413 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:12:09.558595 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:09.558514 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:12:09.558595 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:09.558569 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:12:10.808112 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:10.808079 2568 generic.go:356] "Generic (PLEG): container finished" podID="852c4923-fad2-40f7-a57c-3c4674890b1f" containerID="2a61fcb00f3d5d65098bbb3865735283a44b6868474aca945f9e81f5e5b5917c" exitCode=0 Jul 01 22:12:10.808488 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:10.808141 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b5p2" event={"ID":"852c4923-fad2-40f7-a57c-3c4674890b1f","Type":"ContainerDied","Data":"2a61fcb00f3d5d65098bbb3865735283a44b6868474aca945f9e81f5e5b5917c"} Jul 01 22:12:11.558228 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:11.558196 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:12:11.558402 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:11.558235 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:12:11.558402 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:11.558243 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:11.558402 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:11.558324 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nj76z" podUID="d65a4b07-191f-4737-93c7-d08be8e1794e" Jul 01 22:12:11.558534 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:11.558400 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtm74" podUID="7f8c06d2-2093-4cf2-9461-9accbc6ed553" Jul 01 22:12:11.558534 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:11.558445 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76hn9" podUID="7593af7d-a289-49ad-96da-d36d890ee899" Jul 01 22:12:12.181646 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:12.181609 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:12:12.181646 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:12.181648 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdz8\" (UniqueName: \"kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8\") pod \"network-check-target-76hn9\" (UID: \"7593af7d-a289-49ad-96da-d36d890ee899\") " pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:12.182137 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:12.181808 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 22:12:12.182137 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:12.181827 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 22:12:12.182137 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:12.181842 2568 projected.go:196] Error preparing data for projected volume kube-api-access-6qdz8 for pod openshift-network-diagnostics/network-check-target-76hn9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:12:12.182137 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:12.181842 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 22:12:12.182137 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:12.181906 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8 podName:7593af7d-a289-49ad-96da-d36d890ee899 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:44.181886432 +0000 UTC m=+67.269163912 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6qdz8" (UniqueName: "kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8") pod "network-check-target-76hn9" (UID: "7593af7d-a289-49ad-96da-d36d890ee899") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 22:12:12.182137 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:12.181924 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret podName:d65a4b07-191f-4737-93c7-d08be8e1794e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:44.181916673 +0000 UTC m=+67.269194140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret") pod "global-pull-secret-syncer-nj76z" (UID: "d65a4b07-191f-4737-93c7-d08be8e1794e") : object "kube-system"/"original-pull-secret" not registered Jul 01 22:12:12.282419 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:12.282380 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:12:12.282586 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:12.282521 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:12:12.282586 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:12.282586 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs podName:7f8c06d2-2093-4cf2-9461-9accbc6ed553 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:44.282569337 +0000 UTC m=+67.369846804 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs") pod "network-metrics-daemon-qtm74" (UID: "7f8c06d2-2093-4cf2-9461-9accbc6ed553") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 22:12:13.216695 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.216650 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-116.ec2.internal" event="NodeReady" Jul 01 22:12:13.217127 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.216804 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 22:12:13.255468 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.255433 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f94cfcdd4-b8zxd"] Jul 01 22:12:13.259781 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.259755 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.264747 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.264708 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 22:12:13.264976 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.264957 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 22:12:13.265128 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.265036 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 22:12:13.265231 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.265212 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nc4g9\"" Jul 01 22:12:13.271354 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.271332 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 22:12:13.273538 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.273518 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rmqxv"] Jul 01 22:12:13.277007 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.276989 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gslj7"] Jul 01 22:12:13.277138 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.277122 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rmqxv" Jul 01 22:12:13.280212 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.280190 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 22:12:13.280374 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.280355 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j755g\"" Jul 01 22:12:13.280706 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.280690 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 22:12:13.280995 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.280979 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 22:12:13.281073 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.281032 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.282769 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.282722 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f94cfcdd4-b8zxd"] Jul 01 22:12:13.284214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.284180 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 22:12:13.284354 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.284333 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 22:12:13.284828 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.284811 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j8cc2\"" Jul 01 22:12:13.291036 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.291012 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rmqxv"] Jul 01 22:12:13.292343 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.292324 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gslj7"] Jul 01 22:12:13.390252 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390152 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc46767a-a90e-429a-9288-c41b1fc4e90a-cert\") pod \"ingress-canary-rmqxv\" (UID: \"cc46767a-a90e-429a-9288-c41b1fc4e90a\") " pod="openshift-ingress-canary/ingress-canary-rmqxv" Jul 01 22:12:13.390252 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390199 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-bound-sa-token\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.390252 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390228 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-ca-trust-extracted\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.390544 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390305 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n8jl\" (UniqueName: \"kubernetes.io/projected/cc46767a-a90e-429a-9288-c41b1fc4e90a-kube-api-access-7n8jl\") pod \"ingress-canary-rmqxv\" (UID: \"cc46767a-a90e-429a-9288-c41b1fc4e90a\") " pod="openshift-ingress-canary/ingress-canary-rmqxv" Jul 01 22:12:13.390544 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390372 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.390544 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390413 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtqst\" (UniqueName: \"kubernetes.io/projected/e22595d9-5db0-4470-9253-2efe2469c3b4-kube-api-access-xtqst\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.390544 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390462 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-installation-pull-secrets\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.390544 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390483 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-certificates\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.390544 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390507 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e22595d9-5db0-4470-9253-2efe2469c3b4-config-volume\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.390833 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390583 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22595d9-5db0-4470-9253-2efe2469c3b4-tmp-dir\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.390833 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-image-registry-private-configuration\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.390833 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390788 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvwqt\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-kube-api-access-wvwqt\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.390959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390833 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.390959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.390865 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-trusted-ca\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.491556 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.491515 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc46767a-a90e-429a-9288-c41b1fc4e90a-cert\") pod \"ingress-canary-rmqxv\" (UID: \"cc46767a-a90e-429a-9288-c41b1fc4e90a\") " pod="openshift-ingress-canary/ingress-canary-rmqxv" Jul 01 22:12:13.491756 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.491565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-bound-sa-token\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.491756 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.491693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-ca-trust-extracted\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.491756 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.491737 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n8jl\" (UniqueName: \"kubernetes.io/projected/cc46767a-a90e-429a-9288-c41b1fc4e90a-kube-api-access-7n8jl\") pod \"ingress-canary-rmqxv\" (UID: \"cc46767a-a90e-429a-9288-c41b1fc4e90a\") " pod="openshift-ingress-canary/ingress-canary-rmqxv" Jul 01 22:12:13.491939 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.491760 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.491939 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.491780 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtqst\" (UniqueName: \"kubernetes.io/projected/e22595d9-5db0-4470-9253-2efe2469c3b4-kube-api-access-xtqst\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.491939 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.491807 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-installation-pull-secrets\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.491939 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.491834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-certificates\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.491939 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.491858 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e22595d9-5db0-4470-9253-2efe2469c3b4-config-volume\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.491939 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.491884 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22595d9-5db0-4470-9253-2efe2469c3b4-tmp-dir\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.492153 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.491957 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-image-registry-private-configuration\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.492153 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.491979 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvwqt\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-kube-api-access-wvwqt\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.492153 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.492003 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.492153 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.492043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-trusted-ca\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.492328 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.492232 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-ca-trust-extracted\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.492328 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:13.492288 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 22:12:13.492328 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:13.492309 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f94cfcdd4-b8zxd: secret "image-registry-tls" not found Jul 01 22:12:13.492463 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.492335 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e22595d9-5db0-4470-9253-2efe2469c3b4-tmp-dir\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.492463 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:13.492374 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls podName:1f5bcb6c-99cd-4a13-826d-21cdd30ae4df nodeName:}" failed. No retries permitted until 2026-07-01 22:12:13.992351955 +0000 UTC m=+37.079629428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls") pod "image-registry-6f94cfcdd4-b8zxd" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df") : secret "image-registry-tls" not found Jul 01 22:12:13.492578 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:13.492565 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 22:12:13.492629 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:13.492607 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls podName:e22595d9-5db0-4470-9253-2efe2469c3b4 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:13.992592547 +0000 UTC m=+37.079870010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls") pod "dns-default-gslj7" (UID: "e22595d9-5db0-4470-9253-2efe2469c3b4") : secret "dns-default-metrics-tls" not found Jul 01 22:12:13.492796 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.492768 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-certificates\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.492936 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.492897 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e22595d9-5db0-4470-9253-2efe2469c3b4-config-volume\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.493070 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.493046 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-trusted-ca\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.496571 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.496551 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-installation-pull-secrets\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.496668 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.496582 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-image-registry-private-configuration\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.496668 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.496614 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc46767a-a90e-429a-9288-c41b1fc4e90a-cert\") pod \"ingress-canary-rmqxv\" (UID: \"cc46767a-a90e-429a-9288-c41b1fc4e90a\") " pod="openshift-ingress-canary/ingress-canary-rmqxv" Jul 01 22:12:13.503624 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.503594 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-bound-sa-token\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.503750 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.503603 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtqst\" (UniqueName: \"kubernetes.io/projected/e22595d9-5db0-4470-9253-2efe2469c3b4-kube-api-access-xtqst\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.503750 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.503683 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n8jl\" (UniqueName: \"kubernetes.io/projected/cc46767a-a90e-429a-9288-c41b1fc4e90a-kube-api-access-7n8jl\") pod \"ingress-canary-rmqxv\" (UID: \"cc46767a-a90e-429a-9288-c41b1fc4e90a\") " pod="openshift-ingress-canary/ingress-canary-rmqxv" Jul 01 22:12:13.504353 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.504309 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvwqt\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-kube-api-access-wvwqt\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.558474 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.558441 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:12:13.558474 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.558452 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:12:13.558900 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.558879 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:13.561745 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.561714 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 22:12:13.561745 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.561732 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 22:12:13.561745 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.561717 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 22:12:13.561980 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.561948 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zmdlm\"" Jul 01 22:12:13.562037 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.561986 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 22:12:13.562037 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.561985 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-456tl\"" Jul 01 22:12:13.589985 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.589964 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rmqxv" Jul 01 22:12:13.996942 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.996902 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:13.997120 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:13.997011 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:13.997120 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:13.997072 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 22:12:13.997120 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:13.997094 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f94cfcdd4-b8zxd: secret "image-registry-tls" not found Jul 01 22:12:13.997248 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:13.997139 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 22:12:13.997248 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:13.997152 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls podName:1f5bcb6c-99cd-4a13-826d-21cdd30ae4df nodeName:}" failed. No retries permitted until 2026-07-01 22:12:14.997135534 +0000 UTC m=+38.084412999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls") pod "image-registry-6f94cfcdd4-b8zxd" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df") : secret "image-registry-tls" not found Jul 01 22:12:13.997248 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:13.997189 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls podName:e22595d9-5db0-4470-9253-2efe2469c3b4 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:14.997173609 +0000 UTC m=+38.084451073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls") pod "dns-default-gslj7" (UID: "e22595d9-5db0-4470-9253-2efe2469c3b4") : secret "dns-default-metrics-tls" not found Jul 01 22:12:14.857073 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:14.856917 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rmqxv"] Jul 01 22:12:14.865710 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:14.865680 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc46767a_a90e_429a_9288_c41b1fc4e90a.slice/crio-35a9173f2c9689e7add5757848b494ec2ecc37eb991128e3aa2145963ece73d6 WatchSource:0}: Error finding container 35a9173f2c9689e7add5757848b494ec2ecc37eb991128e3aa2145963ece73d6: Status 404 returned error can't find the container with id 35a9173f2c9689e7add5757848b494ec2ecc37eb991128e3aa2145963ece73d6 Jul 01 22:12:15.006217 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:15.006192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:15.006341 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:15.006276 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:15.006398 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:15.006334 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 22:12:15.006434 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:15.006402 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls podName:e22595d9-5db0-4470-9253-2efe2469c3b4 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:17.006386269 +0000 UTC m=+40.093663732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls") pod "dns-default-gslj7" (UID: "e22595d9-5db0-4470-9253-2efe2469c3b4") : secret "dns-default-metrics-tls" not found Jul 01 22:12:15.006434 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:15.006407 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 22:12:15.006434 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:15.006422 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f94cfcdd4-b8zxd: secret "image-registry-tls" not found Jul 01 22:12:15.006543 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:15.006460 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls podName:1f5bcb6c-99cd-4a13-826d-21cdd30ae4df nodeName:}" failed. No retries permitted until 2026-07-01 22:12:17.006448201 +0000 UTC m=+40.093725662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls") pod "image-registry-6f94cfcdd4-b8zxd" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df") : secret "image-registry-tls" not found Jul 01 22:12:15.823569 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:15.823540 2568 generic.go:356] "Generic (PLEG): container finished" podID="852c4923-fad2-40f7-a57c-3c4674890b1f" containerID="fe0942c5988a809d691bba3688dacfcdb509c59941e2ab5f2512a7cfab3a3f67" exitCode=0 Jul 01 22:12:15.823747 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:15.823603 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b5p2" event={"ID":"852c4923-fad2-40f7-a57c-3c4674890b1f","Type":"ContainerDied","Data":"fe0942c5988a809d691bba3688dacfcdb509c59941e2ab5f2512a7cfab3a3f67"} Jul 01 22:12:15.824811 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:15.824792 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rmqxv" event={"ID":"cc46767a-a90e-429a-9288-c41b1fc4e90a","Type":"ContainerStarted","Data":"35a9173f2c9689e7add5757848b494ec2ecc37eb991128e3aa2145963ece73d6"} Jul 01 22:12:16.830946 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:16.830909 2568 generic.go:356] "Generic (PLEG): container finished" podID="852c4923-fad2-40f7-a57c-3c4674890b1f" containerID="f4555c3b9cc7ae9646371731a1eeb116673c970f8aeb9f49c210a69b38fe030c" exitCode=0 Jul 01 22:12:16.831359 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:16.831006 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b5p2" event={"ID":"852c4923-fad2-40f7-a57c-3c4674890b1f","Type":"ContainerDied","Data":"f4555c3b9cc7ae9646371731a1eeb116673c970f8aeb9f49c210a69b38fe030c"} Jul 01 22:12:17.021567 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:17.021513 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:17.021768 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:17.021608 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:17.021768 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:17.021706 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 22:12:17.021885 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:17.021774 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 22:12:17.021885 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:17.021787 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls podName:e22595d9-5db0-4470-9253-2efe2469c3b4 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:21.021765448 +0000 UTC m=+44.109042940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls") pod "dns-default-gslj7" (UID: "e22595d9-5db0-4470-9253-2efe2469c3b4") : secret "dns-default-metrics-tls" not found Jul 01 22:12:17.021885 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:17.021793 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f94cfcdd4-b8zxd: secret "image-registry-tls" not found Jul 01 22:12:17.021885 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:17.021852 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls podName:1f5bcb6c-99cd-4a13-826d-21cdd30ae4df nodeName:}" failed. No retries permitted until 2026-07-01 22:12:21.021833029 +0000 UTC m=+44.109110495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls") pod "image-registry-6f94cfcdd4-b8zxd" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df") : secret "image-registry-tls" not found Jul 01 22:12:17.744317 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:17.744209 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:17.826242 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:17.826055 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:17.836957 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:17.836926 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5b5p2" event={"ID":"852c4923-fad2-40f7-a57c-3c4674890b1f","Type":"ContainerStarted","Data":"608c77925a917829af03595e7ced292281a92564214cc8d526f4d649a9a4140f"} Jul 01 22:12:17.838295 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:17.838273 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rmqxv" event={"ID":"cc46767a-a90e-429a-9288-c41b1fc4e90a","Type":"ContainerStarted","Data":"fea1e251acea5c4e6a317855a89617a0c239b24d3114a4558a408c695b413c0b"} Jul 01 22:12:17.864565 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:17.864513 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5b5p2" podStartSLOduration=9.555541275 podStartE2EDuration="38.864497148s" totalImagesPullingTime="29.308955873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:17.862613758 +0000 UTC m=+40.949891256" watchObservedRunningTime="2026-07-01 22:12:17.864497148 +0000 UTC m=+40.951774675" Jul 01 22:12:17.878439 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:17.878387 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rmqxv" podStartSLOduration=2.266957582 podStartE2EDuration="4.878369465s" totalImagesPullingTime="2.611411883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:17.877765604 +0000 UTC m=+40.965043101" watchObservedRunningTime="2026-07-01 22:12:17.878369465 +0000 UTC m=+40.965646949" Jul 01 22:12:17.927579 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:17.927548 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:18.061555 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:18.061471 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:18.155527 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:18.155492 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:21.049367 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:21.049325 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:21.049749 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:21.049394 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:21.049749 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:21.049476 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 22:12:21.049749 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:21.049529 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls podName:e22595d9-5db0-4470-9253-2efe2469c3b4 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:29.049516471 +0000 UTC m=+52.136793934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls") pod "dns-default-gslj7" (UID: "e22595d9-5db0-4470-9253-2efe2469c3b4") : secret "dns-default-metrics-tls" not found Jul 01 22:12:21.049749 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:21.049475 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 22:12:21.049749 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:21.049566 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f94cfcdd4-b8zxd: secret "image-registry-tls" not found Jul 01 22:12:21.049749 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:21.049619 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls podName:1f5bcb6c-99cd-4a13-826d-21cdd30ae4df nodeName:}" failed. No retries permitted until 2026-07-01 22:12:29.049604748 +0000 UTC m=+52.136882214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls") pod "image-registry-6f94cfcdd4-b8zxd" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df") : secret "image-registry-tls" not found Jul 01 22:12:26.272738 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.272704 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-x4d2p"] Jul 01 22:12:26.301547 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.301523 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-x4d2p"] Jul 01 22:12:26.301719 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.301612 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-x4d2p" Jul 01 22:12:26.304447 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.304423 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:12:26.305808 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.305786 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-j6p69\"" Jul 01 22:12:26.305918 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.305812 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 22:12:26.376487 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.376453 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd"] Jul 01 22:12:26.388737 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.388702 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6d75\" (UniqueName: \"kubernetes.io/projected/dba8fa25-e947-44e5-b2bc-ceae57514e6a-kube-api-access-q6d75\") pod \"volume-data-source-validator-69d9f679db-x4d2p\" (UID: \"dba8fa25-e947-44e5-b2bc-ceae57514e6a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-x4d2p" Jul 01 22:12:26.394808 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.394786 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-tbws5"] Jul 01 22:12:26.394923 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.394905 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" Jul 01 22:12:26.398018 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.397990 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 22:12:26.398206 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.398039 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mf2jh\"" Jul 01 22:12:26.398206 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.398112 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 22:12:26.398324 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.398241 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 22:12:26.398380 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.398245 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:12:26.416148 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.416123 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz"] Jul 01 22:12:26.416292 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.416239 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-tbws5" Jul 01 22:12:26.418894 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.418874 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qrhdh\"" Jul 01 22:12:26.439276 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.439250 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-rr67r"] Jul 01 22:12:26.439393 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.439355 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:26.442519 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.442500 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 22:12:26.443971 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.443931 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 22:12:26.443971 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.443962 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 22:12:26.444122 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.443935 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 22:12:26.444122 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.444012 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7ptt8\"" Jul 01 22:12:26.463478 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.463449 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-745b957bc7-5mptn"] Jul 01 22:12:26.463590 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.463565 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.468940 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.468912 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 22:12:26.469077 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.468963 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 22:12:26.469534 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.469513 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 22:12:26.470429 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.470410 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 22:12:26.474379 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.474361 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 22:12:26.475283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.475172 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-f7bp9\"" Jul 01 22:12:26.485645 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.485622 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd"] Jul 01 22:12:26.485893 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.485870 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-tbws5"] Jul 01 22:12:26.486098 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.486079 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-rr67r"] Jul 01 22:12:26.486180 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.486105 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-745b957bc7-5mptn"] Jul 01 22:12:26.486180 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.486128 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz"] Jul 01 22:12:26.486180 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.486156 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d"] Jul 01 22:12:26.486279 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.485803 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.489001 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.488970 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 22:12:26.489102 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.489042 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b4b77f2-5cb7-4784-ab97-b80ac9c18060-config\") pod \"service-ca-operator-5d7b7dc95c-9xghd\" (UID: \"6b4b77f2-5cb7-4784-ab97-b80ac9c18060\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" Jul 01 22:12:26.489102 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.489064 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lbxv\" (UniqueName: \"kubernetes.io/projected/6b4b77f2-5cb7-4784-ab97-b80ac9c18060-kube-api-access-8lbxv\") pod \"service-ca-operator-5d7b7dc95c-9xghd\" (UID: \"6b4b77f2-5cb7-4784-ab97-b80ac9c18060\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" Jul 01 22:12:26.489221 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.489105 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xt95p\"" Jul 01 22:12:26.489221 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.489112 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6d75\" (UniqueName: \"kubernetes.io/projected/dba8fa25-e947-44e5-b2bc-ceae57514e6a-kube-api-access-q6d75\") pod \"volume-data-source-validator-69d9f679db-x4d2p\" (UID: \"dba8fa25-e947-44e5-b2bc-ceae57514e6a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-x4d2p" Jul 01 22:12:26.489317 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.489221 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4b77f2-5cb7-4784-ab97-b80ac9c18060-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-9xghd\" (UID: \"6b4b77f2-5cb7-4784-ab97-b80ac9c18060\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" Jul 01 22:12:26.489468 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.489452 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 22:12:26.489544 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.489453 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 22:12:26.489601 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.489570 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 22:12:26.489723 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.489707 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 22:12:26.489902 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.489887 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 22:12:26.507993 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.507965 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k"] Jul 01 22:12:26.508130 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.508111 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:26.510598 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.510572 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6d75\" (UniqueName: \"kubernetes.io/projected/dba8fa25-e947-44e5-b2bc-ceae57514e6a-kube-api-access-q6d75\") pod \"volume-data-source-validator-69d9f679db-x4d2p\" (UID: \"dba8fa25-e947-44e5-b2bc-ceae57514e6a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-x4d2p" Jul 01 22:12:26.511287 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.511271 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 22:12:26.511772 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.511759 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 22:12:26.511968 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.511953 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kssh8\"" Jul 01 22:12:26.512036 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.511958 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:12:26.524140 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.524079 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-crb5t"] Jul 01 22:12:26.524255 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.524191 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" Jul 01 22:12:26.526935 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.526909 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 22:12:26.526935 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.526930 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:12:26.527111 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.526967 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 22:12:26.527111 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.526934 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 22:12:26.527268 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.527245 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-p4bsz\"" Jul 01 22:12:26.536134 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.536117 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d"] Jul 01 22:12:26.536226 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.536149 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k"] Jul 01 22:12:26.536226 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.536164 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-crb5t"] Jul 01 22:12:26.536293 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.536227 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.538830 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.538816 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 22:12:26.538954 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.538939 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 22:12:26.539092 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.539077 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 22:12:26.539452 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.539439 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2vhxq\"" Jul 01 22:12:26.539499 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.539458 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 22:12:26.547589 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.547563 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 22:12:26.589841 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.589807 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6xq8d\" (UID: \"6e936d36-f019-48bc-ae20-1ee9092ff43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:26.589841 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.589840 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dch6k\" (UniqueName: \"kubernetes.io/projected/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-kube-api-access-dch6k\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:26.590029 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.589863 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-serving-cert\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.590029 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.589929 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qwbv\" (UniqueName: \"kubernetes.io/projected/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-kube-api-access-2qwbv\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.590029 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.589950 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cslc2\" (UniqueName: \"kubernetes.io/projected/e3b2eda9-57a2-435f-8b5b-273e643baf4e-kube-api-access-cslc2\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.590029 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.589976 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.590029 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.589998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:26.590195 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590053 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-default-certificate\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.590195 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590100 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j9fd\" (UniqueName: \"kubernetes.io/projected/d1f5259a-0b87-4640-a1ed-4708d9fb1eb3-kube-api-access-7j9fd\") pod \"network-check-source-56499946bc-tbws5\" (UID: \"d1f5259a-0b87-4640-a1ed-4708d9fb1eb3\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-tbws5" Jul 01 22:12:26.590195 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590117 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.590195 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590144 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lbxv\" (UniqueName: \"kubernetes.io/projected/6b4b77f2-5cb7-4784-ab97-b80ac9c18060-kube-api-access-8lbxv\") pod \"service-ca-operator-5d7b7dc95c-9xghd\" (UID: \"6b4b77f2-5cb7-4784-ab97-b80ac9c18060\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" Jul 01 22:12:26.590352 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590237 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:26.590352 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590309 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-snapshots\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.590352 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590336 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-tmp\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.590452 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590353 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4b77f2-5cb7-4784-ab97-b80ac9c18060-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-9xghd\" (UID: \"6b4b77f2-5cb7-4784-ab97-b80ac9c18060\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" Jul 01 22:12:26.590452 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590370 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-stats-auth\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.590517 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590489 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b4b77f2-5cb7-4784-ab97-b80ac9c18060-config\") pod \"service-ca-operator-5d7b7dc95c-9xghd\" (UID: \"6b4b77f2-5cb7-4784-ab97-b80ac9c18060\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" Jul 01 22:12:26.590567 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590514 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-service-ca-bundle\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.590567 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590537 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjw86\" (UniqueName: \"kubernetes.io/projected/6e936d36-f019-48bc-ae20-1ee9092ff43c-kube-api-access-jjw86\") pod \"cluster-samples-operator-9ddc5ff76-6xq8d\" (UID: \"6e936d36-f019-48bc-ae20-1ee9092ff43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:26.590694 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.590596 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.591061 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.591039 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b4b77f2-5cb7-4784-ab97-b80ac9c18060-config\") pod \"service-ca-operator-5d7b7dc95c-9xghd\" (UID: \"6b4b77f2-5cb7-4784-ab97-b80ac9c18060\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" Jul 01 22:12:26.592750 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.592731 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4b77f2-5cb7-4784-ab97-b80ac9c18060-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-9xghd\" (UID: \"6b4b77f2-5cb7-4784-ab97-b80ac9c18060\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" Jul 01 22:12:26.598545 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.598510 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:26.599383 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.599364 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lbxv\" (UniqueName: \"kubernetes.io/projected/6b4b77f2-5cb7-4784-ab97-b80ac9c18060-kube-api-access-8lbxv\") pod \"service-ca-operator-5d7b7dc95c-9xghd\" (UID: \"6b4b77f2-5cb7-4784-ab97-b80ac9c18060\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" Jul 01 22:12:26.610267 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.610246 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-x4d2p" Jul 01 22:12:26.690259 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.690220 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:26.691081 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-snapshots\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.691140 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691101 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d85fb1e7-081a-469e-93bc-d6a08338daba-trusted-ca\") pod \"console-operator-7fdbdf9c99-crb5t\" (UID: \"d85fb1e7-081a-469e-93bc-d6a08338daba\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.691140 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691132 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-tmp\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.691218 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691166 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d85fb1e7-081a-469e-93bc-d6a08338daba-serving-cert\") pod \"console-operator-7fdbdf9c99-crb5t\" (UID: \"d85fb1e7-081a-469e-93bc-d6a08338daba\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.691218 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691193 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-stats-auth\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.691287 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691266 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-service-ca-bundle\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.691328 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691310 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw86\" (UniqueName: \"kubernetes.io/projected/6e936d36-f019-48bc-ae20-1ee9092ff43c-kube-api-access-jjw86\") pod \"cluster-samples-operator-9ddc5ff76-6xq8d\" (UID: \"6e936d36-f019-48bc-ae20-1ee9092ff43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:26.691375 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691341 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.691375 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691368 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6xq8d\" (UID: \"6e936d36-f019-48bc-ae20-1ee9092ff43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:26.691470 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691392 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dch6k\" (UniqueName: \"kubernetes.io/projected/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-kube-api-access-dch6k\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:26.691470 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-serving-cert\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.691470 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691457 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qwbv\" (UniqueName: \"kubernetes.io/projected/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-kube-api-access-2qwbv\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.691602 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691485 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslc2\" (UniqueName: \"kubernetes.io/projected/e3b2eda9-57a2-435f-8b5b-273e643baf4e-kube-api-access-cslc2\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.691602 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691514 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d85fb1e7-081a-469e-93bc-d6a08338daba-config\") pod \"console-operator-7fdbdf9c99-crb5t\" (UID: \"d85fb1e7-081a-469e-93bc-d6a08338daba\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.691602 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691555 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.691602 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691580 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fcbd7f4-17ea-40c3-a234-5278cd77e7e7-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-7zx7k\" (UID: \"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" Jul 01 22:12:26.691825 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691616 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:26.691825 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691681 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-default-certificate\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.691825 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691685 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-tmp\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.691825 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691739 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j9fd\" (UniqueName: \"kubernetes.io/projected/d1f5259a-0b87-4640-a1ed-4708d9fb1eb3-kube-api-access-7j9fd\") pod \"network-check-source-56499946bc-tbws5\" (UID: \"d1f5259a-0b87-4640-a1ed-4708d9fb1eb3\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-tbws5" Jul 01 22:12:26.691825 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691765 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.691825 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691760 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-snapshots\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.691825 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:26.691791 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 22:12:26.691825 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691798 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:26.692214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.691832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnbgg\" (UniqueName: \"kubernetes.io/projected/5fcbd7f4-17ea-40c3-a234-5278cd77e7e7-kube-api-access-hnbgg\") pod \"kube-storage-version-migrator-operator-79964ff6f9-7zx7k\" (UID: \"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" Jul 01 22:12:26.692214 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:26.691858 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls podName:6e936d36-f019-48bc-ae20-1ee9092ff43c nodeName:}" failed. No retries permitted until 2026-07-01 22:12:27.191838568 +0000 UTC m=+50.279116030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-6xq8d" (UID: "6e936d36-f019-48bc-ae20-1ee9092ff43c") : secret "samples-operator-tls" not found Jul 01 22:12:26.692214 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:26.691989 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 22:12:26.692214 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:26.692067 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle podName:e3b2eda9-57a2-435f-8b5b-273e643baf4e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:27.19204841 +0000 UTC m=+50.279325877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle") pod "router-default-745b957bc7-5mptn" (UID: "e3b2eda9-57a2-435f-8b5b-273e643baf4e") : configmap references non-existent config key: service-ca.crt Jul 01 22:12:26.692214 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:26.692095 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls podName:f6c316bc-3ae8-4c89-bf25-ee43411dad9d nodeName:}" failed. No retries permitted until 2026-07-01 22:12:27.192084346 +0000 UTC m=+50.279361823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g7tcz" (UID: "f6c316bc-3ae8-4c89-bf25-ee43411dad9d") : secret "cluster-monitoring-operator-tls" not found Jul 01 22:12:26.692214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.692133 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5fcbd7f4-17ea-40c3-a234-5278cd77e7e7-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-7zx7k\" (UID: \"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" Jul 01 22:12:26.692214 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:26.692170 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 22:12:26.692571 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.692230 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rps5d\" (UniqueName: \"kubernetes.io/projected/d85fb1e7-081a-469e-93bc-d6a08338daba-kube-api-access-rps5d\") pod \"console-operator-7fdbdf9c99-crb5t\" (UID: \"d85fb1e7-081a-469e-93bc-d6a08338daba\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.692571 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:26.692265 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs podName:e3b2eda9-57a2-435f-8b5b-273e643baf4e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:27.192253007 +0000 UTC m=+50.279530475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs") pod "router-default-745b957bc7-5mptn" (UID: "e3b2eda9-57a2-435f-8b5b-273e643baf4e") : secret "router-metrics-certs-default" not found Jul 01 22:12:26.692711 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.692585 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-service-ca-bundle\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.692844 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.692821 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.692948 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.692928 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:26.694237 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.694204 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-stats-auth\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.694370 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.694299 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-serving-cert\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.694540 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.694520 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-default-certificate\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.702427 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.702347 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjw86\" (UniqueName: \"kubernetes.io/projected/6e936d36-f019-48bc-ae20-1ee9092ff43c-kube-api-access-jjw86\") pod \"cluster-samples-operator-9ddc5ff76-6xq8d\" (UID: \"6e936d36-f019-48bc-ae20-1ee9092ff43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:26.704576 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.704559 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" Jul 01 22:12:26.705092 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.705068 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cslc2\" (UniqueName: \"kubernetes.io/projected/e3b2eda9-57a2-435f-8b5b-273e643baf4e-kube-api-access-cslc2\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:26.705187 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.705135 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qwbv\" (UniqueName: \"kubernetes.io/projected/d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc-kube-api-access-2qwbv\") pod \"insights-operator-5f67b55555-rr67r\" (UID: \"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc\") " pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.705187 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.705170 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dch6k\" (UniqueName: \"kubernetes.io/projected/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-kube-api-access-dch6k\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:26.705521 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.705504 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j9fd\" (UniqueName: \"kubernetes.io/projected/d1f5259a-0b87-4640-a1ed-4708d9fb1eb3-kube-api-access-7j9fd\") pod \"network-check-source-56499946bc-tbws5\" (UID: \"d1f5259a-0b87-4640-a1ed-4708d9fb1eb3\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-tbws5" Jul 01 22:12:26.725280 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.725255 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-tbws5" Jul 01 22:12:26.746408 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.746384 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-x4d2p"] Jul 01 22:12:26.772197 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.772173 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-rr67r" Jul 01 22:12:26.794317 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.794262 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d85fb1e7-081a-469e-93bc-d6a08338daba-config\") pod \"console-operator-7fdbdf9c99-crb5t\" (UID: \"d85fb1e7-081a-469e-93bc-d6a08338daba\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.794459 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.794319 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fcbd7f4-17ea-40c3-a234-5278cd77e7e7-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-7zx7k\" (UID: \"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" Jul 01 22:12:26.794459 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.794408 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnbgg\" (UniqueName: \"kubernetes.io/projected/5fcbd7f4-17ea-40c3-a234-5278cd77e7e7-kube-api-access-hnbgg\") pod \"kube-storage-version-migrator-operator-79964ff6f9-7zx7k\" (UID: \"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" Jul 01 22:12:26.794459 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.794438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5fcbd7f4-17ea-40c3-a234-5278cd77e7e7-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-7zx7k\" (UID: \"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" Jul 01 22:12:26.794614 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.794473 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rps5d\" (UniqueName: \"kubernetes.io/projected/d85fb1e7-081a-469e-93bc-d6a08338daba-kube-api-access-rps5d\") pod \"console-operator-7fdbdf9c99-crb5t\" (UID: \"d85fb1e7-081a-469e-93bc-d6a08338daba\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.794614 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.794523 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d85fb1e7-081a-469e-93bc-d6a08338daba-trusted-ca\") pod \"console-operator-7fdbdf9c99-crb5t\" (UID: \"d85fb1e7-081a-469e-93bc-d6a08338daba\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.794614 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.794560 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d85fb1e7-081a-469e-93bc-d6a08338daba-serving-cert\") pod \"console-operator-7fdbdf9c99-crb5t\" (UID: \"d85fb1e7-081a-469e-93bc-d6a08338daba\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.796044 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.795991 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5fcbd7f4-17ea-40c3-a234-5278cd77e7e7-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-7zx7k\" (UID: \"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" Jul 01 22:12:26.797697 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.797670 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d85fb1e7-081a-469e-93bc-d6a08338daba-trusted-ca\") pod \"console-operator-7fdbdf9c99-crb5t\" (UID: \"d85fb1e7-081a-469e-93bc-d6a08338daba\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.798279 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.798234 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d85fb1e7-081a-469e-93bc-d6a08338daba-config\") pod \"console-operator-7fdbdf9c99-crb5t\" (UID: \"d85fb1e7-081a-469e-93bc-d6a08338daba\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.798381 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.798331 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fcbd7f4-17ea-40c3-a234-5278cd77e7e7-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-7zx7k\" (UID: \"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" Jul 01 22:12:26.798712 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.798625 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d85fb1e7-081a-469e-93bc-d6a08338daba-serving-cert\") pod \"console-operator-7fdbdf9c99-crb5t\" (UID: \"d85fb1e7-081a-469e-93bc-d6a08338daba\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.805684 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.805583 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnbgg\" (UniqueName: \"kubernetes.io/projected/5fcbd7f4-17ea-40c3-a234-5278cd77e7e7-kube-api-access-hnbgg\") pod \"kube-storage-version-migrator-operator-79964ff6f9-7zx7k\" (UID: \"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" Jul 01 22:12:26.806373 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.806342 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rps5d\" (UniqueName: \"kubernetes.io/projected/d85fb1e7-081a-469e-93bc-d6a08338daba-kube-api-access-rps5d\") pod \"console-operator-7fdbdf9c99-crb5t\" (UID: \"d85fb1e7-081a-469e-93bc-d6a08338daba\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.833111 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.833083 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" Jul 01 22:12:26.845456 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.844992 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:26.894118 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.893975 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-x4d2p" event={"ID":"dba8fa25-e947-44e5-b2bc-ceae57514e6a","Type":"ContainerStarted","Data":"6fc63b52a90b91a15f9712e06e3b59a5b7c0bdce13fa5dc1bf5a256f245cac88"} Jul 01 22:12:26.903142 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.902993 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd"] Jul 01 22:12:26.905686 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:26.905610 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4b77f2_5cb7_4784_ab97_b80ac9c18060.slice/crio-cbd0467b7dda9c32aa9745675d7a4b85a98f75f225f8f558b64e24b6ff4fd394 WatchSource:0}: Error finding container cbd0467b7dda9c32aa9745675d7a4b85a98f75f225f8f558b64e24b6ff4fd394: Status 404 returned error can't find the container with id cbd0467b7dda9c32aa9745675d7a4b85a98f75f225f8f558b64e24b6ff4fd394 Jul 01 22:12:26.979477 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:26.979440 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-tbws5"] Jul 01 22:12:26.987785 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:26.987758 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f5259a_0b87_4640_a1ed_4708d9fb1eb3.slice/crio-eb89c128f2914c920f641bd3f790619b89071bafe77d3ddcfba6f13836703312 WatchSource:0}: Error finding container eb89c128f2914c920f641bd3f790619b89071bafe77d3ddcfba6f13836703312: Status 404 returned error can't find the container with id eb89c128f2914c920f641bd3f790619b89071bafe77d3ddcfba6f13836703312 Jul 01 22:12:27.019246 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:27.019218 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-rr67r"] Jul 01 22:12:27.022078 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:27.022041 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8939c3e_44b9_4eb8_aa2a_6145bca8e4fc.slice/crio-44c904d5a2a30e9bf659b66b2bbc84a1d3268d04f100cb8bea40119305407760 WatchSource:0}: Error finding container 44c904d5a2a30e9bf659b66b2bbc84a1d3268d04f100cb8bea40119305407760: Status 404 returned error can't find the container with id 44c904d5a2a30e9bf659b66b2bbc84a1d3268d04f100cb8bea40119305407760 Jul 01 22:12:27.025277 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:27.025236 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k"] Jul 01 22:12:27.027425 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:27.027404 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fcbd7f4_17ea_40c3_a234_5278cd77e7e7.slice/crio-31e58a2e3daa4e63166df3372602d068838b19decb26870a1b077e45b4ff9952 WatchSource:0}: Error finding container 31e58a2e3daa4e63166df3372602d068838b19decb26870a1b077e45b4ff9952: Status 404 returned error can't find the container with id 31e58a2e3daa4e63166df3372602d068838b19decb26870a1b077e45b4ff9952 Jul 01 22:12:27.045942 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:27.045911 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-crb5t"] Jul 01 22:12:27.049054 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:27.049026 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85fb1e7_081a_469e_93bc_d6a08338daba.slice/crio-6849d5991210031849a039ef2556c94b4dae597895ab954e06ac971d2cfafcb5 WatchSource:0}: Error finding container 6849d5991210031849a039ef2556c94b4dae597895ab954e06ac971d2cfafcb5: Status 404 returned error can't find the container with id 6849d5991210031849a039ef2556c94b4dae597895ab954e06ac971d2cfafcb5 Jul 01 22:12:27.199330 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:27.199292 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:27.199494 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:27.199344 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:27.199494 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:27.199447 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 22:12:27.199566 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:27.199505 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 22:12:27.199566 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:27.199509 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs podName:e3b2eda9-57a2-435f-8b5b-273e643baf4e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:28.199490173 +0000 UTC m=+51.286767658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs") pod "router-default-745b957bc7-5mptn" (UID: "e3b2eda9-57a2-435f-8b5b-273e643baf4e") : secret "router-metrics-certs-default" not found Jul 01 22:12:27.199566 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:27.199557 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls podName:f6c316bc-3ae8-4c89-bf25-ee43411dad9d nodeName:}" failed. No retries permitted until 2026-07-01 22:12:28.199545717 +0000 UTC m=+51.286823188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g7tcz" (UID: "f6c316bc-3ae8-4c89-bf25-ee43411dad9d") : secret "cluster-monitoring-operator-tls" not found Jul 01 22:12:27.199696 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:27.199679 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:27.199736 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:27.199713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6xq8d\" (UID: \"6e936d36-f019-48bc-ae20-1ee9092ff43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:27.199828 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:27.199810 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle podName:e3b2eda9-57a2-435f-8b5b-273e643baf4e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:28.199793751 +0000 UTC m=+51.287071214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle") pod "router-default-745b957bc7-5mptn" (UID: "e3b2eda9-57a2-435f-8b5b-273e643baf4e") : configmap references non-existent config key: service-ca.crt Jul 01 22:12:27.199877 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:27.199815 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 22:12:27.199877 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:27.199856 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls podName:6e936d36-f019-48bc-ae20-1ee9092ff43c nodeName:}" failed. No retries permitted until 2026-07-01 22:12:28.199844369 +0000 UTC m=+51.287121830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-6xq8d" (UID: "6e936d36-f019-48bc-ae20-1ee9092ff43c") : secret "samples-operator-tls" not found Jul 01 22:12:27.899036 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:27.898957 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-tbws5" event={"ID":"d1f5259a-0b87-4640-a1ed-4708d9fb1eb3","Type":"ContainerStarted","Data":"eb89c128f2914c920f641bd3f790619b89071bafe77d3ddcfba6f13836703312"} Jul 01 22:12:27.901199 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:27.901101 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" event={"ID":"6b4b77f2-5cb7-4784-ab97-b80ac9c18060","Type":"ContainerStarted","Data":"cbd0467b7dda9c32aa9745675d7a4b85a98f75f225f8f558b64e24b6ff4fd394"} Jul 01 22:12:27.904429 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:27.904406 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" event={"ID":"d85fb1e7-081a-469e-93bc-d6a08338daba","Type":"ContainerStarted","Data":"6849d5991210031849a039ef2556c94b4dae597895ab954e06ac971d2cfafcb5"} Jul 01 22:12:27.907197 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:27.907101 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-rr67r" event={"ID":"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc","Type":"ContainerStarted","Data":"44c904d5a2a30e9bf659b66b2bbc84a1d3268d04f100cb8bea40119305407760"} Jul 01 22:12:27.908602 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:27.908548 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" event={"ID":"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7","Type":"ContainerStarted","Data":"31e58a2e3daa4e63166df3372602d068838b19decb26870a1b077e45b4ff9952"} Jul 01 22:12:28.208819 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:28.208776 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:28.208978 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:28.208835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6xq8d\" (UID: \"6e936d36-f019-48bc-ae20-1ee9092ff43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:28.208978 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:28.208907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:28.208978 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:28.208959 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:28.209921 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:28.209162 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 22:12:28.209921 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:28.209226 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs podName:e3b2eda9-57a2-435f-8b5b-273e643baf4e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:30.209208484 +0000 UTC m=+53.296485954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs") pod "router-default-745b957bc7-5mptn" (UID: "e3b2eda9-57a2-435f-8b5b-273e643baf4e") : secret "router-metrics-certs-default" not found Jul 01 22:12:28.209921 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:28.209618 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle podName:e3b2eda9-57a2-435f-8b5b-273e643baf4e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:30.209602124 +0000 UTC m=+53.296879600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle") pod "router-default-745b957bc7-5mptn" (UID: "e3b2eda9-57a2-435f-8b5b-273e643baf4e") : configmap references non-existent config key: service-ca.crt Jul 01 22:12:28.209921 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:28.209713 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 22:12:28.209921 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:28.209751 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls podName:6e936d36-f019-48bc-ae20-1ee9092ff43c nodeName:}" failed. No retries permitted until 2026-07-01 22:12:30.209736997 +0000 UTC m=+53.297014463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-6xq8d" (UID: "6e936d36-f019-48bc-ae20-1ee9092ff43c") : secret "samples-operator-tls" not found Jul 01 22:12:28.209921 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:28.209805 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 22:12:28.209921 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:28.209840 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls podName:f6c316bc-3ae8-4c89-bf25-ee43411dad9d nodeName:}" failed. No retries permitted until 2026-07-01 22:12:30.209828279 +0000 UTC m=+53.297105745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g7tcz" (UID: "f6c316bc-3ae8-4c89-bf25-ee43411dad9d") : secret "cluster-monitoring-operator-tls" not found Jul 01 22:12:28.285669 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:28.285614 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:28.359477 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:28.359432 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:29.120133 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:29.120057 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:29.120607 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:29.120173 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:29.120607 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:29.120212 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 22:12:29.120607 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:29.120238 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f94cfcdd4-b8zxd: secret "image-registry-tls" not found Jul 01 22:12:29.120607 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:29.120308 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls podName:1f5bcb6c-99cd-4a13-826d-21cdd30ae4df nodeName:}" failed. No retries permitted until 2026-07-01 22:12:45.120286929 +0000 UTC m=+68.207564405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls") pod "image-registry-6f94cfcdd4-b8zxd" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df") : secret "image-registry-tls" not found Jul 01 22:12:29.120607 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:29.120362 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 22:12:29.120607 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:29.120415 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls podName:e22595d9-5db0-4470-9253-2efe2469c3b4 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:45.120398113 +0000 UTC m=+68.207675601 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls") pod "dns-default-gslj7" (UID: "e22595d9-5db0-4470-9253-2efe2469c3b4") : secret "dns-default-metrics-tls" not found Jul 01 22:12:29.164989 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:29.164833 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:29.265624 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:29.265587 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:29.588189 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:29.588144 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:29.671907 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:29.671820 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:29.772048 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:29.772011 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:29.872055 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:29.871974 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:29.972826 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:29.972787 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:30.232295 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:30.232259 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:30.232295 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:30.232298 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6xq8d\" (UID: \"6e936d36-f019-48bc-ae20-1ee9092ff43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:30.232792 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:30.232337 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:30.232792 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:30.232370 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:30.232792 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:30.232456 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 22:12:30.232792 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:30.232499 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs podName:e3b2eda9-57a2-435f-8b5b-273e643baf4e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:34.232486785 +0000 UTC m=+57.319764247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs") pod "router-default-745b957bc7-5mptn" (UID: "e3b2eda9-57a2-435f-8b5b-273e643baf4e") : secret "router-metrics-certs-default" not found Jul 01 22:12:30.232792 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:30.232499 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 22:12:30.232792 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:30.232512 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle podName:e3b2eda9-57a2-435f-8b5b-273e643baf4e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:34.232505052 +0000 UTC m=+57.319782514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle") pod "router-default-745b957bc7-5mptn" (UID: "e3b2eda9-57a2-435f-8b5b-273e643baf4e") : configmap references non-existent config key: service-ca.crt Jul 01 22:12:30.232792 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:30.232573 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls podName:f6c316bc-3ae8-4c89-bf25-ee43411dad9d nodeName:}" failed. No retries permitted until 2026-07-01 22:12:34.232551992 +0000 UTC m=+57.319829454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g7tcz" (UID: "f6c316bc-3ae8-4c89-bf25-ee43411dad9d") : secret "cluster-monitoring-operator-tls" not found Jul 01 22:12:30.232792 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:30.232454 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 22:12:30.232792 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:30.232629 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls podName:6e936d36-f019-48bc-ae20-1ee9092ff43c nodeName:}" failed. No retries permitted until 2026-07-01 22:12:34.232615835 +0000 UTC m=+57.319893297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-6xq8d" (UID: "6e936d36-f019-48bc-ae20-1ee9092ff43c") : secret "samples-operator-tls" not found Jul 01 22:12:30.658280 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:30.658186 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:31.054030 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:31.053983 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:31.162348 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:31.162307 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:31.257846 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:31.257811 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:33.926555 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:33.926523 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/0.log" Jul 01 22:12:33.927009 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:33.926570 2568 generic.go:356] "Generic (PLEG): container finished" podID="d85fb1e7-081a-469e-93bc-d6a08338daba" containerID="259464d696edc48fdeeaa7944d6c50f9a7d8fedc0c0de496ea45a47f7e372348" exitCode=255 Jul 01 22:12:33.927009 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:33.926646 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" event={"ID":"d85fb1e7-081a-469e-93bc-d6a08338daba","Type":"ContainerDied","Data":"259464d696edc48fdeeaa7944d6c50f9a7d8fedc0c0de496ea45a47f7e372348"} Jul 01 22:12:33.927009 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:33.926950 2568 scope.go:117] "RemoveContainer" containerID="259464d696edc48fdeeaa7944d6c50f9a7d8fedc0c0de496ea45a47f7e372348" Jul 01 22:12:33.928519 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:33.928490 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-rr67r" event={"ID":"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc","Type":"ContainerStarted","Data":"2357dd9802187589c84404b3bd40d2516f9a407c2b7fdbdb25b9166ca8e8e6b8"} Jul 01 22:12:33.930609 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:33.930540 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" event={"ID":"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7","Type":"ContainerStarted","Data":"1d77d8aa1603af05cf6534a34fd99e8db2a1c521c10e47b4e76f88db19955e57"} Jul 01 22:12:33.932910 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:33.932877 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-tbws5" event={"ID":"d1f5259a-0b87-4640-a1ed-4708d9fb1eb3","Type":"ContainerStarted","Data":"c9bc31f3604eec74bc250fd452c1c73977595a0919eb4da4adf05d3a594f4712"} Jul 01 22:12:33.935078 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:33.935050 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" event={"ID":"6b4b77f2-5cb7-4784-ab97-b80ac9c18060","Type":"ContainerStarted","Data":"d8f0ed436e991dee82dea7b4e76bbdf6485ddf0473de1d4c0f72dad77966bec7"} Jul 01 22:12:33.936651 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:33.936626 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-x4d2p" event={"ID":"dba8fa25-e947-44e5-b2bc-ceae57514e6a","Type":"ContainerStarted","Data":"242e5336b5c4435c3a685689054ec09c4a995e8427e050b40fae74a361085f3d"} Jul 01 22:12:33.970710 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:33.970360 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" podStartSLOduration=1.597347145 podStartE2EDuration="7.970341786s" totalImagesPullingTime="6.372994641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:33.970172147 +0000 UTC m=+57.057449631" watchObservedRunningTime="2026-07-01 22:12:33.970341786 +0000 UTC m=+57.057619271" Jul 01 22:12:34.013243 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.013082 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-rr67r" podStartSLOduration=1.754683076 podStartE2EDuration="8.013060376s" totalImagesPullingTime="6.2583773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:33.993308288 +0000 UTC m=+57.080585773" watchObservedRunningTime="2026-07-01 22:12:34.013060376 +0000 UTC m=+57.100337857" Jul 01 22:12:34.013994 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.013953 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-x4d2p" podStartSLOduration=1.549400956 podStartE2EDuration="8.013939088s" totalImagesPullingTime="6.464538132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:34.012834971 +0000 UTC m=+57.100112455" watchObservedRunningTime="2026-07-01 22:12:34.013939088 +0000 UTC m=+57.101216574" Jul 01 22:12:34.056829 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.056774 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-tbws5" podStartSLOduration=1.753313741 podStartE2EDuration="8.056759051s" totalImagesPullingTime="6.30344531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:34.037902598 +0000 UTC m=+57.125180084" watchObservedRunningTime="2026-07-01 22:12:34.056759051 +0000 UTC m=+57.144036578" Jul 01 22:12:34.057004 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.056895 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" podStartSLOduration=1.803411134 podStartE2EDuration="8.056890873s" totalImagesPullingTime="6.253479739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:34.055794081 +0000 UTC m=+57.143071581" watchObservedRunningTime="2026-07-01 22:12:34.056890873 +0000 UTC m=+57.144168413" Jul 01 22:12:34.133805 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.133765 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:34.271556 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.271510 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:34.271756 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.271589 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:34.271756 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:34.271698 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 22:12:34.271756 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.271713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:34.271756 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:34.271719 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 22:12:34.271756 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.271741 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6xq8d\" (UID: \"6e936d36-f019-48bc-ae20-1ee9092ff43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:34.271994 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:34.271776 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls podName:f6c316bc-3ae8-4c89-bf25-ee43411dad9d nodeName:}" failed. No retries permitted until 2026-07-01 22:12:42.27175563 +0000 UTC m=+65.359033100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g7tcz" (UID: "f6c316bc-3ae8-4c89-bf25-ee43411dad9d") : secret "cluster-monitoring-operator-tls" not found Jul 01 22:12:34.271994 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:34.271794 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs podName:e3b2eda9-57a2-435f-8b5b-273e643baf4e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:42.271785236 +0000 UTC m=+65.359062705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs") pod "router-default-745b957bc7-5mptn" (UID: "e3b2eda9-57a2-435f-8b5b-273e643baf4e") : secret "router-metrics-certs-default" not found Jul 01 22:12:34.271994 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:34.271826 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle podName:e3b2eda9-57a2-435f-8b5b-273e643baf4e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:42.271809957 +0000 UTC m=+65.359087424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle") pod "router-default-745b957bc7-5mptn" (UID: "e3b2eda9-57a2-435f-8b5b-273e643baf4e") : configmap references non-existent config key: service-ca.crt Jul 01 22:12:34.271994 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:34.271831 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 22:12:34.271994 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:34.271874 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls podName:6e936d36-f019-48bc-ae20-1ee9092ff43c nodeName:}" failed. No retries permitted until 2026-07-01 22:12:42.271861131 +0000 UTC m=+65.359138600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-6xq8d" (UID: "6e936d36-f019-48bc-ae20-1ee9092ff43c") : secret "samples-operator-tls" not found Jul 01 22:12:34.683166 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.683070 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:34.739645 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.739611 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jpmzx"] Jul 01 22:12:34.743604 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.743581 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.748444 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.748199 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nkrvr\"" Jul 01 22:12:34.748444 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.748198 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 22:12:34.749393 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.749376 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 22:12:34.761799 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.761773 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpmzx"] Jul 01 22:12:34.776779 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.776637 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.776779 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.776686 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxx9r\" (UniqueName: \"kubernetes.io/projected/753915d6-e023-4dbd-804e-7832002f1a59-kube-api-access-fxx9r\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.776779 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.776781 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/753915d6-e023-4dbd-804e-7832002f1a59-data-volume\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.777111 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.776848 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/753915d6-e023-4dbd-804e-7832002f1a59-crio-socket\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.777111 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.776991 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.791393 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.791365 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:34.878105 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.878068 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/753915d6-e023-4dbd-804e-7832002f1a59-data-volume\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.878249 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.878157 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/753915d6-e023-4dbd-804e-7832002f1a59-crio-socket\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.878249 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.878213 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.878357 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.878296 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/753915d6-e023-4dbd-804e-7832002f1a59-crio-socket\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.878357 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:34.878316 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 22:12:34.878495 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.878396 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/753915d6-e023-4dbd-804e-7832002f1a59-data-volume\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.878495 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.878402 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.878495 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:34.878430 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls podName:753915d6-e023-4dbd-804e-7832002f1a59 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:35.378404391 +0000 UTC m=+58.465681865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpmzx" (UID: "753915d6-e023-4dbd-804e-7832002f1a59") : secret "insights-runtime-extractor-tls" not found Jul 01 22:12:34.878495 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.878469 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxx9r\" (UniqueName: \"kubernetes.io/projected/753915d6-e023-4dbd-804e-7832002f1a59-kube-api-access-fxx9r\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.878495 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:34.878472 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 22:12:34.878710 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:34.878526 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm podName:753915d6-e023-4dbd-804e-7832002f1a59 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:35.378507913 +0000 UTC m=+58.465785389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpmzx" (UID: "753915d6-e023-4dbd-804e-7832002f1a59") : configmap "kube-rbac-proxy" not found Jul 01 22:12:34.893794 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.893767 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxx9r\" (UniqueName: \"kubernetes.io/projected/753915d6-e023-4dbd-804e-7832002f1a59-kube-api-access-fxx9r\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:34.903876 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.903844 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:34.943122 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.943042 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/1.log" Jul 01 22:12:34.943542 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.943526 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/0.log" Jul 01 22:12:34.943601 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.943568 2568 generic.go:356] "Generic (PLEG): container finished" podID="d85fb1e7-081a-469e-93bc-d6a08338daba" containerID="226f7282381a5610cb0768b3b2064fa3bbce29ddecff396c9969886b06192db2" exitCode=255 Jul 01 22:12:34.943699 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.943675 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" event={"ID":"d85fb1e7-081a-469e-93bc-d6a08338daba","Type":"ContainerDied","Data":"226f7282381a5610cb0768b3b2064fa3bbce29ddecff396c9969886b06192db2"} Jul 01 22:12:34.943756 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.943736 2568 scope.go:117] "RemoveContainer" containerID="259464d696edc48fdeeaa7944d6c50f9a7d8fedc0c0de496ea45a47f7e372348" Jul 01 22:12:34.944310 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:34.944057 2568 scope.go:117] "RemoveContainer" containerID="226f7282381a5610cb0768b3b2064fa3bbce29ddecff396c9969886b06192db2" Jul 01 22:12:34.944310 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:34.944253 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-crb5t_openshift-console-operator(d85fb1e7-081a-469e-93bc-d6a08338daba)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" podUID="d85fb1e7-081a-469e-93bc-d6a08338daba" Jul 01 22:12:35.013948 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.013912 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-mjkdr"] Jul 01 22:12:35.018104 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.018084 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-mjkdr" Jul 01 22:12:35.021380 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.021358 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 01 22:12:35.021691 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.021671 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jcmzh\"" Jul 01 22:12:35.021765 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.021719 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 01 22:12:35.024242 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.024216 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:35.029683 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.029647 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-mjkdr"] Jul 01 22:12:35.081245 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.081214 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l5lx\" (UniqueName: \"kubernetes.io/projected/3d3cf9ab-a1b4-4fd3-b53a-a2582c62cce4-kube-api-access-7l5lx\") pod \"migrator-786f9fbc5-mjkdr\" (UID: \"3d3cf9ab-a1b4-4fd3-b53a-a2582c62cce4\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-mjkdr" Jul 01 22:12:35.095500 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.095460 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:35.182256 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.182222 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l5lx\" (UniqueName: \"kubernetes.io/projected/3d3cf9ab-a1b4-4fd3-b53a-a2582c62cce4-kube-api-access-7l5lx\") pod \"migrator-786f9fbc5-mjkdr\" (UID: \"3d3cf9ab-a1b4-4fd3-b53a-a2582c62cce4\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-mjkdr" Jul 01 22:12:35.195861 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.195786 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l5lx\" (UniqueName: \"kubernetes.io/projected/3d3cf9ab-a1b4-4fd3-b53a-a2582c62cce4-kube-api-access-7l5lx\") pod \"migrator-786f9fbc5-mjkdr\" (UID: \"3d3cf9ab-a1b4-4fd3-b53a-a2582c62cce4\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-mjkdr" Jul 01 22:12:35.327766 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.327733 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-mjkdr" Jul 01 22:12:35.383543 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.383507 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:35.383650 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.383609 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:35.383744 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:35.383719 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 22:12:35.383817 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:35.383804 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls podName:753915d6-e023-4dbd-804e-7832002f1a59 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:36.383780563 +0000 UTC m=+59.471058029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpmzx" (UID: "753915d6-e023-4dbd-804e-7832002f1a59") : secret "insights-runtime-extractor-tls" not found Jul 01 22:12:35.383872 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:35.383805 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 22:12:35.383872 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:35.383855 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm podName:753915d6-e023-4dbd-804e-7832002f1a59 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:36.383843328 +0000 UTC m=+59.471120796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpmzx" (UID: "753915d6-e023-4dbd-804e-7832002f1a59") : configmap "kube-rbac-proxy" not found Jul 01 22:12:35.467490 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.467407 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-mjkdr"] Jul 01 22:12:35.470415 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:35.470388 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3cf9ab_a1b4_4fd3_b53a_a2582c62cce4.slice/crio-124d933ce1e46922a6bad44c4caa67ee1199a0bf700bd2bab55511f15f5627be WatchSource:0}: Error finding container 124d933ce1e46922a6bad44c4caa67ee1199a0bf700bd2bab55511f15f5627be: Status 404 returned error can't find the container with id 124d933ce1e46922a6bad44c4caa67ee1199a0bf700bd2bab55511f15f5627be Jul 01 22:12:35.557684 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.557603 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:35.931185 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.931158 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6q954_c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476/dns-node-resolver/0.log" Jul 01 22:12:35.948293 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.948260 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-mjkdr" event={"ID":"3d3cf9ab-a1b4-4fd3-b53a-a2582c62cce4","Type":"ContainerStarted","Data":"124d933ce1e46922a6bad44c4caa67ee1199a0bf700bd2bab55511f15f5627be"} Jul 01 22:12:35.949924 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.949905 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/1.log" Jul 01 22:12:35.950257 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:35.950240 2568 scope.go:117] "RemoveContainer" containerID="226f7282381a5610cb0768b3b2064fa3bbce29ddecff396c9969886b06192db2" Jul 01 22:12:35.950431 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:35.950413 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-crb5t_openshift-console-operator(d85fb1e7-081a-469e-93bc-d6a08338daba)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" podUID="d85fb1e7-081a-469e-93bc-d6a08338daba" Jul 01 22:12:36.046226 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.046175 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:36.178633 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.178597 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:36.269517 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.269435 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:36.369222 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.369188 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:36.391793 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.391755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:36.391983 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:36.391909 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 22:12:36.392042 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:36.392011 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 22:12:36.392090 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:36.392052 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm podName:753915d6-e023-4dbd-804e-7832002f1a59 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:38.39201448 +0000 UTC m=+61.479291943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpmzx" (UID: "753915d6-e023-4dbd-804e-7832002f1a59") : configmap "kube-rbac-proxy" not found Jul 01 22:12:36.392090 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.391935 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:36.392171 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:36.392114 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls podName:753915d6-e023-4dbd-804e-7832002f1a59 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:38.39210079 +0000 UTC m=+61.479378258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpmzx" (UID: "753915d6-e023-4dbd-804e-7832002f1a59") : secret "insights-runtime-extractor-tls" not found Jul 01 22:12:36.845207 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.845174 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:36.845407 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.845233 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:36.931109 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.931079 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6fgns_873029f8-0544-4b82-9ee1-c84e63aa34f7/node-ca/0.log" Jul 01 22:12:36.954795 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.954701 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-mjkdr" event={"ID":"3d3cf9ab-a1b4-4fd3-b53a-a2582c62cce4","Type":"ContainerStarted","Data":"6c966870b3d729d246a769b04dfdaaf708304a33ecd4cc2ef5b3442b49f5d7e6"} Jul 01 22:12:36.954795 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.954760 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-mjkdr" event={"ID":"3d3cf9ab-a1b4-4fd3-b53a-a2582c62cce4","Type":"ContainerStarted","Data":"6d0256990c05c253b977dc9ced6475e4888c6f49984e57337277b525d7392713"} Jul 01 22:12:36.955276 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.955092 2568 scope.go:117] "RemoveContainer" containerID="226f7282381a5610cb0768b3b2064fa3bbce29ddecff396c9969886b06192db2" Jul 01 22:12:36.955276 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:36.955241 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-crb5t_openshift-console-operator(d85fb1e7-081a-469e-93bc-d6a08338daba)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" podUID="d85fb1e7-081a-469e-93bc-d6a08338daba" Jul 01 22:12:36.972892 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:36.972828 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-mjkdr" podStartSLOduration=1.750936395 podStartE2EDuration="2.972811456s" totalImagesPullingTime="1.221875061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:36.971607638 +0000 UTC m=+60.058885122" watchObservedRunningTime="2026-07-01 22:12:36.972811456 +0000 UTC m=+60.060088939" Jul 01 22:12:37.053185 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.053151 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:37.114907 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.114868 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:37.531386 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.531355 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rmqxv_cc46767a-a90e-429a-9288-c41b1fc4e90a/serve-healthcheck-canary/0.log" Jul 01 22:12:37.867163 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.867083 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-qxksm"] Jul 01 22:12:37.870337 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.870318 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" Jul 01 22:12:37.873539 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.873515 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gjjqv\"" Jul 01 22:12:37.874832 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.874812 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 01 22:12:37.874929 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.874840 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 01 22:12:37.874992 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.874937 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 01 22:12:37.875224 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.875209 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 01 22:12:37.879989 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.879970 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-qxksm"] Jul 01 22:12:37.908305 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.907215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b8727c53-8b8c-4719-9ca1-e7984a27e618-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-qxksm\" (UID: \"b8727c53-8b8c-4719-9ca1-e7984a27e618\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" Jul 01 22:12:37.908305 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.907418 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b8727c53-8b8c-4719-9ca1-e7984a27e618-signing-key\") pod \"service-ca-7bb4f4bcc7-qxksm\" (UID: \"b8727c53-8b8c-4719-9ca1-e7984a27e618\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" Jul 01 22:12:37.908305 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.907475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/b8727c53-8b8c-4719-9ca1-e7984a27e618-kube-api-access-pqrl9\") pod \"service-ca-7bb4f4bcc7-qxksm\" (UID: \"b8727c53-8b8c-4719-9ca1-e7984a27e618\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" Jul 01 22:12:37.925834 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:37.925795 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:38.008591 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.008546 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/b8727c53-8b8c-4719-9ca1-e7984a27e618-kube-api-access-pqrl9\") pod \"service-ca-7bb4f4bcc7-qxksm\" (UID: \"b8727c53-8b8c-4719-9ca1-e7984a27e618\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" Jul 01 22:12:38.009105 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.008751 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b8727c53-8b8c-4719-9ca1-e7984a27e618-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-qxksm\" (UID: \"b8727c53-8b8c-4719-9ca1-e7984a27e618\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" Jul 01 22:12:38.009105 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.008788 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b8727c53-8b8c-4719-9ca1-e7984a27e618-signing-key\") pod \"service-ca-7bb4f4bcc7-qxksm\" (UID: \"b8727c53-8b8c-4719-9ca1-e7984a27e618\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" Jul 01 22:12:38.009494 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.009474 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b8727c53-8b8c-4719-9ca1-e7984a27e618-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-qxksm\" (UID: \"b8727c53-8b8c-4719-9ca1-e7984a27e618\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" Jul 01 22:12:38.011182 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.011158 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b8727c53-8b8c-4719-9ca1-e7984a27e618-signing-key\") pod \"service-ca-7bb4f4bcc7-qxksm\" (UID: \"b8727c53-8b8c-4719-9ca1-e7984a27e618\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" Jul 01 22:12:38.019591 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.019562 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/b8727c53-8b8c-4719-9ca1-e7984a27e618-kube-api-access-pqrl9\") pod \"service-ca-7bb4f4bcc7-qxksm\" (UID: \"b8727c53-8b8c-4719-9ca1-e7984a27e618\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" Jul 01 22:12:38.025164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.025139 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:38.179564 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.179506 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" Jul 01 22:12:38.303814 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.303784 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-qxksm"] Jul 01 22:12:38.306497 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:38.306470 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8727c53_8b8c_4719_9ca1_e7984a27e618.slice/crio-f7099f92611a083e2b59d581409e804c272c69fe3e299227328efaebbd40d588 WatchSource:0}: Error finding container f7099f92611a083e2b59d581409e804c272c69fe3e299227328efaebbd40d588: Status 404 returned error can't find the container with id f7099f92611a083e2b59d581409e804c272c69fe3e299227328efaebbd40d588 Jul 01 22:12:38.412120 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.412081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:38.412438 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:38.412253 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 22:12:38.412438 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:38.412310 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 22:12:38.412438 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.412249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:38.412438 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:38.412334 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls podName:753915d6-e023-4dbd-804e-7832002f1a59 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:42.412311773 +0000 UTC m=+65.499589237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpmzx" (UID: "753915d6-e023-4dbd-804e-7832002f1a59") : secret "insights-runtime-extractor-tls" not found Jul 01 22:12:38.412438 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:38.412377 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm podName:753915d6-e023-4dbd-804e-7832002f1a59 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:42.412360708 +0000 UTC m=+65.499638170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpmzx" (UID: "753915d6-e023-4dbd-804e-7832002f1a59") : configmap "kube-rbac-proxy" not found Jul 01 22:12:38.844322 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.844288 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:38.962984 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.962948 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" event={"ID":"b8727c53-8b8c-4719-9ca1-e7984a27e618","Type":"ContainerStarted","Data":"93f3e04cfbf91c7b6f6bc1fc5b3dfad6f14cf84492139645fa44f05d8df356f2"} Jul 01 22:12:38.963176 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.962997 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" event={"ID":"b8727c53-8b8c-4719-9ca1-e7984a27e618","Type":"ContainerStarted","Data":"f7099f92611a083e2b59d581409e804c272c69fe3e299227328efaebbd40d588"} Jul 01 22:12:38.984058 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:38.984004 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-qxksm" podStartSLOduration=1.983988023 podStartE2EDuration="1.983988023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:38.982089225 +0000 UTC m=+62.069366709" watchObservedRunningTime="2026-07-01 22:12:38.983988023 +0000 UTC m=+62.071265556" Jul 01 22:12:39.542876 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:39.542836 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:39.657354 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:39.657292 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:39.739548 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:39.739516 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:39.811267 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:39.811185 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:39.821490 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:39.821459 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wt7qw" Jul 01 22:12:39.898174 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:39.898133 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:40.024210 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:40.024169 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:40.232599 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:40.232565 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:41.258124 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:41.258076 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:41.640538 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:41.640432 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:41.828553 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:41.828518 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:42.034553 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.034511 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:42.113196 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.113150 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:42.285709 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.285611 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:42.338794 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.338754 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:42.349942 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.349916 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:42.350028 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.349951 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6xq8d\" (UID: \"6e936d36-f019-48bc-ae20-1ee9092ff43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:42.350028 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.349996 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:42.350028 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.350024 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:42.350140 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:42.350099 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle podName:e3b2eda9-57a2-435f-8b5b-273e643baf4e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:58.350076616 +0000 UTC m=+81.437354086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle") pod "router-default-745b957bc7-5mptn" (UID: "e3b2eda9-57a2-435f-8b5b-273e643baf4e") : configmap references non-existent config key: service-ca.crt Jul 01 22:12:42.350187 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:42.350141 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 22:12:42.350222 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:42.350185 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls podName:f6c316bc-3ae8-4c89-bf25-ee43411dad9d nodeName:}" failed. No retries permitted until 2026-07-01 22:12:58.350173893 +0000 UTC m=+81.437451355 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-g7tcz" (UID: "f6c316bc-3ae8-4c89-bf25-ee43411dad9d") : secret "cluster-monitoring-operator-tls" not found Jul 01 22:12:42.350222 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:42.350141 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 22:12:42.350222 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:42.350216 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs podName:e3b2eda9-57a2-435f-8b5b-273e643baf4e nodeName:}" failed. No retries permitted until 2026-07-01 22:12:58.350210307 +0000 UTC m=+81.437487769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs") pod "router-default-745b957bc7-5mptn" (UID: "e3b2eda9-57a2-435f-8b5b-273e643baf4e") : secret "router-metrics-certs-default" not found Jul 01 22:12:42.352310 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.352291 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e936d36-f019-48bc-ae20-1ee9092ff43c-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6xq8d\" (UID: \"6e936d36-f019-48bc-ae20-1ee9092ff43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:42.423266 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.423231 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kssh8\"" Jul 01 22:12:42.427366 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.427334 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:42.431117 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.431089 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" Jul 01 22:12:42.451541 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.451504 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:42.451744 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.451603 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:42.451744 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:42.451644 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 22:12:42.451744 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:42.451720 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls podName:753915d6-e023-4dbd-804e-7832002f1a59 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:50.451703669 +0000 UTC m=+73.538981134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpmzx" (UID: "753915d6-e023-4dbd-804e-7832002f1a59") : secret "insights-runtime-extractor-tls" not found Jul 01 22:12:42.451744 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:42.451736 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 22:12:42.451958 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:42.451788 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm podName:753915d6-e023-4dbd-804e-7832002f1a59 nodeName:}" failed. No retries permitted until 2026-07-01 22:12:50.451769064 +0000 UTC m=+73.539046530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpmzx" (UID: "753915d6-e023-4dbd-804e-7832002f1a59") : configmap "kube-rbac-proxy" not found Jul 01 22:12:42.573554 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.573463 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d"] Jul 01 22:12:42.976720 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:42.976686 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" event={"ID":"6e936d36-f019-48bc-ae20-1ee9092ff43c","Type":"ContainerStarted","Data":"1e18be0ce9e9bd7356242c8701a738dbbd8d01e57647aecc03beeac9344adf33"} Jul 01 22:12:43.129491 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:43.129451 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:43.254627 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:43.254536 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:43.329479 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:43.329387 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:43.625136 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:43.625043 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:43.826642 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:43.826612 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:44.022078 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.022045 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:44.118678 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.118629 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:44.265563 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.265526 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:12:44.265779 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.265575 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdz8\" (UniqueName: \"kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8\") pod \"network-check-target-76hn9\" (UID: \"7593af7d-a289-49ad-96da-d36d890ee899\") " pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:44.268538 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.268513 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qdz8\" (UniqueName: \"kubernetes.io/projected/7593af7d-a289-49ad-96da-d36d890ee899-kube-api-access-6qdz8\") pod \"network-check-target-76hn9\" (UID: \"7593af7d-a289-49ad-96da-d36d890ee899\") " pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:44.268894 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.268869 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 22:12:44.278843 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.278783 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d65a4b07-191f-4737-93c7-d08be8e1794e-original-pull-secret\") pod \"global-pull-secret-syncer-nj76z\" (UID: \"d65a4b07-191f-4737-93c7-d08be8e1794e\") " pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:12:44.366920 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.366879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:12:44.369678 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.369639 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 22:12:44.378124 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:44.378101 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 22:12:44.378251 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:12:44.378175 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs podName:7f8c06d2-2093-4cf2-9461-9accbc6ed553 nodeName:}" failed. No retries permitted until 2026-07-01 22:13:48.378151977 +0000 UTC m=+131.465429443 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs") pod "network-metrics-daemon-qtm74" (UID: "7f8c06d2-2093-4cf2-9461-9accbc6ed553") : secret "metrics-daemon-secret" not found Jul 01 22:12:44.426585 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.426549 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:44.470251 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.470217 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nj76z" Jul 01 22:12:44.487104 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.487075 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-456tl\"" Jul 01 22:12:44.494502 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.494471 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:44.633391 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.633335 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:44.704427 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.704404 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-76hn9"] Jul 01 22:12:44.707089 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.707060 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:44.707940 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:44.707919 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7593af7d_a289_49ad_96da_d36d890ee899.slice/crio-2bd0eb0a7e1d6fcbce846919c31ff885a28c792d60353a10337266d3d32bb19e WatchSource:0}: Error finding container 2bd0eb0a7e1d6fcbce846919c31ff885a28c792d60353a10337266d3d32bb19e: Status 404 returned error can't find the container with id 2bd0eb0a7e1d6fcbce846919c31ff885a28c792d60353a10337266d3d32bb19e Jul 01 22:12:44.721990 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.721966 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nj76z"] Jul 01 22:12:44.725025 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:44.724944 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65a4b07_191f_4737_93c7_d08be8e1794e.slice/crio-2758e65efe89ddab5c53c3a37fa0256b4b7d799f664fe03eae78b4ec2d01760e WatchSource:0}: Error finding container 2758e65efe89ddab5c53c3a37fa0256b4b7d799f664fe03eae78b4ec2d01760e: Status 404 returned error can't find the container with id 2758e65efe89ddab5c53c3a37fa0256b4b7d799f664fe03eae78b4ec2d01760e Jul 01 22:12:44.985055 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.985017 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" event={"ID":"6e936d36-f019-48bc-ae20-1ee9092ff43c","Type":"ContainerStarted","Data":"efdb5bcf4cca9b9e391e4dde70ab163917e0bab6754a93a14f527c69ae0561f3"} Jul 01 22:12:44.985256 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.985082 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" event={"ID":"6e936d36-f019-48bc-ae20-1ee9092ff43c","Type":"ContainerStarted","Data":"484fd690c400e4bd3b1185e040b96ffcf1191e1691be3617d00bf8192df0fd6b"} Jul 01 22:12:44.986145 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.986111 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nj76z" event={"ID":"d65a4b07-191f-4737-93c7-d08be8e1794e","Type":"ContainerStarted","Data":"2758e65efe89ddab5c53c3a37fa0256b4b7d799f664fe03eae78b4ec2d01760e"} Jul 01 22:12:44.987601 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.987577 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-76hn9" event={"ID":"7593af7d-a289-49ad-96da-d36d890ee899","Type":"ContainerStarted","Data":"d213be8c13175ba8df49f03f769ff686014e5f1add85e0cff905e14031b351fe"} Jul 01 22:12:44.987713 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.987618 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-76hn9" event={"ID":"7593af7d-a289-49ad-96da-d36d890ee899","Type":"ContainerStarted","Data":"2bd0eb0a7e1d6fcbce846919c31ff885a28c792d60353a10337266d3d32bb19e"} Jul 01 22:12:44.987713 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:44.987673 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:12:45.001919 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.001876 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6xq8d" podStartSLOduration=17.001862512 podStartE2EDuration="19.001859489s" totalImagesPullingTime="1.999996977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:45.001374044 +0000 UTC m=+68.088651555" watchObservedRunningTime="2026-07-01 22:12:45.001859489 +0000 UTC m=+68.089136976" Jul 01 22:12:45.017257 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.017209 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-76hn9" podStartSLOduration=66.017193108 podStartE2EDuration="1m6.017193108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:45.016675697 +0000 UTC m=+68.103953172" watchObservedRunningTime="2026-07-01 22:12:45.017193108 +0000 UTC m=+68.104470592" Jul 01 22:12:45.039933 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.039907 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:45.173956 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.173916 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:45.174155 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.174062 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:45.177003 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.176974 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e22595d9-5db0-4470-9253-2efe2469c3b4-metrics-tls\") pod \"dns-default-gslj7\" (UID: \"e22595d9-5db0-4470-9253-2efe2469c3b4\") " pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:45.177129 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.177095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls\") pod \"image-registry-6f94cfcdd4-b8zxd\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:45.373945 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.373864 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nc4g9\"" Jul 01 22:12:45.381605 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.381568 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:45.399890 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.399864 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j8cc2\"" Jul 01 22:12:45.407958 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.407928 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:45.425087 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.425051 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:45.530565 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.530234 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:45.577394 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.577130 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f94cfcdd4-b8zxd"] Jul 01 22:12:45.580322 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:45.580295 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f5bcb6c_99cd_4a13_826d_21cdd30ae4df.slice/crio-261f50fd4731c14c9e9fbdb5c1af9560afc53e0ec0bbc3f9a407d6086f03cfba WatchSource:0}: Error finding container 261f50fd4731c14c9e9fbdb5c1af9560afc53e0ec0bbc3f9a407d6086f03cfba: Status 404 returned error can't find the container with id 261f50fd4731c14c9e9fbdb5c1af9560afc53e0ec0bbc3f9a407d6086f03cfba Jul 01 22:12:45.588529 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.588458 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gslj7"] Jul 01 22:12:45.592158 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:45.592130 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22595d9_5db0_4470_9253_2efe2469c3b4.slice/crio-ebaa6fd11c65e62238304529b752d1d624b9a978aa318da42ca9c9e4464920f6 WatchSource:0}: Error finding container ebaa6fd11c65e62238304529b752d1d624b9a978aa318da42ca9c9e4464920f6: Status 404 returned error can't find the container with id ebaa6fd11c65e62238304529b752d1d624b9a978aa318da42ca9c9e4464920f6 Jul 01 22:12:45.825628 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.825587 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:45.926701 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.926627 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:45.994363 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.994304 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gslj7" event={"ID":"e22595d9-5db0-4470-9253-2efe2469c3b4","Type":"ContainerStarted","Data":"ebaa6fd11c65e62238304529b752d1d624b9a978aa318da42ca9c9e4464920f6"} Jul 01 22:12:45.996606 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.996578 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" event={"ID":"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df","Type":"ContainerStarted","Data":"fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade"} Jul 01 22:12:45.996765 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.996628 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" event={"ID":"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df","Type":"ContainerStarted","Data":"261f50fd4731c14c9e9fbdb5c1af9560afc53e0ec0bbc3f9a407d6086f03cfba"} Jul 01 22:12:45.996949 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:45.996905 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:12:46.019342 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:46.019285 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" podStartSLOduration=67.01926288 podStartE2EDuration="1m7.01926288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:46.017413802 +0000 UTC m=+69.104691287" watchObservedRunningTime="2026-07-01 22:12:46.01926288 +0000 UTC m=+69.106540367" Jul 01 22:12:46.022155 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:46.022075 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:46.224127 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:46.224042 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:46.425380 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:46.425344 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:46.843592 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:46.843502 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:47.247710 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:47.247646 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:47.628701 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:47.628598 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:47.816114 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:47.816075 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:48.034133 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:48.034087 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:48.425865 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:48.425831 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:49.022382 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:49.022336 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:49.457889 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:49.457854 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:49.827549 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:49.827503 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:50.014326 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.014291 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nj76z" event={"ID":"d65a4b07-191f-4737-93c7-d08be8e1794e","Type":"ContainerStarted","Data":"3eeb5e334e9079f882e53ee079d2b05e00aacba832a7458e8971681f4c9de29b"} Jul 01 22:12:50.016091 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.016066 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gslj7" event={"ID":"e22595d9-5db0-4470-9253-2efe2469c3b4","Type":"ContainerStarted","Data":"437c013ec51cc339a14cc256d13cb3ee21407f0deff2e74cc1dda17186162c55"} Jul 01 22:12:50.016220 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.016107 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gslj7" event={"ID":"e22595d9-5db0-4470-9253-2efe2469c3b4","Type":"ContainerStarted","Data":"e9433318f1b0c983a3ce0de529ecc6a4cc9e8adf07cc3edacc7fb7a7473723c6"} Jul 01 22:12:50.016220 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.016143 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gslj7" Jul 01 22:12:50.024167 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.024136 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:50.032955 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.032912 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nj76z" podStartSLOduration=66.50566247 podStartE2EDuration="1m11.032898462s" totalImagesPullingTime="4.527235992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:50.032037888 +0000 UTC m=+73.119315366" watchObservedRunningTime="2026-07-01 22:12:50.032898462 +0000 UTC m=+73.120175924" Jul 01 22:12:50.050234 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.050193 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gslj7" podStartSLOduration=33.398714943 podStartE2EDuration="37.050181142s" totalImagesPullingTime="3.651466199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:50.049971758 +0000 UTC m=+73.137249241" watchObservedRunningTime="2026-07-01 22:12:50.050181142 +0000 UTC m=+73.137458625" Jul 01 22:12:50.220962 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.220924 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:50.536588 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.536497 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:50.536588 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.536574 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:50.537158 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.537134 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753915d6-e023-4dbd-804e-7832002f1a59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:50.538865 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.538846 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753915d6-e023-4dbd-804e-7832002f1a59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpmzx\" (UID: \"753915d6-e023-4dbd-804e-7832002f1a59\") " pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:50.558230 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.558207 2568 scope.go:117] "RemoveContainer" containerID="226f7282381a5610cb0768b3b2064fa3bbce29ddecff396c9969886b06192db2" Jul 01 22:12:50.656619 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.656580 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nkrvr\"" Jul 01 22:12:50.664072 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.664047 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpmzx" Jul 01 22:12:50.791929 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:50.791739 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpmzx"] Jul 01 22:12:50.794810 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:50.794769 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753915d6_e023_4dbd_804e_7832002f1a59.slice/crio-28ec3cdad0459dfce655b42c1a4e73b3999ecfd4d1ed34f2e4835c6224098870 WatchSource:0}: Error finding container 28ec3cdad0459dfce655b42c1a4e73b3999ecfd4d1ed34f2e4835c6224098870: Status 404 returned error can't find the container with id 28ec3cdad0459dfce655b42c1a4e73b3999ecfd4d1ed34f2e4835c6224098870 Jul 01 22:12:51.021348 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:51.021320 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/1.log" Jul 01 22:12:51.021491 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:51.021446 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" event={"ID":"d85fb1e7-081a-469e-93bc-d6a08338daba","Type":"ContainerStarted","Data":"71cffe62d0077fafcee406c8e53c0229d19afacba8517e5aeb312cd4006c00dd"} Jul 01 22:12:51.021804 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:51.021773 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:51.022564 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:51.022542 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpmzx" event={"ID":"753915d6-e023-4dbd-804e-7832002f1a59","Type":"ContainerStarted","Data":"28ec3cdad0459dfce655b42c1a4e73b3999ecfd4d1ed34f2e4835c6224098870"} Jul 01 22:12:51.057668 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:51.057549 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" podStartSLOduration=18.825719477 podStartE2EDuration="25.057529133s" totalImagesPullingTime="6.231809656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:51.056455347 +0000 UTC m=+74.143732832" watchObservedRunningTime="2026-07-01 22:12:51.057529133 +0000 UTC m=+74.144806619" Jul 01 22:12:51.772084 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:51.772050 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-crb5t" Jul 01 22:12:51.950249 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:51.950145 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:52.051425 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:52.051331 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:52.108688 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:52.108643 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:52.288483 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:52.288452 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:52.435189 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:52.435148 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:52.533769 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:52.533721 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:52.663276 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:52.663238 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:52.741150 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:52.741060 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:52.855542 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:52.855506 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:53.836521 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:53.836487 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:54.045634 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:54.045575 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:54.454637 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:54.454602 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:54.507646 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:54.507610 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:54.654450 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:54.654413 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:55.041108 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:55.041077 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpmzx" event={"ID":"753915d6-e023-4dbd-804e-7832002f1a59","Type":"ContainerStarted","Data":"de03c2a41e49c55a76c14a0e2f6b4fee87dea8a295d9d8ee9f1d4900f1ea3b5e"} Jul 01 22:12:56.047550 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:56.047513 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpmzx" event={"ID":"753915d6-e023-4dbd-804e-7832002f1a59","Type":"ContainerStarted","Data":"cadd4d6fbbb057cea8ea3842bd4285cb080da639d3a882b652785a6629f50a23"} Jul 01 22:12:56.260670 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:56.260618 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:57.689330 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.689296 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h"] Jul 01 22:12:57.701598 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.701572 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm"] Jul 01 22:12:57.701781 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.701740 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h" Jul 01 22:12:57.704775 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.704748 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9"] Jul 01 22:12:57.704919 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.704834 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:12:57.706326 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.706302 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 22:12:57.706326 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.706312 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 22:12:57.706501 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.706322 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-g49bp\"" Jul 01 22:12:57.706701 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.706613 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 01 22:12:57.708173 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.708149 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.708923 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.708904 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 01 22:12:57.709372 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.709133 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 22:12:57.710229 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.710001 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm"] Jul 01 22:12:57.711285 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.710800 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 01 22:12:57.711285 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.711033 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 01 22:12:57.711511 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.711492 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 01 22:12:57.711677 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.711620 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 01 22:12:57.715527 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.712716 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h"] Jul 01 22:12:57.717737 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.717689 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9"] Jul 01 22:12:57.805409 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.805377 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29cbc666-ebac-4781-8894-0f7c24902f0d-tmp\") pod \"klusterlet-addon-workmgr-6c8d648576-q2zhm\" (UID: \"29cbc666-ebac-4781-8894-0f7c24902f0d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:12:57.805409 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.805410 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9vrw\" (UniqueName: \"kubernetes.io/projected/04431b77-714d-436f-aa14-a87f94a30724-kube-api-access-s9vrw\") pod \"managed-serviceaccount-addon-agent-7cb846b454-6269h\" (UID: \"04431b77-714d-436f-aa14-a87f94a30724\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h" Jul 01 22:12:57.805642 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.805460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.805642 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.805488 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04431b77-714d-436f-aa14-a87f94a30724-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cb846b454-6269h\" (UID: \"04431b77-714d-436f-aa14-a87f94a30724\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h" Jul 01 22:12:57.805642 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.805510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-ca\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.805642 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.805532 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz7r6\" (UniqueName: \"kubernetes.io/projected/29cbc666-ebac-4781-8894-0f7c24902f0d-kube-api-access-fz7r6\") pod \"klusterlet-addon-workmgr-6c8d648576-q2zhm\" (UID: \"29cbc666-ebac-4781-8894-0f7c24902f0d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:12:57.805874 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.805687 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.805874 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.805711 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29cbc666-ebac-4781-8894-0f7c24902f0d-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c8d648576-q2zhm\" (UID: \"29cbc666-ebac-4781-8894-0f7c24902f0d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:12:57.805874 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.805769 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-hub\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.805874 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.805825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.805874 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.805854 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xfq4\" (UniqueName: \"kubernetes.io/projected/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-kube-api-access-5xfq4\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.807158 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.807085 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:57.822464 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.822437 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-l5xzg"] Jul 01 22:12:57.825444 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.825426 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-l5xzg" Jul 01 22:12:57.828480 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.828458 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mffm5\"" Jul 01 22:12:57.829098 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.829077 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 22:12:57.829337 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.829320 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 22:12:57.851086 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.851061 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr"] Jul 01 22:12:57.855064 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.855041 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-l5xzg"] Jul 01 22:12:57.855171 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.855154 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr" Jul 01 22:12:57.858160 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.858130 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 22:12:57.858289 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.858258 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4gkcx\"" Jul 01 22:12:57.858505 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.858487 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 22:12:57.863800 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.863779 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr"] Jul 01 22:12:57.907137 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907108 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.907271 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907144 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfq4\" (UniqueName: \"kubernetes.io/projected/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-kube-api-access-5xfq4\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.907271 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907196 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29cbc666-ebac-4781-8894-0f7c24902f0d-tmp\") pod \"klusterlet-addon-workmgr-6c8d648576-q2zhm\" (UID: \"29cbc666-ebac-4781-8894-0f7c24902f0d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:12:57.907271 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907223 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9vrw\" (UniqueName: \"kubernetes.io/projected/04431b77-714d-436f-aa14-a87f94a30724-kube-api-access-s9vrw\") pod \"managed-serviceaccount-addon-agent-7cb846b454-6269h\" (UID: \"04431b77-714d-436f-aa14-a87f94a30724\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h" Jul 01 22:12:57.907429 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907356 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.907429 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04431b77-714d-436f-aa14-a87f94a30724-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cb846b454-6269h\" (UID: \"04431b77-714d-436f-aa14-a87f94a30724\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h" Jul 01 22:12:57.907529 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-ca\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.907529 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907464 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz7r6\" (UniqueName: \"kubernetes.io/projected/29cbc666-ebac-4781-8894-0f7c24902f0d-kube-api-access-fz7r6\") pod \"klusterlet-addon-workmgr-6c8d648576-q2zhm\" (UID: \"29cbc666-ebac-4781-8894-0f7c24902f0d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:12:57.907629 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907540 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.907629 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907563 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29cbc666-ebac-4781-8894-0f7c24902f0d-tmp\") pod \"klusterlet-addon-workmgr-6c8d648576-q2zhm\" (UID: \"29cbc666-ebac-4781-8894-0f7c24902f0d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:12:57.907629 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907577 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29cbc666-ebac-4781-8894-0f7c24902f0d-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c8d648576-q2zhm\" (UID: \"29cbc666-ebac-4781-8894-0f7c24902f0d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:12:57.907865 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907629 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd2m7\" (UniqueName: \"kubernetes.io/projected/39f81c8d-3ba9-48e7-8bc3-b826e993c369-kube-api-access-rd2m7\") pod \"downloads-5499b6fb8f-l5xzg\" (UID: \"39f81c8d-3ba9-48e7-8bc3-b826e993c369\") " pod="openshift-console/downloads-5499b6fb8f-l5xzg" Jul 01 22:12:57.907865 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.907691 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-hub\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.908061 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.908031 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.910102 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.910083 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29cbc666-ebac-4781-8894-0f7c24902f0d-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c8d648576-q2zhm\" (UID: \"29cbc666-ebac-4781-8894-0f7c24902f0d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:12:57.910192 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.910137 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04431b77-714d-436f-aa14-a87f94a30724-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cb846b454-6269h\" (UID: \"04431b77-714d-436f-aa14-a87f94a30724\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h" Jul 01 22:12:57.910268 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.910244 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-ca\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.910384 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.910371 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.910482 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.910459 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.910531 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.910517 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-hub\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.915759 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.915735 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz7r6\" (UniqueName: \"kubernetes.io/projected/29cbc666-ebac-4781-8894-0f7c24902f0d-kube-api-access-fz7r6\") pod \"klusterlet-addon-workmgr-6c8d648576-q2zhm\" (UID: \"29cbc666-ebac-4781-8894-0f7c24902f0d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:12:57.916017 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.915993 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9vrw\" (UniqueName: \"kubernetes.io/projected/04431b77-714d-436f-aa14-a87f94a30724-kube-api-access-s9vrw\") pod \"managed-serviceaccount-addon-agent-7cb846b454-6269h\" (UID: \"04431b77-714d-436f-aa14-a87f94a30724\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h" Jul 01 22:12:57.916205 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.916189 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xfq4\" (UniqueName: \"kubernetes.io/projected/cb8ccc4e-76eb-4a95-bada-dca25c7b9543-kube-api-access-5xfq4\") pod \"cluster-proxy-proxy-agent-8f749654c-gsbr9\" (UID: \"cb8ccc4e-76eb-4a95-bada-dca25c7b9543\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:57.996983 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:57.996873 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:58.008551 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.008520 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2m7\" (UniqueName: \"kubernetes.io/projected/39f81c8d-3ba9-48e7-8bc3-b826e993c369-kube-api-access-rd2m7\") pod \"downloads-5499b6fb8f-l5xzg\" (UID: \"39f81c8d-3ba9-48e7-8bc3-b826e993c369\") " pod="openshift-console/downloads-5499b6fb8f-l5xzg" Jul 01 22:12:58.008725 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.008618 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/85fe5172-c260-471b-ad47-c24df99b38a1-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-kp2sr\" (UID: \"85fe5172-c260-471b-ad47-c24df99b38a1\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr" Jul 01 22:12:58.008725 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.008643 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/85fe5172-c260-471b-ad47-c24df99b38a1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kp2sr\" (UID: \"85fe5172-c260-471b-ad47-c24df99b38a1\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr" Jul 01 22:12:58.020058 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.020023 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd2m7\" (UniqueName: \"kubernetes.io/projected/39f81c8d-3ba9-48e7-8bc3-b826e993c369-kube-api-access-rd2m7\") pod \"downloads-5499b6fb8f-l5xzg\" (UID: \"39f81c8d-3ba9-48e7-8bc3-b826e993c369\") " pod="openshift-console/downloads-5499b6fb8f-l5xzg" Jul 01 22:12:58.024166 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.024138 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h" Jul 01 22:12:58.033212 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.033180 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:12:58.038395 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.038365 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" Jul 01 22:12:58.060078 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.060037 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpmzx" event={"ID":"753915d6-e023-4dbd-804e-7832002f1a59","Type":"ContainerStarted","Data":"b08917594a4335aefcfdaba6492c2d124a09ade5c8885014a4dac79e6afc39db"} Jul 01 22:12:58.086525 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.086056 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jpmzx" podStartSLOduration=17.181162356 podStartE2EDuration="24.086030538s" totalImagesPullingTime="6.904868182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:12:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:58.085731566 +0000 UTC m=+81.173009051" watchObservedRunningTime="2026-07-01 22:12:58.086030538 +0000 UTC m=+81.173308023" Jul 01 22:12:58.096838 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.095477 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:58.109906 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.109870 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/85fe5172-c260-471b-ad47-c24df99b38a1-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-kp2sr\" (UID: \"85fe5172-c260-471b-ad47-c24df99b38a1\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr" Jul 01 22:12:58.110072 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.109922 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/85fe5172-c260-471b-ad47-c24df99b38a1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kp2sr\" (UID: \"85fe5172-c260-471b-ad47-c24df99b38a1\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr" Jul 01 22:12:58.110787 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.110737 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/85fe5172-c260-471b-ad47-c24df99b38a1-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-kp2sr\" (UID: \"85fe5172-c260-471b-ad47-c24df99b38a1\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr" Jul 01 22:12:58.114484 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.114433 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/85fe5172-c260-471b-ad47-c24df99b38a1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kp2sr\" (UID: \"85fe5172-c260-471b-ad47-c24df99b38a1\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr" Jul 01 22:12:58.138523 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.138487 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-l5xzg" Jul 01 22:12:58.170263 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.170226 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:58.183214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.183156 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h"] Jul 01 22:12:58.187198 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:58.187165 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04431b77_714d_436f_aa14_a87f94a30724.slice/crio-a832f8cc55a37238700a06607e9d0bc6dfe1a9fc5bb0c7d952628f79b36610c8 WatchSource:0}: Error finding container a832f8cc55a37238700a06607e9d0bc6dfe1a9fc5bb0c7d952628f79b36610c8: Status 404 returned error can't find the container with id a832f8cc55a37238700a06607e9d0bc6dfe1a9fc5bb0c7d952628f79b36610c8 Jul 01 22:12:58.195688 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.195643 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr" Jul 01 22:12:58.309029 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.308995 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-l5xzg"] Jul 01 22:12:58.311424 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:58.311389 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f81c8d_3ba9_48e7_8bc3_b826e993c369.slice/crio-e723966a5c9cd08d621a2bb5eb6a24c5d46f451c92177a61d91c4ce07f9cea52 WatchSource:0}: Error finding container e723966a5c9cd08d621a2bb5eb6a24c5d46f451c92177a61d91c4ce07f9cea52: Status 404 returned error can't find the container with id e723966a5c9cd08d621a2bb5eb6a24c5d46f451c92177a61d91c4ce07f9cea52 Jul 01 22:12:58.350443 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.350406 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr"] Jul 01 22:12:58.353956 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:58.353932 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85fe5172_c260_471b_ad47_c24df99b38a1.slice/crio-a4c95ea2973ee2f94c2a6bdf4185f8342585a3bea17c4affeec6e2eb54307d82 WatchSource:0}: Error finding container a4c95ea2973ee2f94c2a6bdf4185f8342585a3bea17c4affeec6e2eb54307d82: Status 404 returned error can't find the container with id a4c95ea2973ee2f94c2a6bdf4185f8342585a3bea17c4affeec6e2eb54307d82 Jul 01 22:12:58.365497 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.365466 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:58.412750 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.412714 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:58.412917 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.412767 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:58.412917 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.412813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:58.413558 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.413530 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b2eda9-57a2-435f-8b5b-273e643baf4e-service-ca-bundle\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:58.416167 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.415918 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6c316bc-3ae8-4c89-bf25-ee43411dad9d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-g7tcz\" (UID: \"f6c316bc-3ae8-4c89-bf25-ee43411dad9d\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:58.416342 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.416322 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b2eda9-57a2-435f-8b5b-273e643baf4e-metrics-certs\") pod \"router-default-745b957bc7-5mptn\" (UID: \"e3b2eda9-57a2-435f-8b5b-273e643baf4e\") " pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:58.417267 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.417246 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm"] Jul 01 22:12:58.418858 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.418834 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9"] Jul 01 22:12:58.419946 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:58.419921 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29cbc666_ebac_4781_8894_0f7c24902f0d.slice/crio-589fd195db2c966b55858cbad180798f71ce33bef294e6d0936960aabb2b761c WatchSource:0}: Error finding container 589fd195db2c966b55858cbad180798f71ce33bef294e6d0936960aabb2b761c: Status 404 returned error can't find the container with id 589fd195db2c966b55858cbad180798f71ce33bef294e6d0936960aabb2b761c Jul 01 22:12:58.420902 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:58.420883 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb8ccc4e_76eb_4a95_bada_dca25c7b9543.slice/crio-e1e941ea0a1d4e284f926f09905d0efa2d8d08711b8f4c0e14aa03091d98bed7 WatchSource:0}: Error finding container e1e941ea0a1d4e284f926f09905d0efa2d8d08711b8f4c0e14aa03091d98bed7: Status 404 returned error can't find the container with id e1e941ea0a1d4e284f926f09905d0efa2d8d08711b8f4c0e14aa03091d98bed7 Jul 01 22:12:58.438232 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.438202 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:58.551289 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.551207 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7ptt8\"" Jul 01 22:12:58.558785 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.558762 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" Jul 01 22:12:58.597681 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.597619 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xt95p\"" Jul 01 22:12:58.605452 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.605427 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:58.698348 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.698319 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz"] Jul 01 22:12:58.701522 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:58.701490 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c316bc_3ae8_4c89_bf25_ee43411dad9d.slice/crio-a7070eae88d37ef13d0e903855234f7e332bc68d0737557b42656d9f6661f1cf WatchSource:0}: Error finding container a7070eae88d37ef13d0e903855234f7e332bc68d0737557b42656d9f6661f1cf: Status 404 returned error can't find the container with id a7070eae88d37ef13d0e903855234f7e332bc68d0737557b42656d9f6661f1cf Jul 01 22:12:58.749052 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:58.749013 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-745b957bc7-5mptn"] Jul 01 22:12:58.752956 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:12:58.752906 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b2eda9_57a2_435f_8b5b_273e643baf4e.slice/crio-0817390c9f7d3cbb5f0c8a984643edf195eae51d66efc99105027f87366333ad WatchSource:0}: Error finding container 0817390c9f7d3cbb5f0c8a984643edf195eae51d66efc99105027f87366333ad: Status 404 returned error can't find the container with id 0817390c9f7d3cbb5f0c8a984643edf195eae51d66efc99105027f87366333ad Jul 01 22:12:59.066789 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.066643 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr" event={"ID":"85fe5172-c260-471b-ad47-c24df99b38a1","Type":"ContainerStarted","Data":"a4c95ea2973ee2f94c2a6bdf4185f8342585a3bea17c4affeec6e2eb54307d82"} Jul 01 22:12:59.068464 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.068431 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" event={"ID":"f6c316bc-3ae8-4c89-bf25-ee43411dad9d","Type":"ContainerStarted","Data":"a7070eae88d37ef13d0e903855234f7e332bc68d0737557b42656d9f6661f1cf"} Jul 01 22:12:59.070054 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.070023 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-l5xzg" event={"ID":"39f81c8d-3ba9-48e7-8bc3-b826e993c369","Type":"ContainerStarted","Data":"e723966a5c9cd08d621a2bb5eb6a24c5d46f451c92177a61d91c4ce07f9cea52"} Jul 01 22:12:59.071903 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.071878 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-745b957bc7-5mptn" event={"ID":"e3b2eda9-57a2-435f-8b5b-273e643baf4e","Type":"ContainerStarted","Data":"99bf0c8b279297e2d927545db6108ed8e3c283f8f6b5738e689aebc714e24009"} Jul 01 22:12:59.072011 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.071923 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-745b957bc7-5mptn" event={"ID":"e3b2eda9-57a2-435f-8b5b-273e643baf4e","Type":"ContainerStarted","Data":"0817390c9f7d3cbb5f0c8a984643edf195eae51d66efc99105027f87366333ad"} Jul 01 22:12:59.073993 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.073967 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" event={"ID":"cb8ccc4e-76eb-4a95-bada-dca25c7b9543","Type":"ContainerStarted","Data":"e1e941ea0a1d4e284f926f09905d0efa2d8d08711b8f4c0e14aa03091d98bed7"} Jul 01 22:12:59.075540 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.075515 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" event={"ID":"29cbc666-ebac-4781-8894-0f7c24902f0d","Type":"ContainerStarted","Data":"589fd195db2c966b55858cbad180798f71ce33bef294e6d0936960aabb2b761c"} Jul 01 22:12:59.076861 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.076831 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h" event={"ID":"04431b77-714d-436f-aa14-a87f94a30724","Type":"ContainerStarted","Data":"a832f8cc55a37238700a06607e9d0bc6dfe1a9fc5bb0c7d952628f79b36610c8"} Jul 01 22:12:59.093259 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.093099 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-745b957bc7-5mptn" podStartSLOduration=33.093076592 podStartE2EDuration="33.093076592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:12:59.091321568 +0000 UTC m=+82.178599054" watchObservedRunningTime="2026-07-01 22:12:59.093076592 +0000 UTC m=+82.180354086" Jul 01 22:12:59.606644 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.606612 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:59.609767 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.609738 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:12:59.864758 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.864599 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:12:59.931942 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:12:59.931799 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:00.026235 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:00.025298 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gslj7" Jul 01 22:13:00.105696 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:00.105569 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr" event={"ID":"85fe5172-c260-471b-ad47-c24df99b38a1","Type":"ContainerStarted","Data":"2294ce18aaff336ebfe13c75f3c3cade54316ec319e44649a16a8562625143a7"} Jul 01 22:13:00.105696 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:00.105632 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:13:00.108278 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:00.108232 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-745b957bc7-5mptn" Jul 01 22:13:00.124718 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:00.123344 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kp2sr" podStartSLOduration=1.8528855640000002 podStartE2EDuration="3.123325262s" totalImagesPullingTime="1.270439698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:13:00.123024005 +0000 UTC m=+83.210301490" watchObservedRunningTime="2026-07-01 22:13:00.123325262 +0000 UTC m=+83.210602748" Jul 01 22:13:00.253578 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:00.253437 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:00.355419 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:00.355312 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:01.466615 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:01.466582 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:01.529359 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:01.529324 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:02.718487 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:02.718376 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:02.813810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:02.813762 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:04.861378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:04.861321 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:04.961393 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:04.961304 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:05.388033 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:05.387993 2568 patch_prober.go:28] interesting pod/image-registry-6f94cfcdd4-b8zxd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 22:13:05.388220 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:05.388059 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" podUID="1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 22:13:06.242867 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:06.242831 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:06.319292 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:06.319255 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:06.429296 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:06.429257 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:06.529454 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:06.529417 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:06.632726 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:06.632690 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:06.730808 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:06.730778 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:06.837527 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:06.837401 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:06.930934 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:06.930890 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:07.008526 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.008498 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:13:07.080634 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.080492 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:07.149874 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.149781 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" event={"ID":"cb8ccc4e-76eb-4a95-bada-dca25c7b9543","Type":"ContainerStarted","Data":"bbe7db78bf0e4ecc38151ee29e126e49ff8e9041f09feee06889806e7f3a635d"} Jul 01 22:13:07.149874 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.149839 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" event={"ID":"cb8ccc4e-76eb-4a95-bada-dca25c7b9543","Type":"ContainerStarted","Data":"582ac668c76bd63003741f67afe85a64852aadf0a8f78c675b48e906f65652fc"} Jul 01 22:13:07.149874 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.149866 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" event={"ID":"cb8ccc4e-76eb-4a95-bada-dca25c7b9543","Type":"ContainerStarted","Data":"992234647cd18b0735284a5a7f72ef82ff514782e5d7fb335b4f80755c9789f6"} Jul 01 22:13:07.151893 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.151863 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" event={"ID":"29cbc666-ebac-4781-8894-0f7c24902f0d","Type":"ContainerStarted","Data":"92799836741f8c0902ae83a5e67598e84c8fb5b25c80df1e1840c69beb6df143"} Jul 01 22:13:07.152233 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.152180 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:13:07.154036 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.154014 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" Jul 01 22:13:07.155138 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.155096 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h" event={"ID":"04431b77-714d-436f-aa14-a87f94a30724","Type":"ContainerStarted","Data":"4041bcec19900dddacd9a3d83a710d871254bc4f857f3e43ed6962499c4b8459"} Jul 01 22:13:07.157260 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.157215 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" event={"ID":"f6c316bc-3ae8-4c89-bf25-ee43411dad9d","Type":"ContainerStarted","Data":"4deeaa50b3bdb0b531c182f7ab91618f6af38bafb207ff94d6fb07dbcb25fa06"} Jul 01 22:13:07.172957 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.172898 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8f749654c-gsbr9" podStartSLOduration=2.137451436 podStartE2EDuration="10.172880689s" totalImagesPullingTime="8.035429253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:13:07.171749331 +0000 UTC m=+90.259026818" watchObservedRunningTime="2026-07-01 22:13:07.172880689 +0000 UTC m=+90.260158175" Jul 01 22:13:07.190459 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.190371 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb846b454-6269h" podStartSLOduration=1.941758529 podStartE2EDuration="10.190349328s" totalImagesPullingTime="8.248590799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:13:07.189391811 +0000 UTC m=+90.276669297" watchObservedRunningTime="2026-07-01 22:13:07.190349328 +0000 UTC m=+90.277626813" Jul 01 22:13:07.210476 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.210323 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c8d648576-q2zhm" podStartSLOduration=2.173934623 podStartE2EDuration="10.210303696s" totalImagesPullingTime="8.036369073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:13:07.209486502 +0000 UTC m=+90.296763986" watchObservedRunningTime="2026-07-01 22:13:07.210303696 +0000 UTC m=+90.297581179" Jul 01 22:13:07.229990 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.229912 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-g7tcz" podStartSLOduration=33.498089465 podStartE2EDuration="41.229892969s" totalImagesPullingTime="7.731803504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:13:07.229510892 +0000 UTC m=+90.316788378" watchObservedRunningTime="2026-07-01 22:13:07.229892969 +0000 UTC m=+90.317170453" Jul 01 22:13:07.441058 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.441014 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:07.541727 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.541636 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:07.709812 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:07.709731 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:08.140799 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:08.140702 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:08.199373 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:08.199329 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:09.065929 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:09.065893 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:09.163324 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:09.163279 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:09.265164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:09.265118 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:11.095837 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:11.095802 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:11.196871 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:11.196832 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:11.311165 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:11.311116 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:11.411897 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:11.411813 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:12.935721 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:12.935683 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:14.825269 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:14.825235 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:14.926438 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:14.926397 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:15.442713 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:15.442673 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:15.542601 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:15.542519 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:15.999787 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:15.999758 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-76hn9" Jul 01 22:13:16.083741 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:16.083703 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:16.174695 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:16.174618 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:16.676536 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:16.676492 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:17.207077 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:17.207041 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:17.300066 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:17.300025 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:17.426884 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:17.426852 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:17.522965 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:17.522934 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:17.623839 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:17.623809 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:18.210417 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:18.210372 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-l5xzg" event={"ID":"39f81c8d-3ba9-48e7-8bc3-b826e993c369","Type":"ContainerStarted","Data":"c38801e2c9b6b5a42fc66a8806c81d8f61269ab2148e7c4c693fcde3c66cb50e"} Jul 01 22:13:18.210919 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:18.210540 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-l5xzg" Jul 01 22:13:18.231081 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:18.231052 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-l5xzg" Jul 01 22:13:18.231581 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:18.231525 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-l5xzg" podStartSLOduration=2.006281954 podStartE2EDuration="21.231507673s" totalImagesPullingTime="19.225225719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:13:18.228721333 +0000 UTC m=+101.315998818" watchObservedRunningTime="2026-07-01 22:13:18.231507673 +0000 UTC m=+101.318785194" Jul 01 22:13:19.240360 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.240326 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:19.480499 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.480463 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:19.538965 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.538879 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8424v"] Jul 01 22:13:19.567547 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.567517 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.570889 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.570858 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 22:13:19.572880 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.572858 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 22:13:19.580849 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.573172 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 22:13:19.580849 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.573458 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lvwkm\"" Jul 01 22:13:19.580849 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.573223 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 22:13:19.580849 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.578395 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:19.631427 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.631386 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ljcl\" (UniqueName: \"kubernetes.io/projected/42d354db-b3d2-46fb-a3f7-a245154ac462-kube-api-access-7ljcl\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.631734 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.631716 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-wtmp\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.631908 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.631894 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-textfile\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.632087 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.632065 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42d354db-b3d2-46fb-a3f7-a245154ac462-sys\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.632215 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.632201 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.632337 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.632325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d354db-b3d2-46fb-a3f7-a245154ac462-metrics-client-ca\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.632504 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.632491 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42d354db-b3d2-46fb-a3f7-a245154ac462-root\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.632639 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.632627 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-tls\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.632802 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.632787 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-accelerators-collector-config\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.675515 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.675482 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:19.733926 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.733890 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-accelerators-collector-config\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.734171 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.734155 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ljcl\" (UniqueName: \"kubernetes.io/projected/42d354db-b3d2-46fb-a3f7-a245154ac462-kube-api-access-7ljcl\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.734288 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.734274 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-wtmp\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.734393 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.734381 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-textfile\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.734534 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.734522 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42d354db-b3d2-46fb-a3f7-a245154ac462-sys\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.734643 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.734631 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.734782 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.734766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d354db-b3d2-46fb-a3f7-a245154ac462-metrics-client-ca\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.734915 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.734903 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42d354db-b3d2-46fb-a3f7-a245154ac462-root\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.735009 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.734998 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-tls\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.735223 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:13:19.735210 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 22:13:19.735351 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:13:19.735342 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-tls podName:42d354db-b3d2-46fb-a3f7-a245154ac462 nodeName:}" failed. No retries permitted until 2026-07-01 22:13:20.235323296 +0000 UTC m=+103.322600761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-tls") pod "node-exporter-8424v" (UID: "42d354db-b3d2-46fb-a3f7-a245154ac462") : secret "node-exporter-tls" not found Jul 01 22:13:19.736007 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.735984 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-wtmp\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.736431 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.736412 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-textfile\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.736587 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.736573 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42d354db-b3d2-46fb-a3f7-a245154ac462-sys\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.737685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.737605 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-accelerators-collector-config\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.737685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.737629 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d354db-b3d2-46fb-a3f7-a245154ac462-metrics-client-ca\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.737903 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.737886 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42d354db-b3d2-46fb-a3f7-a245154ac462-root\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.740288 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.740269 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.750941 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.750904 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ljcl\" (UniqueName: \"kubernetes.io/projected/42d354db-b3d2-46fb-a3f7-a245154ac462-kube-api-access-7ljcl\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:19.852262 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.851912 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:19.951935 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:19.951550 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:20.051213 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:20.051167 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:20.162029 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:20.161923 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:20.240938 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:20.240898 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-tls\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:20.241424 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:13:20.241068 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 22:13:20.241424 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:13:20.241137 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-tls podName:42d354db-b3d2-46fb-a3f7-a245154ac462 nodeName:}" failed. No retries permitted until 2026-07-01 22:13:21.241117153 +0000 UTC m=+104.328394633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-tls") pod "node-exporter-8424v" (UID: "42d354db-b3d2-46fb-a3f7-a245154ac462") : secret "node-exporter-tls" not found Jul 01 22:13:20.484468 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:20.484428 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:20.578701 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:20.578651 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:20.654687 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:20.654600 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:20.666644 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:20.666609 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f94cfcdd4-b8zxd"] Jul 01 22:13:20.778416 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:20.778257 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:20.881810 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:20.881767 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:20.978979 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:20.978940 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:21.252547 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:21.252511 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-tls\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:21.255427 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:21.255400 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42d354db-b3d2-46fb-a3f7-a245154ac462-node-exporter-tls\") pod \"node-exporter-8424v\" (UID: \"42d354db-b3d2-46fb-a3f7-a245154ac462\") " pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:21.390076 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:21.390042 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8424v" Jul 01 22:13:21.421382 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:13:21.421321 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d354db_b3d2_46fb_a3f7_a245154ac462.slice/crio-01d54acf48836cb5989f5b82fd78c919260536b1837cf5435f37ae969fb0fafd WatchSource:0}: Error finding container 01d54acf48836cb5989f5b82fd78c919260536b1837cf5435f37ae969fb0fafd: Status 404 returned error can't find the container with id 01d54acf48836cb5989f5b82fd78c919260536b1837cf5435f37ae969fb0fafd Jul 01 22:13:21.531492 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:21.531396 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:21.628872 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:21.628834 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:22.233406 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:22.233359 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8424v" event={"ID":"42d354db-b3d2-46fb-a3f7-a245154ac462","Type":"ContainerStarted","Data":"01d54acf48836cb5989f5b82fd78c919260536b1837cf5435f37ae969fb0fafd"} Jul 01 22:13:22.488944 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:22.488864 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:22.588342 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:22.588307 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:22.687292 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:22.687102 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:23.070086 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:23.070045 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:24.244609 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:24.244577 2568 generic.go:356] "Generic (PLEG): container finished" podID="42d354db-b3d2-46fb-a3f7-a245154ac462" containerID="69d5df258609673acbf397d8883003144755ee91c4977517a708db372dc8cacd" exitCode=0 Jul 01 22:13:24.245110 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:24.244683 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8424v" event={"ID":"42d354db-b3d2-46fb-a3f7-a245154ac462","Type":"ContainerDied","Data":"69d5df258609673acbf397d8883003144755ee91c4977517a708db372dc8cacd"} Jul 01 22:13:24.322045 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:24.322013 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:24.403703 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:24.403592 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:24.504186 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:24.504153 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:24.604526 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:24.604491 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:25.251760 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:25.251717 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8424v" event={"ID":"42d354db-b3d2-46fb-a3f7-a245154ac462","Type":"ContainerStarted","Data":"10f4f84f9c3e2a2480dc04c28478385b21f7c9f5602287ac928a2b554626d3d9"} Jul 01 22:13:25.252225 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:25.251784 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8424v" event={"ID":"42d354db-b3d2-46fb-a3f7-a245154ac462","Type":"ContainerStarted","Data":"b37c40cc000f3906e0c3d6805f936535ae815ee83d931ecdd5f8155d3f3aa2f1"} Jul 01 22:13:25.274283 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:25.274220 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8424v" podStartSLOduration=4.342548859 podStartE2EDuration="6.274198007s" totalImagesPullingTime="1.831593057s" totalInitContainerRuntime="100.056091ms" isStatefulPod=true podCreationTimestamp="2026-07-01 22:13:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:13:25.272359365 +0000 UTC m=+108.359636849" watchObservedRunningTime="2026-07-01 22:13:25.274198007 +0000 UTC m=+108.361475492" Jul 01 22:13:25.737086 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:25.737049 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:29.548101 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:29.548056 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:29.600952 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:29.600917 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:30.118546 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:30.118513 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:30.219157 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:30.219117 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:32.705116 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:32.705078 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:32.757324 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:32.757287 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:39.891772 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:39.891723 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:39.985621 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:39.985582 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:40.086742 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:40.086696 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:40.148785 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:40.148689 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:44.330398 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:44.330316 2568 generic.go:356] "Generic (PLEG): container finished" podID="5fcbd7f4-17ea-40c3-a234-5278cd77e7e7" containerID="1d77d8aa1603af05cf6534a34fd99e8db2a1c521c10e47b4e76f88db19955e57" exitCode=0 Jul 01 22:13:44.330807 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:44.330390 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" event={"ID":"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7","Type":"ContainerDied","Data":"1d77d8aa1603af05cf6534a34fd99e8db2a1c521c10e47b4e76f88db19955e57"} Jul 01 22:13:44.330807 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:44.330764 2568 scope.go:117] "RemoveContainer" containerID="1d77d8aa1603af05cf6534a34fd99e8db2a1c521c10e47b4e76f88db19955e57" Jul 01 22:13:44.331959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:44.331936 2568 generic.go:356] "Generic (PLEG): container finished" podID="d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc" containerID="2357dd9802187589c84404b3bd40d2516f9a407c2b7fdbdb25b9166ca8e8e6b8" exitCode=0 Jul 01 22:13:44.332072 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:44.331976 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-rr67r" event={"ID":"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc","Type":"ContainerDied","Data":"2357dd9802187589c84404b3bd40d2516f9a407c2b7fdbdb25b9166ca8e8e6b8"} Jul 01 22:13:44.332330 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:44.332309 2568 scope.go:117] "RemoveContainer" containerID="2357dd9802187589c84404b3bd40d2516f9a407c2b7fdbdb25b9166ca8e8e6b8" Jul 01 22:13:45.337561 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:45.337519 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-rr67r" event={"ID":"d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc","Type":"ContainerStarted","Data":"6d1eb52ba429bc96a5703d7da1eebc93c022b18f579d49b7e550fdbeae2ecba5"} Jul 01 22:13:45.339230 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:45.339204 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-7zx7k" event={"ID":"5fcbd7f4-17ea-40c3-a234-5278cd77e7e7","Type":"ContainerStarted","Data":"2b9b7e243043c528393c397608eacae7c075446cb5bb5b764ce1968f99392892"} Jul 01 22:13:45.699886 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:45.699840 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" podUID="1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" containerName="registry" containerID="cri-o://fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade" gracePeriod=30 Jul 01 22:13:45.984921 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:45.984891 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:13:46.180089 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.180050 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-installation-pull-secrets\") pod \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " Jul 01 22:13:46.180089 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.180091 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-certificates\") pod \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " Jul 01 22:13:46.180342 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.180124 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvwqt\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-kube-api-access-wvwqt\") pod \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " Jul 01 22:13:46.180342 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.180167 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-image-registry-private-configuration\") pod \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " Jul 01 22:13:46.180342 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.180199 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls\") pod \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " Jul 01 22:13:46.180342 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.180240 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-ca-trust-extracted\") pod \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " Jul 01 22:13:46.180342 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.180268 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-trusted-ca\") pod \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " Jul 01 22:13:46.180342 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.180309 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-bound-sa-token\") pod \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\" (UID: \"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df\") " Jul 01 22:13:46.180793 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.180762 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:13:46.181006 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.180769 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:13:46.182742 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.182709 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:13:46.182848 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.182820 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-kube-api-access-wvwqt" (OuterVolumeSpecName: "kube-api-access-wvwqt") pod "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df"). InnerVolumeSpecName "kube-api-access-wvwqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:13:46.182912 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.182847 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:13:46.182966 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.182901 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:13:46.183107 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.183090 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:13:46.189455 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.189427 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" (UID: "1f5bcb6c-99cd-4a13-826d-21cdd30ae4df"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:13:46.281857 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.281781 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-image-registry-private-configuration\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:13:46.281857 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.281810 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-tls\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:13:46.281857 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.281820 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-ca-trust-extracted\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:13:46.281857 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.281828 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-trusted-ca\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:13:46.281857 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.281837 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-bound-sa-token\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:13:46.281857 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.281844 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-installation-pull-secrets\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:13:46.281857 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.281853 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-registry-certificates\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:13:46.281857 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.281861 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvwqt\" (UniqueName: \"kubernetes.io/projected/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df-kube-api-access-wvwqt\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:13:46.343883 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.343845 2568 generic.go:356] "Generic (PLEG): container finished" podID="1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" containerID="fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade" exitCode=0 Jul 01 22:13:46.344274 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.343895 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" Jul 01 22:13:46.344274 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.343938 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" event={"ID":"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df","Type":"ContainerDied","Data":"fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade"} Jul 01 22:13:46.344274 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.343992 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f94cfcdd4-b8zxd" event={"ID":"1f5bcb6c-99cd-4a13-826d-21cdd30ae4df","Type":"ContainerDied","Data":"261f50fd4731c14c9e9fbdb5c1af9560afc53e0ec0bbc3f9a407d6086f03cfba"} Jul 01 22:13:46.344274 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.344013 2568 scope.go:117] "RemoveContainer" containerID="fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade" Jul 01 22:13:46.353104 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.353087 2568 scope.go:117] "RemoveContainer" containerID="fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade" Jul 01 22:13:46.353369 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:13:46.353352 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade\": container with ID starting with fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade not found: ID does not exist" containerID="fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade" Jul 01 22:13:46.353454 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.353376 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade"} err="failed to get container status \"fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade\": rpc error: code = NotFound desc = could not find container \"fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade\": container with ID starting with fe8cd32e4a3290dfd9bf754b38895abc848e4efca1954e7673f5dce1dcdc0ade not found: ID does not exist" Jul 01 22:13:46.365899 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.365876 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f94cfcdd4-b8zxd"] Jul 01 22:13:46.369445 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.369424 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f94cfcdd4-b8zxd"] Jul 01 22:13:46.563415 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:46.563333 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" path="/var/lib/kubelet/pods/1f5bcb6c-99cd-4a13-826d-21cdd30ae4df/volumes" Jul 01 22:13:47.710400 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:47.710360 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:47.770024 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:47.769985 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:48.396983 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:48.396942 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:13:48.399260 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:48.399242 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8c06d2-2093-4cf2-9461-9accbc6ed553-metrics-certs\") pod \"network-metrics-daemon-qtm74\" (UID: \"7f8c06d2-2093-4cf2-9461-9accbc6ed553\") " pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:13:48.680361 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:48.680328 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zmdlm\"" Jul 01 22:13:48.687801 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:48.687780 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtm74" Jul 01 22:13:48.849264 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:48.849234 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qtm74"] Jul 01 22:13:48.851965 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:13:48.851933 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8c06d2_2093_4cf2_9461_9accbc6ed553.slice/crio-8f1a3567bbc6cfc644e896953170090ba2077e5e37977687676ec96e45ebdd84 WatchSource:0}: Error finding container 8f1a3567bbc6cfc644e896953170090ba2077e5e37977687676ec96e45ebdd84: Status 404 returned error can't find the container with id 8f1a3567bbc6cfc644e896953170090ba2077e5e37977687676ec96e45ebdd84 Jul 01 22:13:49.358421 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:49.358385 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qtm74" event={"ID":"7f8c06d2-2093-4cf2-9461-9accbc6ed553","Type":"ContainerStarted","Data":"8f1a3567bbc6cfc644e896953170090ba2077e5e37977687676ec96e45ebdd84"} Jul 01 22:13:50.365827 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:50.365791 2568 generic.go:356] "Generic (PLEG): container finished" podID="6b4b77f2-5cb7-4784-ab97-b80ac9c18060" containerID="d8f0ed436e991dee82dea7b4e76bbdf6485ddf0473de1d4c0f72dad77966bec7" exitCode=0 Jul 01 22:13:50.366263 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:50.365857 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" event={"ID":"6b4b77f2-5cb7-4784-ab97-b80ac9c18060","Type":"ContainerDied","Data":"d8f0ed436e991dee82dea7b4e76bbdf6485ddf0473de1d4c0f72dad77966bec7"} Jul 01 22:13:50.366394 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:50.366274 2568 scope.go:117] "RemoveContainer" containerID="d8f0ed436e991dee82dea7b4e76bbdf6485ddf0473de1d4c0f72dad77966bec7" Jul 01 22:13:51.371963 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:51.371925 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-9xghd" event={"ID":"6b4b77f2-5cb7-4784-ab97-b80ac9c18060","Type":"ContainerStarted","Data":"6507a892655257de723d254a923647401b309ed5b033387498264ca69793e658"} Jul 01 22:13:51.373739 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:51.373711 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qtm74" event={"ID":"7f8c06d2-2093-4cf2-9461-9accbc6ed553","Type":"ContainerStarted","Data":"1495060a29935d3783058fe4282e0fc4cef742770f42b589d1e2e84a61031491"} Jul 01 22:13:51.373854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:51.373756 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qtm74" event={"ID":"7f8c06d2-2093-4cf2-9461-9accbc6ed553","Type":"ContainerStarted","Data":"d5e33ba673e23c657b603e029605b19d3131c70dcee1b0f5f04cf0c50a18632b"} Jul 01 22:13:51.407930 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:51.407880 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qtm74" podStartSLOduration=130.96350297 podStartE2EDuration="2m12.407861716s" totalImagesPullingTime="1.444358746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:13:51.406421047 +0000 UTC m=+134.493698533" watchObservedRunningTime="2026-07-01 22:13:51.407861716 +0000 UTC m=+134.495139249" Jul 01 22:13:51.509591 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:51.509558 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:13:51.562530 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:13:51.562497 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:14:35.615870 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:14:35.615791 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:14:35.716900 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:14:35.716852 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:14:40.451634 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:14:40.451598 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:14:47.618832 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:14:47.618795 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:14:47.719673 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:14:47.719625 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:14:48.999076 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:14:48.999042 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:14:49.051064 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:14:49.051030 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:15:00.344564 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:15:00.344529 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:15:00.444954 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:15:00.444911 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:15:00.497323 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:15:00.497285 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:15:02.735566 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:15:02.735529 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:15:02.841260 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:15:02.841226 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:15:15.422973 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:15:15.422938 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:15:38.205858 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:15:38.205819 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:15:38.304716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:15:38.304649 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:15:39.318954 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:15:39.318920 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:15:39.377709 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:15:39.377649 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:05.139446 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:05.139351 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:05.689126 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:05.689084 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:05.794704 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:05.794646 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:06.535676 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:06.535616 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:08.745852 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:08.745813 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:08.833259 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:08.833223 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:09.837375 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:09.837344 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:09.963084 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:09.963045 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:10.201880 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:10.201843 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:10.370130 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:10.370094 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:13.750168 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:13.750133 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:13.891863 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:13.891827 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:15.862284 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:15.862247 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:15.988053 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:15.988002 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:18.925943 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:18.925901 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:19.023737 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:19.023693 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:21.046322 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:21.046281 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:21.161928 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:21.161883 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:23.740993 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:23.740955 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:23.839977 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:23.839936 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:30.251439 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:30.251402 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:30.369880 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:30.369841 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:32.334998 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:32.334964 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:38.340546 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:38.340515 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/1.log" Jul 01 22:16:38.343779 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:38.343759 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/1.log" Jul 01 22:16:38.352242 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:38.352217 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 22:16:44.490519 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:44.490480 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:44.628301 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:44.628259 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:45.150553 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.150519 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:45.615859 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.615819 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:45.730767 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.730729 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:45.815582 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.815545 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs"] Jul 01 22:16:45.815854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.815842 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" containerName="registry" Jul 01 22:16:45.815910 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.815855 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" containerName="registry" Jul 01 22:16:45.815945 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.815922 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f5bcb6c-99cd-4a13-826d-21cdd30ae4df" containerName="registry" Jul 01 22:16:45.818855 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.818838 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:45.822161 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.822137 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 22:16:45.822564 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.822545 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4b42z\"" Jul 01 22:16:45.822847 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.822825 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 22:16:45.822956 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.822854 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 22:16:45.823992 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:16:45.823961 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="d3bc568f-be58-4ef6-baae-471c0fac6ddb" pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:45.824106 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:16:45.824024 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret" Jul 01 22:16:45.856413 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.856385 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs"] Jul 01 22:16:45.921017 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.920989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3bc568f-be58-4ef6-baae-471c0fac6ddb-tmp\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:45.921216 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.921026 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d3bc568f-be58-4ef6-baae-471c0fac6ddb-manifests\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:45.921216 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.921049 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mfvx\" (UniqueName: \"kubernetes.io/projected/d3bc568f-be58-4ef6-baae-471c0fac6ddb-kube-api-access-2mfvx\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:45.921216 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.921194 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d3bc568f-be58-4ef6-baae-471c0fac6ddb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:45.921365 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:45.921239 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3bc568f-be58-4ef6-baae-471c0fac6ddb-webhook-cert\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:46.021831 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.021794 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3bc568f-be58-4ef6-baae-471c0fac6ddb-tmp\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:46.021998 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.021836 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d3bc568f-be58-4ef6-baae-471c0fac6ddb-manifests\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:46.021998 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.021870 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mfvx\" (UniqueName: \"kubernetes.io/projected/d3bc568f-be58-4ef6-baae-471c0fac6ddb-kube-api-access-2mfvx\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:46.021998 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.021953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d3bc568f-be58-4ef6-baae-471c0fac6ddb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:46.021998 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.021983 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3bc568f-be58-4ef6-baae-471c0fac6ddb-webhook-cert\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:46.022396 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.022371 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d3bc568f-be58-4ef6-baae-471c0fac6ddb-manifests\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:46.024251 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.024221 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3bc568f-be58-4ef6-baae-471c0fac6ddb-tmp\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:46.024353 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.024307 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3bc568f-be58-4ef6-baae-471c0fac6ddb-webhook-cert\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:46.024538 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.024518 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d3bc568f-be58-4ef6-baae-471c0fac6ddb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:46.043431 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.043390 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:46.043777 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.043756 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mfvx\" (UniqueName: \"kubernetes.io/projected/d3bc568f-be58-4ef6-baae-471c0fac6ddb-kube-api-access-2mfvx\") pod \"opendatahub-operator-controller-manager-cddbccb87-z5fgs\" (UID: \"d3bc568f-be58-4ef6-baae-471c0fac6ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:46.129576 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.129539 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:46.144555 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.144523 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:46.288221 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.288185 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:46.305211 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.305188 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs"] Jul 01 22:16:46.307750 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:16:46.307719 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3bc568f_be58_4ef6_baae_471c0fac6ddb.slice/crio-6396f80c748e450efec103ec61b5ac7610e3370d8e498421922164886d0abbdb WatchSource:0}: Error finding container 6396f80c748e450efec103ec61b5ac7610e3370d8e498421922164886d0abbdb: Status 404 returned error can't find the container with id 6396f80c748e450efec103ec61b5ac7610e3370d8e498421922164886d0abbdb Jul 01 22:16:46.309448 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.309427 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 22:16:46.418712 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.418677 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:46.518759 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.518653 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:46.625955 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.625906 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:46.732399 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:46.732322 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:47.048347 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:47.048316 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" event={"ID":"d3bc568f-be58-4ef6-baae-471c0fac6ddb","Type":"ContainerStarted","Data":"6396f80c748e450efec103ec61b5ac7610e3370d8e498421922164886d0abbdb"} Jul 01 22:16:47.131225 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:47.131188 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 22:16:50.062785 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:50.062745 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" event={"ID":"d3bc568f-be58-4ef6-baae-471c0fac6ddb","Type":"ContainerStarted","Data":"2713c42c6c4515400ff164622112fb665258775792e2d279c32873e85bc444e4"} Jul 01 22:16:51.068591 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:51.068554 2568 generic.go:356] "Generic (PLEG): container finished" podID="d3bc568f-be58-4ef6-baae-471c0fac6ddb" containerID="2713c42c6c4515400ff164622112fb665258775792e2d279c32873e85bc444e4" exitCode=0 Jul 01 22:16:51.069004 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:51.068605 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" event={"ID":"d3bc568f-be58-4ef6-baae-471c0fac6ddb","Type":"ContainerDied","Data":"2713c42c6c4515400ff164622112fb665258775792e2d279c32873e85bc444e4"} Jul 01 22:16:52.074733 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:52.074690 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" event={"ID":"d3bc568f-be58-4ef6-baae-471c0fac6ddb","Type":"ContainerStarted","Data":"96926168616f3def633f61604697f221ad45e2514ee00969da90d081acddbe16"} Jul 01 22:16:52.075311 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:52.074888 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:16:52.105699 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:52.105632 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" podStartSLOduration=2.588630569 podStartE2EDuration="7.105616425s" totalImagesPullingTime="3.422704467s" totalInitContainerRuntime="1.094281389s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:16:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:16:52.102951527 +0000 UTC m=+315.190229011" watchObservedRunningTime="2026-07-01 22:16:52.105616425 +0000 UTC m=+315.192893908" Jul 01 22:16:56.611901 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:56.611862 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:16:57.871925 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:16:57.871886 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:03.081942 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:03.081913 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cddbccb87-z5fgs" Jul 01 22:17:04.964247 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:04.964210 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:05.431019 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:05.430970 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:06.635775 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.635740 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jt699"] Jul 01 22:17:06.643214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.643188 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jt699" Jul 01 22:17:06.646521 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.646498 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 01 22:17:06.646521 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.646514 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4tlg2\"" Jul 01 22:17:06.666060 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.666027 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jt699"] Jul 01 22:17:06.685755 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.685727 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:06.691845 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.691821 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/570160c7-a6d7-49d9-83a7-78e8df973289-cert\") pod \"odh-model-controller-7998c67dc4-jt699\" (UID: \"570160c7-a6d7-49d9-83a7-78e8df973289\") " pod="opendatahub/odh-model-controller-7998c67dc4-jt699" Jul 01 22:17:06.691958 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.691866 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h28sq\" (UniqueName: \"kubernetes.io/projected/570160c7-a6d7-49d9-83a7-78e8df973289-kube-api-access-h28sq\") pod \"odh-model-controller-7998c67dc4-jt699\" (UID: \"570160c7-a6d7-49d9-83a7-78e8df973289\") " pod="opendatahub/odh-model-controller-7998c67dc4-jt699" Jul 01 22:17:06.792315 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.792276 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/570160c7-a6d7-49d9-83a7-78e8df973289-cert\") pod \"odh-model-controller-7998c67dc4-jt699\" (UID: \"570160c7-a6d7-49d9-83a7-78e8df973289\") " pod="opendatahub/odh-model-controller-7998c67dc4-jt699" Jul 01 22:17:06.792482 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.792333 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h28sq\" (UniqueName: \"kubernetes.io/projected/570160c7-a6d7-49d9-83a7-78e8df973289-kube-api-access-h28sq\") pod \"odh-model-controller-7998c67dc4-jt699\" (UID: \"570160c7-a6d7-49d9-83a7-78e8df973289\") " pod="opendatahub/odh-model-controller-7998c67dc4-jt699" Jul 01 22:17:06.792482 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:17:06.792443 2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 01 22:17:06.792558 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:17:06.792508 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/570160c7-a6d7-49d9-83a7-78e8df973289-cert podName:570160c7-a6d7-49d9-83a7-78e8df973289 nodeName:}" failed. No retries permitted until 2026-07-01 22:17:07.292490072 +0000 UTC m=+330.379767538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/570160c7-a6d7-49d9-83a7-78e8df973289-cert") pod "odh-model-controller-7998c67dc4-jt699" (UID: "570160c7-a6d7-49d9-83a7-78e8df973289") : secret "odh-model-controller-webhook-cert" not found Jul 01 22:17:06.814057 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.814027 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h28sq\" (UniqueName: \"kubernetes.io/projected/570160c7-a6d7-49d9-83a7-78e8df973289-kube-api-access-h28sq\") pod \"odh-model-controller-7998c67dc4-jt699\" (UID: \"570160c7-a6d7-49d9-83a7-78e8df973289\") " pod="opendatahub/odh-model-controller-7998c67dc4-jt699" Jul 01 22:17:06.859018 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.858986 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:06.997254 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:06.997223 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:07.182716 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:07.182645 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:07.294771 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:07.294680 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/570160c7-a6d7-49d9-83a7-78e8df973289-cert\") pod \"odh-model-controller-7998c67dc4-jt699\" (UID: \"570160c7-a6d7-49d9-83a7-78e8df973289\") " pod="opendatahub/odh-model-controller-7998c67dc4-jt699" Jul 01 22:17:07.297248 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:07.297220 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/570160c7-a6d7-49d9-83a7-78e8df973289-cert\") pod \"odh-model-controller-7998c67dc4-jt699\" (UID: \"570160c7-a6d7-49d9-83a7-78e8df973289\") " pod="opendatahub/odh-model-controller-7998c67dc4-jt699" Jul 01 22:17:07.553427 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:07.553320 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jt699" Jul 01 22:17:07.727479 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:07.727443 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jt699"] Jul 01 22:17:07.730573 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:17:07.730543 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570160c7_a6d7_49d9_83a7_78e8df973289.slice/crio-5bfbd113d078675435e55b9ebb2d76a58eb0d86a572df9e8362e7d15f10f4901 WatchSource:0}: Error finding container 5bfbd113d078675435e55b9ebb2d76a58eb0d86a572df9e8362e7d15f10f4901: Status 404 returned error can't find the container with id 5bfbd113d078675435e55b9ebb2d76a58eb0d86a572df9e8362e7d15f10f4901 Jul 01 22:17:08.001700 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.001668 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tgtr8"] Jul 01 22:17:08.006057 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.006037 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" Jul 01 22:17:08.011026 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.011003 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 01 22:17:08.034217 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.034186 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tgtr8"] Jul 01 22:17:08.059458 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.059419 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:08.100806 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.100768 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbw92\" (UniqueName: \"kubernetes.io/projected/97dc65a9-6f2a-4e13-94aa-7a041b9f6e23-kube-api-access-lbw92\") pod \"model-serving-api-54d89bd5fc-tgtr8\" (UID: \"97dc65a9-6f2a-4e13-94aa-7a041b9f6e23\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" Jul 01 22:17:08.100991 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.100824 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97dc65a9-6f2a-4e13-94aa-7a041b9f6e23-tls-certs\") pod \"model-serving-api-54d89bd5fc-tgtr8\" (UID: \"97dc65a9-6f2a-4e13-94aa-7a041b9f6e23\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" Jul 01 22:17:08.143488 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.143453 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jt699" event={"ID":"570160c7-a6d7-49d9-83a7-78e8df973289","Type":"ContainerStarted","Data":"5bfbd113d078675435e55b9ebb2d76a58eb0d86a572df9e8362e7d15f10f4901"} Jul 01 22:17:08.201413 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.201376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbw92\" (UniqueName: \"kubernetes.io/projected/97dc65a9-6f2a-4e13-94aa-7a041b9f6e23-kube-api-access-lbw92\") pod \"model-serving-api-54d89bd5fc-tgtr8\" (UID: \"97dc65a9-6f2a-4e13-94aa-7a041b9f6e23\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" Jul 01 22:17:08.201413 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.201427 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97dc65a9-6f2a-4e13-94aa-7a041b9f6e23-tls-certs\") pod \"model-serving-api-54d89bd5fc-tgtr8\" (UID: \"97dc65a9-6f2a-4e13-94aa-7a041b9f6e23\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" Jul 01 22:17:08.203873 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.203843 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97dc65a9-6f2a-4e13-94aa-7a041b9f6e23-tls-certs\") pod \"model-serving-api-54d89bd5fc-tgtr8\" (UID: \"97dc65a9-6f2a-4e13-94aa-7a041b9f6e23\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" Jul 01 22:17:08.279425 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.279357 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbw92\" (UniqueName: \"kubernetes.io/projected/97dc65a9-6f2a-4e13-94aa-7a041b9f6e23-kube-api-access-lbw92\") pod \"model-serving-api-54d89bd5fc-tgtr8\" (UID: \"97dc65a9-6f2a-4e13-94aa-7a041b9f6e23\") " pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" Jul 01 22:17:08.304353 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.304304 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:08.316266 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.316240 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" Jul 01 22:17:08.523219 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:08.523039 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tgtr8"] Jul 01 22:17:08.526862 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:17:08.526829 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97dc65a9_6f2a_4e13_94aa_7a041b9f6e23.slice/crio-65fdf8def69276736f6efd9d56deff2d1757cec0a0741c1a132be1ed7d0bab89 WatchSource:0}: Error finding container 65fdf8def69276736f6efd9d56deff2d1757cec0a0741c1a132be1ed7d0bab89: Status 404 returned error can't find the container with id 65fdf8def69276736f6efd9d56deff2d1757cec0a0741c1a132be1ed7d0bab89 Jul 01 22:17:09.150632 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.150599 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" event={"ID":"97dc65a9-6f2a-4e13-94aa-7a041b9f6e23","Type":"ContainerStarted","Data":"65fdf8def69276736f6efd9d56deff2d1757cec0a0741c1a132be1ed7d0bab89"} Jul 01 22:17:09.236541 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.236505 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:09.353218 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.353178 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5"] Jul 01 22:17:09.357863 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.357815 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" Jul 01 22:17:09.366087 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.366063 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 22:17:09.367252 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.367228 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pvsfv\"" Jul 01 22:17:09.367623 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.367600 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 22:17:09.385194 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.385164 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5"] Jul 01 22:17:09.386731 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.386627 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:09.413612 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.413522 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4292d888-30df-4f38-bc5e-4ffc6c85fb00-tls-certs\") pod \"kube-auth-proxy-7dd7845ff-wwvj5\" (UID: \"4292d888-30df-4f38-bc5e-4ffc6c85fb00\") " pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" Jul 01 22:17:09.413612 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.413577 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4292d888-30df-4f38-bc5e-4ffc6c85fb00-tmp\") pod \"kube-auth-proxy-7dd7845ff-wwvj5\" (UID: \"4292d888-30df-4f38-bc5e-4ffc6c85fb00\") " pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" Jul 01 22:17:09.413612 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.413604 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk97w\" (UniqueName: \"kubernetes.io/projected/4292d888-30df-4f38-bc5e-4ffc6c85fb00-kube-api-access-fk97w\") pod \"kube-auth-proxy-7dd7845ff-wwvj5\" (UID: \"4292d888-30df-4f38-bc5e-4ffc6c85fb00\") " pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" Jul 01 22:17:09.514371 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.514330 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4292d888-30df-4f38-bc5e-4ffc6c85fb00-tls-certs\") pod \"kube-auth-proxy-7dd7845ff-wwvj5\" (UID: \"4292d888-30df-4f38-bc5e-4ffc6c85fb00\") " pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" Jul 01 22:17:09.514555 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.514387 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4292d888-30df-4f38-bc5e-4ffc6c85fb00-tmp\") pod \"kube-auth-proxy-7dd7845ff-wwvj5\" (UID: \"4292d888-30df-4f38-bc5e-4ffc6c85fb00\") " pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" Jul 01 22:17:09.514555 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.514415 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk97w\" (UniqueName: \"kubernetes.io/projected/4292d888-30df-4f38-bc5e-4ffc6c85fb00-kube-api-access-fk97w\") pod \"kube-auth-proxy-7dd7845ff-wwvj5\" (UID: \"4292d888-30df-4f38-bc5e-4ffc6c85fb00\") " pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" Jul 01 22:17:09.517158 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.517128 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4292d888-30df-4f38-bc5e-4ffc6c85fb00-tmp\") pod \"kube-auth-proxy-7dd7845ff-wwvj5\" (UID: \"4292d888-30df-4f38-bc5e-4ffc6c85fb00\") " pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" Jul 01 22:17:09.517584 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.517537 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4292d888-30df-4f38-bc5e-4ffc6c85fb00-tls-certs\") pod \"kube-auth-proxy-7dd7845ff-wwvj5\" (UID: \"4292d888-30df-4f38-bc5e-4ffc6c85fb00\") " pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" Jul 01 22:17:09.528405 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.528359 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk97w\" (UniqueName: \"kubernetes.io/projected/4292d888-30df-4f38-bc5e-4ffc6c85fb00-kube-api-access-fk97w\") pod \"kube-auth-proxy-7dd7845ff-wwvj5\" (UID: \"4292d888-30df-4f38-bc5e-4ffc6c85fb00\") " pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" Jul 01 22:17:09.672743 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:09.672704 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" Jul 01 22:17:11.303960 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.302255 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg"] Jul 01 22:17:11.318674 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.314924 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.318674 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.317839 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:11.318674 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.318513 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 22:17:11.322050 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.319065 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vhmw6\"" Jul 01 22:17:11.322050 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.319245 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 22:17:11.322050 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.319401 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 22:17:11.322050 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.319568 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 22:17:11.327619 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.327589 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg"] Jul 01 22:17:11.337544 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.337513 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.337738 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.337559 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-token\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.337738 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.337596 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.337738 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.337620 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.337738 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.337691 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdbz8\" (UniqueName: \"kubernetes.io/projected/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-kube-api-access-hdbz8\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.337966 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.337764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-cacerts\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.337966 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.337810 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-local-certs\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.409693 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.409630 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:11.423291 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.423255 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5"] Jul 01 22:17:11.426298 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:17:11.426267 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4292d888_30df_4f38_bc5e_4ffc6c85fb00.slice/crio-97cbf84afb343e79cad93b514eb5ba563e5205a4c70a4090e4bfa8c83afbf86a WatchSource:0}: Error finding container 97cbf84afb343e79cad93b514eb5ba563e5205a4c70a4090e4bfa8c83afbf86a: Status 404 returned error can't find the container with id 97cbf84afb343e79cad93b514eb5ba563e5205a4c70a4090e4bfa8c83afbf86a Jul 01 22:17:11.438497 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.438472 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.438592 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.438516 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-token\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.438681 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.438640 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.438738 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.438694 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.438738 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.438725 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdbz8\" (UniqueName: \"kubernetes.io/projected/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-kube-api-access-hdbz8\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.438850 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.438830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-cacerts\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.438908 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.438879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-local-certs\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.439327 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.439301 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.441044 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.440943 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.441044 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.441022 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-cacerts\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.441167 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.441151 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-local-certs\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.441231 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.441214 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.447998 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.447978 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-token\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.448843 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.448820 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdbz8\" (UniqueName: \"kubernetes.io/projected/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-kube-api-access-hdbz8\") pod \"istiod-openshift-gateway-7574459656-tw7qg\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.662269 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.662167 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:11.818781 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:11.818756 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg"] Jul 01 22:17:11.821312 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:17:11.821287 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f42fcaa_400f_43ef_9b4c_d467ddc52df2.slice/crio-4aa1a214300e79e3d143fdae8367bdb76aedafa19161def2301515bf562ac103 WatchSource:0}: Error finding container 4aa1a214300e79e3d143fdae8367bdb76aedafa19161def2301515bf562ac103: Status 404 returned error can't find the container with id 4aa1a214300e79e3d143fdae8367bdb76aedafa19161def2301515bf562ac103 Jul 01 22:17:12.168442 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:12.168404 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" event={"ID":"4292d888-30df-4f38-bc5e-4ffc6c85fb00","Type":"ContainerStarted","Data":"97cbf84afb343e79cad93b514eb5ba563e5205a4c70a4090e4bfa8c83afbf86a"} Jul 01 22:17:12.170098 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:12.170060 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jt699" event={"ID":"570160c7-a6d7-49d9-83a7-78e8df973289","Type":"ContainerStarted","Data":"d694238273c1d7e9729c79d900f0e83d4ab71458c55140e7937bac9b05fea1b2"} Jul 01 22:17:12.170241 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:12.170170 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jt699" Jul 01 22:17:12.171843 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:12.171816 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" event={"ID":"97dc65a9-6f2a-4e13-94aa-7a041b9f6e23","Type":"ContainerStarted","Data":"3482332365edb699785334e53cc21da318fe7c4c17e6a1a08894451c2fad2e58"} Jul 01 22:17:12.171984 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:12.171917 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" Jul 01 22:17:12.173203 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:12.173184 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" event={"ID":"1f42fcaa-400f-43ef-9b4c-d467ddc52df2","Type":"ContainerStarted","Data":"4aa1a214300e79e3d143fdae8367bdb76aedafa19161def2301515bf562ac103"} Jul 01 22:17:12.211584 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:12.211528 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jt699" podStartSLOduration=2.688217088 podStartE2EDuration="6.211512379s" totalImagesPullingTime="3.523295291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:17:12.209352327 +0000 UTC m=+335.296629810" watchObservedRunningTime="2026-07-01 22:17:12.211512379 +0000 UTC m=+335.298789868" Jul 01 22:17:12.253373 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:12.253316 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" podStartSLOduration=2.525793283 podStartE2EDuration="5.253298992s" totalImagesPullingTime="2.727505709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:17:12.251620342 +0000 UTC m=+335.338897843" watchObservedRunningTime="2026-07-01 22:17:12.253298992 +0000 UTC m=+335.340576475" Jul 01 22:17:13.007383 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:13.007325 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:14.184929 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:14.184894 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" event={"ID":"4292d888-30df-4f38-bc5e-4ffc6c85fb00","Type":"ContainerStarted","Data":"fbeabdbebaa356250dd976fdd39a5719e89fdc9d0dc7139ca80ef49a3f622b23"} Jul 01 22:17:14.210144 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:14.210089 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7dd7845ff-wwvj5" podStartSLOduration=3.168272703 podStartE2EDuration="5.210069134s" totalImagesPullingTime="2.041796431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:17:14.208580134 +0000 UTC m=+337.295857618" watchObservedRunningTime="2026-07-01 22:17:14.210069134 +0000 UTC m=+337.297346619" Jul 01 22:17:15.324420 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:15.324370 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 22:17:15.324726 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:15.324483 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 22:17:16.196436 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:16.196394 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" event={"ID":"1f42fcaa-400f-43ef-9b4c-d467ddc52df2","Type":"ContainerStarted","Data":"9aefb73eabb9cbfaf496051655cf8cbeffeb74e4286efc2cd62e2d4af1c85e52"} Jul 01 22:17:16.196622 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:16.196452 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:16.198112 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:16.198083 2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-tw7qg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 01 22:17:16.198228 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:16.198140 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" podUID="1f42fcaa-400f-43ef-9b4c-d467ddc52df2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 22:17:16.256302 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:16.256233 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" podStartSLOduration=1.7555595309999998 podStartE2EDuration="5.256211773s" totalImagesPullingTime="3.500652242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:17:16.255121883 +0000 UTC m=+339.342399368" watchObservedRunningTime="2026-07-01 22:17:16.256211773 +0000 UTC m=+339.343489258" Jul 01 22:17:16.459868 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:16.459782 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:16.686004 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:16.685962 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:17.201641 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:17.201610 2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-tw7qg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 01 22:17:17.201822 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:17.201682 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" podUID="1f42fcaa-400f-43ef-9b4c-d467ddc52df2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 22:17:18.352010 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:18.351962 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:18.545251 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:18.545213 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8"] Jul 01 22:17:18.549085 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:18.549058 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" Jul 01 22:17:18.603503 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:18.603418 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 01 22:17:18.614986 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:18.614951 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77q78\" (UniqueName: \"kubernetes.io/projected/a4185069-1aa6-40f7-b0a4-f2048f52071c-kube-api-access-77q78\") pod \"kserve-controller-manager-d6f4b65b8-g9tx8\" (UID: \"a4185069-1aa6-40f7-b0a4-f2048f52071c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" Jul 01 22:17:18.615167 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:18.615141 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4185069-1aa6-40f7-b0a4-f2048f52071c-cert\") pod \"kserve-controller-manager-d6f4b65b8-g9tx8\" (UID: \"a4185069-1aa6-40f7-b0a4-f2048f52071c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" Jul 01 22:17:18.616939 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:18.616919 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-m8w8s\"" Jul 01 22:17:18.637852 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:18.637818 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8"] Jul 01 22:17:18.645541 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:18.645502 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:18.715963 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:18.715932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4185069-1aa6-40f7-b0a4-f2048f52071c-cert\") pod \"kserve-controller-manager-d6f4b65b8-g9tx8\" (UID: \"a4185069-1aa6-40f7-b0a4-f2048f52071c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" Jul 01 22:17:18.716153 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:18.716031 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77q78\" (UniqueName: \"kubernetes.io/projected/a4185069-1aa6-40f7-b0a4-f2048f52071c-kube-api-access-77q78\") pod \"kserve-controller-manager-d6f4b65b8-g9tx8\" (UID: \"a4185069-1aa6-40f7-b0a4-f2048f52071c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" Jul 01 22:17:18.716153 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:17:18.716098 2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 01 22:17:18.716274 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:17:18.716173 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4185069-1aa6-40f7-b0a4-f2048f52071c-cert podName:a4185069-1aa6-40f7-b0a4-f2048f52071c nodeName:}" failed. No retries permitted until 2026-07-01 22:17:19.216150572 +0000 UTC m=+342.303428049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4185069-1aa6-40f7-b0a4-f2048f52071c-cert") pod "kserve-controller-manager-d6f4b65b8-g9tx8" (UID: "a4185069-1aa6-40f7-b0a4-f2048f52071c") : secret "kserve-webhook-server-cert" not found Jul 01 22:17:18.730403 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:18.730364 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77q78\" (UniqueName: \"kubernetes.io/projected/a4185069-1aa6-40f7-b0a4-f2048f52071c-kube-api-access-77q78\") pod \"kserve-controller-manager-d6f4b65b8-g9tx8\" (UID: \"a4185069-1aa6-40f7-b0a4-f2048f52071c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" Jul 01 22:17:19.060316 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.060273 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:19.220628 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.220594 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4185069-1aa6-40f7-b0a4-f2048f52071c-cert\") pod \"kserve-controller-manager-d6f4b65b8-g9tx8\" (UID: \"a4185069-1aa6-40f7-b0a4-f2048f52071c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" Jul 01 22:17:19.220833 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:17:19.220719 2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 01 22:17:19.220833 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:17:19.220767 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4185069-1aa6-40f7-b0a4-f2048f52071c-cert podName:a4185069-1aa6-40f7-b0a4-f2048f52071c nodeName:}" failed. No retries permitted until 2026-07-01 22:17:20.220753751 +0000 UTC m=+343.308031213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4185069-1aa6-40f7-b0a4-f2048f52071c-cert") pod "kserve-controller-manager-d6f4b65b8-g9tx8" (UID: "a4185069-1aa6-40f7-b0a4-f2048f52071c") : secret "kserve-webhook-server-cert" not found Jul 01 22:17:19.340864 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.340781 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9"] Jul 01 22:17:19.344333 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.344314 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.350337 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.350313 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qpz9k\"" Jul 01 22:17:19.394520 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.394475 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9"] Jul 01 22:17:19.402376 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.402324 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:19.423290 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.423251 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.423461 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.423296 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.423461 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.423322 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.423461 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.423358 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.423461 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.423380 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.423461 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.423399 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.423461 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.423421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.423729 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.423541 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpfcz\" (UniqueName: \"kubernetes.io/projected/38ba54ff-8e3a-4474-a05b-d6d11cea6993-kube-api-access-wpfcz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.423729 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.423574 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.524366 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.524319 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.524564 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.524387 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.524564 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.524421 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.524564 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.524450 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.524564 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.524508 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.524564 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.524538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.524564 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.524563 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.524933 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.524772 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.524933 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.524887 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpfcz\" (UniqueName: \"kubernetes.io/projected/38ba54ff-8e3a-4474-a05b-d6d11cea6993-kube-api-access-wpfcz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.524933 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.524905 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.525075 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.524937 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.525075 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.525016 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.525281 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.525258 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.525705 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.525683 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.526987 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.526963 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.527391 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.527372 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.537403 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.537375 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpfcz\" (UniqueName: \"kubernetes.io/projected/38ba54ff-8e3a-4474-a05b-d6d11cea6993-kube-api-access-wpfcz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.540487 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.540461 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ba54ff-8e3a-4474-a05b-d6d11cea6993-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49zjb9\" (UID: \"38ba54ff-8e3a-4474-a05b-d6d11cea6993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.597782 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.597679 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:19.654994 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.654954 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:19.859077 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:17:19.859032 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ba54ff_8e3a_4474_a05b_d6d11cea6993.slice/crio-fcd02a98e01d32850c52ddc6e0e121398cbd14669be8481703c1a08bef30c256 WatchSource:0}: Error finding container fcd02a98e01d32850c52ddc6e0e121398cbd14669be8481703c1a08bef30c256: Status 404 returned error can't find the container with id fcd02a98e01d32850c52ddc6e0e121398cbd14669be8481703c1a08bef30c256 Jul 01 22:17:19.860596 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.860563 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9"] Jul 01 22:17:19.879241 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:19.879206 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:20.086080 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.086047 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg"] Jul 01 22:17:20.086260 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.086236 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" podUID="1f42fcaa-400f-43ef-9b4c-d467ddc52df2" containerName="discovery" containerID="cri-o://9aefb73eabb9cbfaf496051655cf8cbeffeb74e4286efc2cd62e2d4af1c85e52" gracePeriod=30 Jul 01 22:17:20.086970 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.086953 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:20.134974 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.134888 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:20.217404 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.217371 2568 generic.go:356] "Generic (PLEG): container finished" podID="1f42fcaa-400f-43ef-9b4c-d467ddc52df2" containerID="9aefb73eabb9cbfaf496051655cf8cbeffeb74e4286efc2cd62e2d4af1c85e52" exitCode=0 Jul 01 22:17:20.217562 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.217434 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" event={"ID":"1f42fcaa-400f-43ef-9b4c-d467ddc52df2","Type":"ContainerDied","Data":"9aefb73eabb9cbfaf496051655cf8cbeffeb74e4286efc2cd62e2d4af1c85e52"} Jul 01 22:17:20.218622 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.218600 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" event={"ID":"38ba54ff-8e3a-4474-a05b-d6d11cea6993","Type":"ContainerStarted","Data":"fcd02a98e01d32850c52ddc6e0e121398cbd14669be8481703c1a08bef30c256"} Jul 01 22:17:20.230779 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.230749 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4185069-1aa6-40f7-b0a4-f2048f52071c-cert\") pod \"kserve-controller-manager-d6f4b65b8-g9tx8\" (UID: \"a4185069-1aa6-40f7-b0a4-f2048f52071c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" Jul 01 22:17:20.233284 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.233226 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4185069-1aa6-40f7-b0a4-f2048f52071c-cert\") pod \"kserve-controller-manager-d6f4b65b8-g9tx8\" (UID: \"a4185069-1aa6-40f7-b0a4-f2048f52071c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" Jul 01 22:17:20.329804 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.329779 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:20.362859 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.362821 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" Jul 01 22:17:20.432775 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.432742 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-cacerts\") pod \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " Jul 01 22:17:20.433219 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.432784 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-token\") pod \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " Jul 01 22:17:20.433219 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.432929 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-kubeconfig\") pod \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " Jul 01 22:17:20.433219 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.432988 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-local-certs\") pod \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " Jul 01 22:17:20.433219 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.433019 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdbz8\" (UniqueName: \"kubernetes.io/projected/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-kube-api-access-hdbz8\") pod \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " Jul 01 22:17:20.433219 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.433087 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-csr-ca-configmap\") pod \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " Jul 01 22:17:20.433219 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.433117 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-csr-dns-cert\") pod \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\" (UID: \"1f42fcaa-400f-43ef-9b4c-d467ddc52df2\") " Jul 01 22:17:20.433600 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.433543 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1f42fcaa-400f-43ef-9b4c-d467ddc52df2" (UID: "1f42fcaa-400f-43ef-9b4c-d467ddc52df2"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:17:20.435523 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.435485 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-cacerts" (OuterVolumeSpecName: "cacerts") pod "1f42fcaa-400f-43ef-9b4c-d467ddc52df2" (UID: "1f42fcaa-400f-43ef-9b4c-d467ddc52df2"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:17:20.435523 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.435504 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-kube-api-access-hdbz8" (OuterVolumeSpecName: "kube-api-access-hdbz8") pod "1f42fcaa-400f-43ef-9b4c-d467ddc52df2" (UID: "1f42fcaa-400f-43ef-9b4c-d467ddc52df2"). InnerVolumeSpecName "kube-api-access-hdbz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:17:20.435693 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.435529 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-token" (OuterVolumeSpecName: "istio-token") pod "1f42fcaa-400f-43ef-9b4c-d467ddc52df2" (UID: "1f42fcaa-400f-43ef-9b4c-d467ddc52df2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:17:20.435693 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.435540 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1f42fcaa-400f-43ef-9b4c-d467ddc52df2" (UID: "1f42fcaa-400f-43ef-9b4c-d467ddc52df2"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:17:20.435693 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.435565 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-local-certs" (OuterVolumeSpecName: "local-certs") pod "1f42fcaa-400f-43ef-9b4c-d467ddc52df2" (UID: "1f42fcaa-400f-43ef-9b4c-d467ddc52df2"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:17:20.435795 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.435755 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1f42fcaa-400f-43ef-9b4c-d467ddc52df2" (UID: "1f42fcaa-400f-43ef-9b4c-d467ddc52df2"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:17:20.466715 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.466644 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:20.511307 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.511281 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8"] Jul 01 22:17:20.513586 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:17:20.513556 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4185069_1aa6_40f7_b0a4_f2048f52071c.slice/crio-bb0a5df31b61a64b01c985d4cdb30da9839745bddb5d6c972d79494f1c6dcb23 WatchSource:0}: Error finding container bb0a5df31b61a64b01c985d4cdb30da9839745bddb5d6c972d79494f1c6dcb23: Status 404 returned error can't find the container with id bb0a5df31b61a64b01c985d4cdb30da9839745bddb5d6c972d79494f1c6dcb23 Jul 01 22:17:20.534879 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.534849 2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-cacerts\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:17:20.534879 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.534873 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-token\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:17:20.534879 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.534882 2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-kubeconfig\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:17:20.535079 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.534890 2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-local-certs\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:17:20.535079 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.534902 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdbz8\" (UniqueName: \"kubernetes.io/projected/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-kube-api-access-hdbz8\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:17:20.535079 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.534911 2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-csr-ca-configmap\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:17:20.535079 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.534920 2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1f42fcaa-400f-43ef-9b4c-d467ddc52df2-istio-csr-dns-cert\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:17:20.662471 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:20.662428 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:17:21.224188 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:21.224156 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" Jul 01 22:17:21.224387 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:21.224194 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg" event={"ID":"1f42fcaa-400f-43ef-9b4c-d467ddc52df2","Type":"ContainerDied","Data":"4aa1a214300e79e3d143fdae8367bdb76aedafa19161def2301515bf562ac103"} Jul 01 22:17:21.224387 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:21.224244 2568 scope.go:117] "RemoveContainer" containerID="9aefb73eabb9cbfaf496051655cf8cbeffeb74e4286efc2cd62e2d4af1c85e52" Jul 01 22:17:21.225482 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:21.225419 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" event={"ID":"a4185069-1aa6-40f7-b0a4-f2048f52071c","Type":"ContainerStarted","Data":"bb0a5df31b61a64b01c985d4cdb30da9839745bddb5d6c972d79494f1c6dcb23"} Jul 01 22:17:21.258907 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:21.258872 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg"] Jul 01 22:17:21.267306 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:21.267237 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tw7qg"] Jul 01 22:17:22.566070 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:22.566028 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f42fcaa-400f-43ef-9b4c-d467ddc52df2" path="/var/lib/kubelet/pods/1f42fcaa-400f-43ef-9b4c-d467ddc52df2/volumes" Jul 01 22:17:23.181828 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:23.180960 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jt699" Jul 01 22:17:23.184925 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:23.184359 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tgtr8" Jul 01 22:17:24.247778 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:24.247732 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" event={"ID":"a4185069-1aa6-40f7-b0a4-f2048f52071c","Type":"ContainerStarted","Data":"788151f9ceb069d41996a0ae8503eb4809340494bbfc4e75a94b180dd99b2b88"} Jul 01 22:17:24.248274 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:24.247969 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" Jul 01 22:17:24.356772 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:24.356736 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 22:17:24.356886 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:24.356821 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 22:17:24.356886 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:24.356854 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 22:17:25.254175 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:25.254133 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" event={"ID":"38ba54ff-8e3a-4474-a05b-d6d11cea6993","Type":"ContainerStarted","Data":"7d7013c8e811629ae9e308550bb196136b2757faec5dd4f307ac234acf14b1e2"} Jul 01 22:17:25.304861 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:25.304811 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" podStartSLOduration=4.601715006 podStartE2EDuration="7.30478376s" totalImagesPullingTime="2.703068754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:17:24.368532133 +0000 UTC m=+347.455809618" watchObservedRunningTime="2026-07-01 22:17:25.30478376 +0000 UTC m=+348.392061244" Jul 01 22:17:25.305041 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:25.304976 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" podStartSLOduration=1.810034039 podStartE2EDuration="6.304968418s" totalImagesPullingTime="4.494934379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:17:25.302513646 +0000 UTC m=+348.389791132" watchObservedRunningTime="2026-07-01 22:17:25.304968418 +0000 UTC m=+348.392245901" Jul 01 22:17:25.655929 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:25.655838 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:25.660728 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:25.660695 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:26.258567 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:26.258525 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:26.259681 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:26.259634 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49zjb9" Jul 01 22:17:55.259622 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:17:55.259589 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g9tx8" Jul 01 22:18:06.845204 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:06.845161 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:06.946833 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:06.946799 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:06.964164 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:06.964137 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8kbgv"] Jul 01 22:18:06.964496 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:06.964484 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f42fcaa-400f-43ef-9b4c-d467ddc52df2" containerName="discovery" Jul 01 22:18:06.964539 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:06.964498 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f42fcaa-400f-43ef-9b4c-d467ddc52df2" containerName="discovery" Jul 01 22:18:06.964577 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:06.964560 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f42fcaa-400f-43ef-9b4c-d467ddc52df2" containerName="discovery" Jul 01 22:18:06.967531 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:06.967515 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" Jul 01 22:18:06.971232 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:06.971205 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 22:18:06.972747 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:06.972720 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-wnng9\"" Jul 01 22:18:06.972873 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:06.972728 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 22:18:06.977299 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:06.976917 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8kbgv"] Jul 01 22:18:07.021414 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.021370 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:07.037583 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.037554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4qcz\" (UniqueName: \"kubernetes.io/projected/4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f-kube-api-access-p4qcz\") pod \"kuadrant-operator-catalog-8kbgv\" (UID: \"4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f\") " pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" Jul 01 22:18:07.138688 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.138574 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4qcz\" (UniqueName: \"kubernetes.io/projected/4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f-kube-api-access-p4qcz\") pod \"kuadrant-operator-catalog-8kbgv\" (UID: \"4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f\") " pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" Jul 01 22:18:07.147772 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.147742 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4qcz\" (UniqueName: \"kubernetes.io/projected/4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f-kube-api-access-p4qcz\") pod \"kuadrant-operator-catalog-8kbgv\" (UID: \"4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f\") " pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" Jul 01 22:18:07.279834 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.279802 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" Jul 01 22:18:07.317131 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.317096 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8kbgv"] Jul 01 22:18:07.414564 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.414488 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8kbgv"] Jul 01 22:18:07.417474 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:18:07.417446 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ead67b0_d5c1_41d7_b0dd_076ca7e46f3f.slice/crio-b2c1a86e413b283f427f60bd714b1bd9ad1cccf8e7d3e4d79daeb535e2288463 WatchSource:0}: Error finding container b2c1a86e413b283f427f60bd714b1bd9ad1cccf8e7d3e4d79daeb535e2288463: Status 404 returned error can't find the container with id b2c1a86e413b283f427f60bd714b1bd9ad1cccf8e7d3e4d79daeb535e2288463 Jul 01 22:18:07.443385 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.443354 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" event={"ID":"4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f","Type":"ContainerStarted","Data":"b2c1a86e413b283f427f60bd714b1bd9ad1cccf8e7d3e4d79daeb535e2288463"} Jul 01 22:18:07.554397 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.554358 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vtl5"] Jul 01 22:18:07.558814 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.558792 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vtl5" Jul 01 22:18:07.577083 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.577057 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vtl5"] Jul 01 22:18:07.642866 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.642831 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hpr7\" (UniqueName: \"kubernetes.io/projected/935162f7-8488-4d32-a06f-b52fdd6684af-kube-api-access-4hpr7\") pod \"kuadrant-operator-catalog-5vtl5\" (UID: \"935162f7-8488-4d32-a06f-b52fdd6684af\") " pod="kuadrant-system/kuadrant-operator-catalog-5vtl5" Jul 01 22:18:07.743483 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.743450 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hpr7\" (UniqueName: \"kubernetes.io/projected/935162f7-8488-4d32-a06f-b52fdd6684af-kube-api-access-4hpr7\") pod \"kuadrant-operator-catalog-5vtl5\" (UID: \"935162f7-8488-4d32-a06f-b52fdd6684af\") " pod="kuadrant-system/kuadrant-operator-catalog-5vtl5" Jul 01 22:18:07.754166 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.754144 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hpr7\" (UniqueName: \"kubernetes.io/projected/935162f7-8488-4d32-a06f-b52fdd6684af-kube-api-access-4hpr7\") pod \"kuadrant-operator-catalog-5vtl5\" (UID: \"935162f7-8488-4d32-a06f-b52fdd6684af\") " pod="kuadrant-system/kuadrant-operator-catalog-5vtl5" Jul 01 22:18:07.776016 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.775984 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:07.868916 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:07.868886 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vtl5" Jul 01 22:18:08.012207 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:08.012120 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:08.025493 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:08.025453 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vtl5"] Jul 01 22:18:08.055382 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:18:08.055348 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod935162f7_8488_4d32_a06f_b52fdd6684af.slice/crio-f6b49b13d723f87b51dedb1aa71722d4b08d4be3509ec36ab47b09404ed47c03 WatchSource:0}: Error finding container f6b49b13d723f87b51dedb1aa71722d4b08d4be3509ec36ab47b09404ed47c03: Status 404 returned error can't find the container with id f6b49b13d723f87b51dedb1aa71722d4b08d4be3509ec36ab47b09404ed47c03 Jul 01 22:18:08.451584 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:08.451547 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vtl5" event={"ID":"935162f7-8488-4d32-a06f-b52fdd6684af","Type":"ContainerStarted","Data":"f6b49b13d723f87b51dedb1aa71722d4b08d4be3509ec36ab47b09404ed47c03"} Jul 01 22:18:10.463101 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:10.463046 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" event={"ID":"4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f","Type":"ContainerStarted","Data":"4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124"} Jul 01 22:18:10.463101 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:10.463067 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" podUID="4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f" containerName="registry-server" containerID="cri-o://4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124" gracePeriod=2 Jul 01 22:18:10.464528 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:10.464499 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vtl5" event={"ID":"935162f7-8488-4d32-a06f-b52fdd6684af","Type":"ContainerStarted","Data":"2c65ecd3c1729308ca092bdfacb243ada5671745bb4a2474ed90c9a337b7357a"} Jul 01 22:18:10.497714 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:10.497649 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" podStartSLOduration=2.38736821 podStartE2EDuration="4.497631211s" totalImagesPullingTime="2.110263001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:18:10.496185772 +0000 UTC m=+393.583463260" watchObservedRunningTime="2026-07-01 22:18:10.497631211 +0000 UTC m=+393.584908694" Jul 01 22:18:10.529140 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:10.529090 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5vtl5" podStartSLOduration=2.054260298 podStartE2EDuration="3.529073212s" totalImagesPullingTime="1.474812914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:18:10.528206239 +0000 UTC m=+393.615483736" watchObservedRunningTime="2026-07-01 22:18:10.529073212 +0000 UTC m=+393.616350695" Jul 01 22:18:10.722816 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:10.722755 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" Jul 01 22:18:10.769495 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:10.769463 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4qcz\" (UniqueName: \"kubernetes.io/projected/4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f-kube-api-access-p4qcz\") pod \"4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f\" (UID: \"4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f\") " Jul 01 22:18:10.771581 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:10.771550 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f-kube-api-access-p4qcz" (OuterVolumeSpecName: "kube-api-access-p4qcz") pod "4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f" (UID: "4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f"). InnerVolumeSpecName "kube-api-access-p4qcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:18:10.870788 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:10.870751 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4qcz\" (UniqueName: \"kubernetes.io/projected/4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f-kube-api-access-p4qcz\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:18:11.475519 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:11.475477 2568 generic.go:356] "Generic (PLEG): container finished" podID="4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f" containerID="4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124" exitCode=0 Jul 01 22:18:11.475956 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:11.475538 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" Jul 01 22:18:11.475956 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:11.475557 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" event={"ID":"4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f","Type":"ContainerDied","Data":"4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124"} Jul 01 22:18:11.475956 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:11.475628 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8kbgv" event={"ID":"4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f","Type":"ContainerDied","Data":"b2c1a86e413b283f427f60bd714b1bd9ad1cccf8e7d3e4d79daeb535e2288463"} Jul 01 22:18:11.475956 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:11.475649 2568 scope.go:117] "RemoveContainer" containerID="4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124" Jul 01 22:18:11.487494 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:11.487476 2568 scope.go:117] "RemoveContainer" containerID="4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124" Jul 01 22:18:11.487780 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:18:11.487761 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124\": container with ID starting with 4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124 not found: ID does not exist" containerID="4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124" Jul 01 22:18:11.487850 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:11.487790 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124"} err="failed to get container status \"4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124\": rpc error: code = NotFound desc = could not find container \"4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124\": container with ID starting with 4cc240b84d37dacaaa5c24c06800ba3c6c68c222a82487b2655bb9d56f6dc124 not found: ID does not exist" Jul 01 22:18:11.503238 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:11.503209 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8kbgv"] Jul 01 22:18:11.510100 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:11.510076 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8kbgv"] Jul 01 22:18:12.564011 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:12.563977 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f" path="/var/lib/kubelet/pods/4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f/volumes" Jul 01 22:18:17.869761 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:17.869644 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5vtl5" Jul 01 22:18:17.869761 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:17.869733 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5vtl5" Jul 01 22:18:17.892403 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:17.892370 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5vtl5" Jul 01 22:18:18.530063 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:18.530038 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5vtl5" Jul 01 22:18:36.438300 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:36.438260 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:37.828060 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:37.827996 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:37.925545 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:37.925503 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:38.248634 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:38.248595 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:38.343510 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:38.343475 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:40.120184 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:40.120148 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:41.620519 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.620488 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v"] Jul 01 22:18:41.620930 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.620889 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f" containerName="registry-server" Jul 01 22:18:41.620930 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.620902 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f" containerName="registry-server" Jul 01 22:18:41.621050 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.620960 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ead67b0-d5c1-41d7-b0dd-076ca7e46f3f" containerName="registry-server" Jul 01 22:18:41.628766 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.628741 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:18:41.633548 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.633527 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x2q46\"" Jul 01 22:18:41.646527 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.646492 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v"] Jul 01 22:18:41.691530 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.691493 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:41.724785 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.724750 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" (UID: \"893b57e8-bc0d-4ed6-a8ee-6dd22430a53d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:18:41.724963 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.724829 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8jkm\" (UniqueName: \"kubernetes.io/projected/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d-kube-api-access-b8jkm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" (UID: \"893b57e8-bc0d-4ed6-a8ee-6dd22430a53d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:18:41.825398 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.825363 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" (UID: \"893b57e8-bc0d-4ed6-a8ee-6dd22430a53d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:18:41.825563 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.825421 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8jkm\" (UniqueName: \"kubernetes.io/projected/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d-kube-api-access-b8jkm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" (UID: \"893b57e8-bc0d-4ed6-a8ee-6dd22430a53d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:18:41.825762 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.825743 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" (UID: \"893b57e8-bc0d-4ed6-a8ee-6dd22430a53d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:18:41.837347 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.837319 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8jkm\" (UniqueName: \"kubernetes.io/projected/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d-kube-api-access-b8jkm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" (UID: \"893b57e8-bc0d-4ed6-a8ee-6dd22430a53d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:18:41.938999 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:41.938964 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:18:42.062971 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:42.062936 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:42.091098 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:42.091063 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v"] Jul 01 22:18:42.095005 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:18:42.094976 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893b57e8_bc0d_4ed6_a8ee_6dd22430a53d.slice/crio-70ee3366ee4c3dcd16e903e4fe47466c434a442286b0d2f2ef10fdf32ef920fa WatchSource:0}: Error finding container 70ee3366ee4c3dcd16e903e4fe47466c434a442286b0d2f2ef10fdf32ef920fa: Status 404 returned error can't find the container with id 70ee3366ee4c3dcd16e903e4fe47466c434a442286b0d2f2ef10fdf32ef920fa Jul 01 22:18:42.620732 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:42.620701 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" event={"ID":"893b57e8-bc0d-4ed6-a8ee-6dd22430a53d","Type":"ContainerStarted","Data":"70ee3366ee4c3dcd16e903e4fe47466c434a442286b0d2f2ef10fdf32ef920fa"} Jul 01 22:18:42.824076 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:42.824040 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:42.935566 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:42.935475 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:44.177022 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:44.176981 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:44.315332 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:44.315296 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:44.365690 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:44.365647 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl"] Jul 01 22:18:44.369392 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:44.369375 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl" Jul 01 22:18:44.373407 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:44.373387 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-28vv8\"" Jul 01 22:18:44.385674 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:44.385632 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl"] Jul 01 22:18:44.445753 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:44.445671 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2qtn\" (UniqueName: \"kubernetes.io/projected/f9342327-964b-4742-98ac-913f6553563b-kube-api-access-j2qtn\") pod \"authorino-operator-75cc8d5cb7-zgcpl\" (UID: \"f9342327-964b-4742-98ac-913f6553563b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl" Jul 01 22:18:44.546775 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:44.546737 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2qtn\" (UniqueName: \"kubernetes.io/projected/f9342327-964b-4742-98ac-913f6553563b-kube-api-access-j2qtn\") pod \"authorino-operator-75cc8d5cb7-zgcpl\" (UID: \"f9342327-964b-4742-98ac-913f6553563b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl" Jul 01 22:18:44.567935 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:44.567905 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2qtn\" (UniqueName: \"kubernetes.io/projected/f9342327-964b-4742-98ac-913f6553563b-kube-api-access-j2qtn\") pod \"authorino-operator-75cc8d5cb7-zgcpl\" (UID: \"f9342327-964b-4742-98ac-913f6553563b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl" Jul 01 22:18:44.680187 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:44.680147 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl" Jul 01 22:18:44.704866 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:44.704772 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:44.845358 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:44.845329 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl"] Jul 01 22:18:44.847749 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:18:44.847722 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9342327_964b_4742_98ac_913f6553563b.slice/crio-ed9eb266d1adc06327aa1428b37812ff5936c2b477969493d5ddda739755edf0 WatchSource:0}: Error finding container ed9eb266d1adc06327aa1428b37812ff5936c2b477969493d5ddda739755edf0: Status 404 returned error can't find the container with id ed9eb266d1adc06327aa1428b37812ff5936c2b477969493d5ddda739755edf0 Jul 01 22:18:45.636996 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:45.636952 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl" event={"ID":"f9342327-964b-4742-98ac-913f6553563b","Type":"ContainerStarted","Data":"ed9eb266d1adc06327aa1428b37812ff5936c2b477969493d5ddda739755edf0"} Jul 01 22:18:46.051136 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:46.051095 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq"] Jul 01 22:18:46.058473 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:46.058444 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq" Jul 01 22:18:46.062637 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:46.062616 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 01 22:18:46.063241 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:46.063056 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-x748l\"" Jul 01 22:18:46.069401 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:46.069021 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq"] Jul 01 22:18:46.163007 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:46.162963 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdl7v\" (UniqueName: \"kubernetes.io/projected/6b020979-438f-4d95-a818-95caefb56ed6-kube-api-access-fdl7v\") pod \"dns-operator-controller-manager-864dd78c4c-kl7bq\" (UID: \"6b020979-438f-4d95-a818-95caefb56ed6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq" Jul 01 22:18:46.263622 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:46.263580 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdl7v\" (UniqueName: \"kubernetes.io/projected/6b020979-438f-4d95-a818-95caefb56ed6-kube-api-access-fdl7v\") pod \"dns-operator-controller-manager-864dd78c4c-kl7bq\" (UID: \"6b020979-438f-4d95-a818-95caefb56ed6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq" Jul 01 22:18:46.291203 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:46.291171 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdl7v\" (UniqueName: \"kubernetes.io/projected/6b020979-438f-4d95-a818-95caefb56ed6-kube-api-access-fdl7v\") pod \"dns-operator-controller-manager-864dd78c4c-kl7bq\" (UID: \"6b020979-438f-4d95-a818-95caefb56ed6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq" Jul 01 22:18:46.373743 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:46.373572 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq" Jul 01 22:18:46.645437 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:46.645355 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:46.911322 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:46.911247 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:47.071131 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:47.071107 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq"] Jul 01 22:18:47.073726 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:18:47.073695 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b020979_438f_4d95_a818_95caefb56ed6.slice/crio-e789025cfbdf2e73503b35a7b0d1ec44c05150a2891bce229ac30caf8b3e52f3 WatchSource:0}: Error finding container e789025cfbdf2e73503b35a7b0d1ec44c05150a2891bce229ac30caf8b3e52f3: Status 404 returned error can't find the container with id e789025cfbdf2e73503b35a7b0d1ec44c05150a2891bce229ac30caf8b3e52f3 Jul 01 22:18:47.648209 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:47.648176 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq" event={"ID":"6b020979-438f-4d95-a818-95caefb56ed6","Type":"ContainerStarted","Data":"e789025cfbdf2e73503b35a7b0d1ec44c05150a2891bce229ac30caf8b3e52f3"} Jul 01 22:18:47.649830 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:47.649804 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl" event={"ID":"f9342327-964b-4742-98ac-913f6553563b","Type":"ContainerStarted","Data":"97df8cdb4455364118e7d61f0bc063622f4ed0f67b040a423eaa6fbd07465215"} Jul 01 22:18:47.650038 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:47.649938 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl" Jul 01 22:18:47.680005 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:47.679951 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl" podStartSLOduration=1.567774479 podStartE2EDuration="3.679934s" totalImagesPullingTime="2.112159521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:18:47.677780883 +0000 UTC m=+430.765058383" watchObservedRunningTime="2026-07-01 22:18:47.679934 +0000 UTC m=+430.767211461" Jul 01 22:18:48.778065 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:48.778027 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx"] Jul 01 22:18:48.781670 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:48.781632 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:18:48.784924 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:48.784902 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mrmkg\"" Jul 01 22:18:48.793048 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:48.793018 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx"] Jul 01 22:18:48.889561 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:48.889508 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w28f\" (UniqueName: \"kubernetes.io/projected/232a273f-03e4-4e69-8929-72b56b39dffa-kube-api-access-9w28f\") pod \"limitador-operator-controller-manager-859d7b78bd-r9bzx\" (UID: \"232a273f-03e4-4e69-8929-72b56b39dffa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:18:48.990927 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:48.990883 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w28f\" (UniqueName: \"kubernetes.io/projected/232a273f-03e4-4e69-8929-72b56b39dffa-kube-api-access-9w28f\") pod \"limitador-operator-controller-manager-859d7b78bd-r9bzx\" (UID: \"232a273f-03e4-4e69-8929-72b56b39dffa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:18:49.000692 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:49.000632 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w28f\" (UniqueName: \"kubernetes.io/projected/232a273f-03e4-4e69-8929-72b56b39dffa-kube-api-access-9w28f\") pod \"limitador-operator-controller-manager-859d7b78bd-r9bzx\" (UID: \"232a273f-03e4-4e69-8929-72b56b39dffa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:18:49.095524 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:49.095432 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:18:49.297959 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:49.297918 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:50.178740 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:50.178673 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx"] Jul 01 22:18:50.182160 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:18:50.182131 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232a273f_03e4_4e69_8929_72b56b39dffa.slice/crio-129c89b162ee21f886a4feb154fdbe75beef701c204e5c77fd60adacd73d50d0 WatchSource:0}: Error finding container 129c89b162ee21f886a4feb154fdbe75beef701c204e5c77fd60adacd73d50d0: Status 404 returned error can't find the container with id 129c89b162ee21f886a4feb154fdbe75beef701c204e5c77fd60adacd73d50d0 Jul 01 22:18:50.667790 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:50.667754 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" event={"ID":"893b57e8-bc0d-4ed6-a8ee-6dd22430a53d","Type":"ContainerStarted","Data":"660cf34eee4b348f65eaeeddf41ff300c813970a2e15681c28fafc43a6e05ed4"} Jul 01 22:18:50.667996 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:50.667845 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:18:50.669404 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:50.669368 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq" event={"ID":"6b020979-438f-4d95-a818-95caefb56ed6","Type":"ContainerStarted","Data":"ee0707ff0ad639e6b7dcef71a823749162275b21dd182ddc8402d8aeda0f0151"} Jul 01 22:18:50.669529 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:50.669496 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq" Jul 01 22:18:50.670694 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:50.670675 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" event={"ID":"232a273f-03e4-4e69-8929-72b56b39dffa","Type":"ContainerStarted","Data":"129c89b162ee21f886a4feb154fdbe75beef701c204e5c77fd60adacd73d50d0"} Jul 01 22:18:50.692344 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:50.692273 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" podStartSLOduration=1.769403912 podStartE2EDuration="9.69225177s" totalImagesPullingTime="7.922847858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:18:50.692101783 +0000 UTC m=+433.779379270" watchObservedRunningTime="2026-07-01 22:18:50.69225177 +0000 UTC m=+433.779529256" Jul 01 22:18:50.711788 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:50.711736 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq" podStartSLOduration=1.768576618 podStartE2EDuration="4.711718419s" totalImagesPullingTime="2.943141801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:18:50.711359838 +0000 UTC m=+433.798637321" watchObservedRunningTime="2026-07-01 22:18:50.711718419 +0000 UTC m=+433.798995902" Jul 01 22:18:51.264490 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:51.264456 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:51.364100 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:51.364064 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:52.682772 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:52.682737 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" event={"ID":"232a273f-03e4-4e69-8929-72b56b39dffa","Type":"ContainerStarted","Data":"99f3e1975bd404548b415e466cbb9aaf3e0d7240bbc84a3a25f979a6b043ab1c"} Jul 01 22:18:52.683196 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:52.682798 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:18:52.704008 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:52.703957 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" podStartSLOduration=3.026919949 podStartE2EDuration="4.703940079s" totalImagesPullingTime="1.67702013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:18:52.70292989 +0000 UTC m=+435.790207375" watchObservedRunningTime="2026-07-01 22:18:52.703940079 +0000 UTC m=+435.791217563" Jul 01 22:18:53.115590 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:53.115503 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:53.390572 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:53.390487 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:54.725279 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:54.725249 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:54.825869 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:54.825831 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:54.928541 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:54.928511 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:18:58.658256 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:18:58.658225 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zgcpl" Jul 01 22:19:00.358424 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:00.358344 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:00.459608 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:00.459570 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:00.614369 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:00.614282 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:01.679307 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:01.679276 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kl7bq" Jul 01 22:19:01.679692 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:01.679355 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:19:02.955471 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:02.955432 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:03.108751 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.108710 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:03.554350 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.554315 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v"] Jul 01 22:19:03.554541 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.554503 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" podUID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" containerName="manager" containerID="cri-o://660cf34eee4b348f65eaeeddf41ff300c813970a2e15681c28fafc43a6e05ed4" gracePeriod=2 Jul 01 22:19:03.557538 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.557457 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:19:03.558411 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.558384 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v"] Jul 01 22:19:03.579333 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.579301 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx"] Jul 01 22:19:03.579785 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.579552 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" podUID="232a273f-03e4-4e69-8929-72b56b39dffa" containerName="manager" containerID="cri-o://99f3e1975bd404548b415e466cbb9aaf3e0d7240bbc84a3a25f979a6b043ab1c" gracePeriod=2 Jul 01 22:19:03.581943 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.581922 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:19:03.583730 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.583436 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7"] Jul 01 22:19:03.584493 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.584055 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" containerName="manager" Jul 01 22:19:03.584493 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.584078 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" containerName="manager" Jul 01 22:19:03.584493 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.584195 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" containerName="manager" Jul 01 22:19:03.585063 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.585032 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:19:03.587524 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.587497 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r9bzx\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="232a273f-03e4-4e69-8929-72b56b39dffa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:19:03.588232 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.588052 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx"] Jul 01 22:19:03.588232 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.588153 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" Jul 01 22:19:03.589983 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.589955 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r9bzx\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="232a273f-03e4-4e69-8929-72b56b39dffa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:19:03.593302 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.593269 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:19:03.607984 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.607927 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr"] Jul 01 22:19:03.608455 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.608440 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="232a273f-03e4-4e69-8929-72b56b39dffa" containerName="manager" Jul 01 22:19:03.608455 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.608456 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="232a273f-03e4-4e69-8929-72b56b39dffa" containerName="manager" Jul 01 22:19:03.608614 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.608517 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="232a273f-03e4-4e69-8929-72b56b39dffa" containerName="manager" Jul 01 22:19:03.611458 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.611440 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7"] Jul 01 22:19:03.611548 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.611522 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr" Jul 01 22:19:03.626129 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.626099 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr"] Jul 01 22:19:03.630110 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.630076 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:19:03.632417 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.632370 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r9bzx\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="232a273f-03e4-4e69-8929-72b56b39dffa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:19:03.636057 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.636028 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:19:03.640030 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.640005 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r9bzx\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="232a273f-03e4-4e69-8929-72b56b39dffa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:19:03.722248 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.722204 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khqt8\" (UniqueName: \"kubernetes.io/projected/4ba47b17-94fa-4e43-937c-3446fa214898-kube-api-access-khqt8\") pod \"limitador-operator-controller-manager-859d7b78bd-7vhrr\" (UID: \"4ba47b17-94fa-4e43-937c-3446fa214898\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr" Jul 01 22:19:03.722407 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.722286 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7706d83-d705-405f-8892-139e09a9e524-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gvww7\" (UID: \"f7706d83-d705-405f-8892-139e09a9e524\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" Jul 01 22:19:03.722407 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.722356 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64gc8\" (UniqueName: \"kubernetes.io/projected/f7706d83-d705-405f-8892-139e09a9e524-kube-api-access-64gc8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gvww7\" (UID: \"f7706d83-d705-405f-8892-139e09a9e524\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" Jul 01 22:19:03.736554 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.736523 2568 generic.go:356] "Generic (PLEG): container finished" podID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" containerID="660cf34eee4b348f65eaeeddf41ff300c813970a2e15681c28fafc43a6e05ed4" exitCode=0 Jul 01 22:19:03.738094 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.738038 2568 generic.go:356] "Generic (PLEG): container finished" podID="232a273f-03e4-4e69-8929-72b56b39dffa" containerID="99f3e1975bd404548b415e466cbb9aaf3e0d7240bbc84a3a25f979a6b043ab1c" exitCode=0 Jul 01 22:19:03.823170 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.823135 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khqt8\" (UniqueName: \"kubernetes.io/projected/4ba47b17-94fa-4e43-937c-3446fa214898-kube-api-access-khqt8\") pod \"limitador-operator-controller-manager-859d7b78bd-7vhrr\" (UID: \"4ba47b17-94fa-4e43-937c-3446fa214898\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr" Jul 01 22:19:03.823287 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.823213 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7706d83-d705-405f-8892-139e09a9e524-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gvww7\" (UID: \"f7706d83-d705-405f-8892-139e09a9e524\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" Jul 01 22:19:03.823353 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.823285 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64gc8\" (UniqueName: \"kubernetes.io/projected/f7706d83-d705-405f-8892-139e09a9e524-kube-api-access-64gc8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gvww7\" (UID: \"f7706d83-d705-405f-8892-139e09a9e524\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" Jul 01 22:19:03.823576 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.823556 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7706d83-d705-405f-8892-139e09a9e524-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gvww7\" (UID: \"f7706d83-d705-405f-8892-139e09a9e524\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" Jul 01 22:19:03.828712 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.828690 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:19:03.831330 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.831311 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:19:03.831559 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.831539 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:19:03.833997 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.833972 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r9bzx\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="232a273f-03e4-4e69-8929-72b56b39dffa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:19:03.836417 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.836391 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dzz9v\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:19:03.838509 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.838484 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khqt8\" (UniqueName: \"kubernetes.io/projected/4ba47b17-94fa-4e43-937c-3446fa214898-kube-api-access-khqt8\") pod \"limitador-operator-controller-manager-859d7b78bd-7vhrr\" (UID: \"4ba47b17-94fa-4e43-937c-3446fa214898\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr" Jul 01 22:19:03.838589 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.838577 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64gc8\" (UniqueName: \"kubernetes.io/projected/f7706d83-d705-405f-8892-139e09a9e524-kube-api-access-64gc8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gvww7\" (UID: \"f7706d83-d705-405f-8892-139e09a9e524\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" Jul 01 22:19:03.840421 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:03.840394 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r9bzx\" is forbidden: User \"system:node:ip-10-0-133-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-116.ec2.internal' and this object" podUID="232a273f-03e4-4e69-8929-72b56b39dffa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:19:03.924116 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.924078 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d-extensions-socket-volume\") pod \"893b57e8-bc0d-4ed6-a8ee-6dd22430a53d\" (UID: \"893b57e8-bc0d-4ed6-a8ee-6dd22430a53d\") " Jul 01 22:19:03.924116 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.924121 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w28f\" (UniqueName: \"kubernetes.io/projected/232a273f-03e4-4e69-8929-72b56b39dffa-kube-api-access-9w28f\") pod \"232a273f-03e4-4e69-8929-72b56b39dffa\" (UID: \"232a273f-03e4-4e69-8929-72b56b39dffa\") " Jul 01 22:19:03.924324 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.924149 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8jkm\" (UniqueName: \"kubernetes.io/projected/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d-kube-api-access-b8jkm\") pod \"893b57e8-bc0d-4ed6-a8ee-6dd22430a53d\" (UID: \"893b57e8-bc0d-4ed6-a8ee-6dd22430a53d\") " Jul 01 22:19:03.924614 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.924588 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" (UID: "893b57e8-bc0d-4ed6-a8ee-6dd22430a53d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:19:03.926225 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.926200 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/232a273f-03e4-4e69-8929-72b56b39dffa-kube-api-access-9w28f" (OuterVolumeSpecName: "kube-api-access-9w28f") pod "232a273f-03e4-4e69-8929-72b56b39dffa" (UID: "232a273f-03e4-4e69-8929-72b56b39dffa"). InnerVolumeSpecName "kube-api-access-9w28f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:19:03.926282 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.926226 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d-kube-api-access-b8jkm" (OuterVolumeSpecName: "kube-api-access-b8jkm") pod "893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" (UID: "893b57e8-bc0d-4ed6-a8ee-6dd22430a53d"). InnerVolumeSpecName "kube-api-access-b8jkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:19:03.996234 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:03.996197 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" Jul 01 22:19:04.004257 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.004229 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr" Jul 01 22:19:04.025424 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.025392 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d-extensions-socket-volume\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:19:04.025546 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.025428 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w28f\" (UniqueName: \"kubernetes.io/projected/232a273f-03e4-4e69-8929-72b56b39dffa-kube-api-access-9w28f\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:19:04.025546 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.025443 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8jkm\" (UniqueName: \"kubernetes.io/projected/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d-kube-api-access-b8jkm\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:19:04.155502 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.155468 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7"] Jul 01 22:19:04.158970 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:19:04.158942 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7706d83_d705_405f_8892_139e09a9e524.slice/crio-474600affc2f52a7b4120f824c8e936bfee400e446295dde6ae0f9cafcdc4bbb WatchSource:0}: Error finding container 474600affc2f52a7b4120f824c8e936bfee400e446295dde6ae0f9cafcdc4bbb: Status 404 returned error can't find the container with id 474600affc2f52a7b4120f824c8e936bfee400e446295dde6ae0f9cafcdc4bbb Jul 01 22:19:04.174065 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.174041 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr"] Jul 01 22:19:04.176993 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:19:04.176971 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba47b17_94fa_4e43_937c_3446fa214898.slice/crio-4f5928f28fd570ad76a23663345a2d0710010797b3bf1bdb94326ebe962392b5 WatchSource:0}: Error finding container 4f5928f28fd570ad76a23663345a2d0710010797b3bf1bdb94326ebe962392b5: Status 404 returned error can't find the container with id 4f5928f28fd570ad76a23663345a2d0710010797b3bf1bdb94326ebe962392b5 Jul 01 22:19:04.563834 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.563796 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="232a273f-03e4-4e69-8929-72b56b39dffa" path="/var/lib/kubelet/pods/232a273f-03e4-4e69-8929-72b56b39dffa/volumes" Jul 01 22:19:04.564172 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.564160 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="893b57e8-bc0d-4ed6-a8ee-6dd22430a53d" path="/var/lib/kubelet/pods/893b57e8-bc0d-4ed6-a8ee-6dd22430a53d/volumes" Jul 01 22:19:04.744445 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.744403 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" event={"ID":"f7706d83-d705-405f-8892-139e09a9e524","Type":"ContainerStarted","Data":"44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b"} Jul 01 22:19:04.744640 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.744577 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" Jul 01 22:19:04.744640 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.744621 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" event={"ID":"f7706d83-d705-405f-8892-139e09a9e524","Type":"ContainerStarted","Data":"474600affc2f52a7b4120f824c8e936bfee400e446295dde6ae0f9cafcdc4bbb"} Jul 01 22:19:04.745881 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.745864 2568 scope.go:117] "RemoveContainer" containerID="660cf34eee4b348f65eaeeddf41ff300c813970a2e15681c28fafc43a6e05ed4" Jul 01 22:19:04.745972 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.745865 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dzz9v" Jul 01 22:19:04.747566 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.747538 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr" event={"ID":"4ba47b17-94fa-4e43-937c-3446fa214898","Type":"ContainerStarted","Data":"9dce6a0847d751af4c2e99ce5baeb3231e0ffbcca0fba0d0f6d91aa260fab694"} Jul 01 22:19:04.747685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.747592 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr" Jul 01 22:19:04.747685 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.747617 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr" event={"ID":"4ba47b17-94fa-4e43-937c-3446fa214898","Type":"ContainerStarted","Data":"4f5928f28fd570ad76a23663345a2d0710010797b3bf1bdb94326ebe962392b5"} Jul 01 22:19:04.749101 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.749081 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r9bzx" Jul 01 22:19:04.757315 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.757299 2568 scope.go:117] "RemoveContainer" containerID="99f3e1975bd404548b415e466cbb9aaf3e0d7240bbc84a3a25f979a6b043ab1c" Jul 01 22:19:04.789394 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.789331 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" podStartSLOduration=1.789316467 podStartE2EDuration="1.789316467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:19:04.788232784 +0000 UTC m=+447.875510269" watchObservedRunningTime="2026-07-01 22:19:04.789316467 +0000 UTC m=+447.876593951" Jul 01 22:19:04.833095 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:04.832987 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr" podStartSLOduration=1.83297197 podStartE2EDuration="1.83297197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:19:04.832431217 +0000 UTC m=+447.919708705" watchObservedRunningTime="2026-07-01 22:19:04.83297197 +0000 UTC m=+447.920249453" Jul 01 22:19:07.513105 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:07.513072 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:07.614921 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:07.614884 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:11.304102 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:11.304061 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:11.407536 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:11.407502 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:15.758175 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:15.758144 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" Jul 01 22:19:15.758643 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:15.758337 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7vhrr" Jul 01 22:19:19.982805 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:19.982008 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:20.082614 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:20.082574 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:21.399622 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.399586 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7"] Jul 01 22:19:21.400045 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.399821 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" podUID="f7706d83-d705-405f-8892-139e09a9e524" containerName="manager" containerID="cri-o://44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b" gracePeriod=10 Jul 01 22:19:21.661031 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.660969 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" Jul 01 22:19:21.782577 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.782537 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64gc8\" (UniqueName: \"kubernetes.io/projected/f7706d83-d705-405f-8892-139e09a9e524-kube-api-access-64gc8\") pod \"f7706d83-d705-405f-8892-139e09a9e524\" (UID: \"f7706d83-d705-405f-8892-139e09a9e524\") " Jul 01 22:19:21.782792 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.782616 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7706d83-d705-405f-8892-139e09a9e524-extensions-socket-volume\") pod \"f7706d83-d705-405f-8892-139e09a9e524\" (UID: \"f7706d83-d705-405f-8892-139e09a9e524\") " Jul 01 22:19:21.783049 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.783019 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7706d83-d705-405f-8892-139e09a9e524-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f7706d83-d705-405f-8892-139e09a9e524" (UID: "f7706d83-d705-405f-8892-139e09a9e524"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 22:19:21.784718 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.784692 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7706d83-d705-405f-8892-139e09a9e524-kube-api-access-64gc8" (OuterVolumeSpecName: "kube-api-access-64gc8") pod "f7706d83-d705-405f-8892-139e09a9e524" (UID: "f7706d83-d705-405f-8892-139e09a9e524"). InnerVolumeSpecName "kube-api-access-64gc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:19:21.836129 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.836094 2568 generic.go:356] "Generic (PLEG): container finished" podID="f7706d83-d705-405f-8892-139e09a9e524" containerID="44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b" exitCode=0 Jul 01 22:19:21.836312 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.836139 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" Jul 01 22:19:21.836312 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.836188 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" event={"ID":"f7706d83-d705-405f-8892-139e09a9e524","Type":"ContainerDied","Data":"44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b"} Jul 01 22:19:21.836312 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.836246 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7" event={"ID":"f7706d83-d705-405f-8892-139e09a9e524","Type":"ContainerDied","Data":"474600affc2f52a7b4120f824c8e936bfee400e446295dde6ae0f9cafcdc4bbb"} Jul 01 22:19:21.836312 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.836280 2568 scope.go:117] "RemoveContainer" containerID="44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b" Jul 01 22:19:21.847322 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.847300 2568 scope.go:117] "RemoveContainer" containerID="44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b" Jul 01 22:19:21.847729 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:21.847704 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b\": container with ID starting with 44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b not found: ID does not exist" containerID="44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b" Jul 01 22:19:21.847817 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.847737 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b"} err="failed to get container status \"44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b\": rpc error: code = NotFound desc = could not find container \"44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b\": container with ID starting with 44cadcfda639d7fda51ceff38f6909b88988ac910929425c3626f53efd30c27b not found: ID does not exist" Jul 01 22:19:21.859040 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.859015 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7"] Jul 01 22:19:21.863074 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.863052 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gvww7"] Jul 01 22:19:21.883633 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.883611 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7706d83-d705-405f-8892-139e09a9e524-extensions-socket-volume\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:19:21.883633 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:21.883633 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64gc8\" (UniqueName: \"kubernetes.io/projected/f7706d83-d705-405f-8892-139e09a9e524-kube-api-access-64gc8\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:19:22.445983 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:22.445944 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:22.543825 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:22.543794 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:22.564081 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:22.564041 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7706d83-d705-405f-8892-139e09a9e524" path="/var/lib/kubelet/pods/f7706d83-d705-405f-8892-139e09a9e524/volumes" Jul 01 22:19:27.170924 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:27.170883 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:27.275441 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:27.275407 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:27.799822 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:27.799790 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:31.195555 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:31.195518 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:31.299350 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:31.299314 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:37.802502 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.802468 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj"] Jul 01 22:19:37.802974 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.802852 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7706d83-d705-405f-8892-139e09a9e524" containerName="manager" Jul 01 22:19:37.802974 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.802863 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7706d83-d705-405f-8892-139e09a9e524" containerName="manager" Jul 01 22:19:37.802974 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.802956 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7706d83-d705-405f-8892-139e09a9e524" containerName="manager" Jul 01 22:19:37.806151 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.806133 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:37.809879 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.809853 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gxnk6\"" Jul 01 22:19:37.830338 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.827968 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj"] Jul 01 22:19:37.840006 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.839977 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:37.917472 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.917438 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:37.917647 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.917477 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:37.917647 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.917513 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3c2af52-8690-4324-9ffc-05b654476041-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:37.917647 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.917574 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:37.917647 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.917605 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3c2af52-8690-4324-9ffc-05b654476041-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:37.917647 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.917647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:37.917843 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.917682 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3c2af52-8690-4324-9ffc-05b654476041-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:37.917843 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.917716 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkhql\" (UniqueName: \"kubernetes.io/projected/c3c2af52-8690-4324-9ffc-05b654476041-kube-api-access-bkhql\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:37.917843 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.917746 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:37.933424 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:37.933385 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:38.018641 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.018605 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.018641 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.018643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.018885 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.018696 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3c2af52-8690-4324-9ffc-05b654476041-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.018885 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.018713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.018885 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.018739 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3c2af52-8690-4324-9ffc-05b654476041-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.018885 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.018776 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.018885 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.018791 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3c2af52-8690-4324-9ffc-05b654476041-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.018885 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.018819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkhql\" (UniqueName: \"kubernetes.io/projected/c3c2af52-8690-4324-9ffc-05b654476041-kube-api-access-bkhql\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.019163 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.019099 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.019163 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.019133 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.019276 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.019157 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.019276 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.019251 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.019470 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.019445 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.019607 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.019587 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3c2af52-8690-4324-9ffc-05b654476041-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.021183 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.021161 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3c2af52-8690-4324-9ffc-05b654476041-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.021371 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.021349 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3c2af52-8690-4324-9ffc-05b654476041-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.033357 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.033325 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkhql\" (UniqueName: \"kubernetes.io/projected/c3c2af52-8690-4324-9ffc-05b654476041-kube-api-access-bkhql\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.033357 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.033324 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3c2af52-8690-4324-9ffc-05b654476041-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jgpdj\" (UID: \"c3c2af52-8690-4324-9ffc-05b654476041\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.117869 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.117775 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:38.270148 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.270114 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj"] Jul 01 22:19:38.275857 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:19:38.275827 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c2af52_8690_4324_9ffc_05b654476041.slice/crio-67ca1f19a88ccabacb5173d25c9046c7008d3eecdbd96aad5d4d4fa07ba02905 WatchSource:0}: Error finding container 67ca1f19a88ccabacb5173d25c9046c7008d3eecdbd96aad5d4d4fa07ba02905: Status 404 returned error can't find the container with id 67ca1f19a88ccabacb5173d25c9046c7008d3eecdbd96aad5d4d4fa07ba02905 Jul 01 22:19:38.277837 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.277805 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 22:19:38.277903 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.277870 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 22:19:38.277903 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.277898 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 22:19:38.921058 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.921021 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" event={"ID":"c3c2af52-8690-4324-9ffc-05b654476041","Type":"ContainerStarted","Data":"0b6a6733c5cc4e70dcaf97a245039abcf1795159792ad03c6a72deeb8a34ba2f"} Jul 01 22:19:38.921440 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.921086 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" event={"ID":"c3c2af52-8690-4324-9ffc-05b654476041","Type":"ContainerStarted","Data":"67ca1f19a88ccabacb5173d25c9046c7008d3eecdbd96aad5d4d4fa07ba02905"} Jul 01 22:19:38.946098 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:38.946042 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" podStartSLOduration=1.946024067 podStartE2EDuration="1.946024067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:19:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:19:38.944648394 +0000 UTC m=+482.031925878" watchObservedRunningTime="2026-07-01 22:19:38.946024067 +0000 UTC m=+482.033301550" Jul 01 22:19:39.118128 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:39.118097 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:39.123346 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:39.123318 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:39.932077 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:39.932047 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:39.933099 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:39.933078 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:19:40.182378 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.182292 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkmt4"] Jul 01 22:19:40.187134 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.187113 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" Jul 01 22:19:40.188757 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.188714 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:40.190386 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.190368 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 22:19:40.190885 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.190870 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4tqfg\"" Jul 01 22:19:40.202961 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.202932 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkmt4"] Jul 01 22:19:40.272697 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.272643 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkmt4"] Jul 01 22:19:40.294748 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.294710 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:40.339292 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.339253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/400e8653-54f3-46da-a278-f0f9abb2686e-config-file\") pod \"limitador-limitador-64c94fd64f-tkmt4\" (UID: \"400e8653-54f3-46da-a278-f0f9abb2686e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" Jul 01 22:19:40.339477 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.339300 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gwmp\" (UniqueName: \"kubernetes.io/projected/400e8653-54f3-46da-a278-f0f9abb2686e-kube-api-access-6gwmp\") pod \"limitador-limitador-64c94fd64f-tkmt4\" (UID: \"400e8653-54f3-46da-a278-f0f9abb2686e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" Jul 01 22:19:40.397305 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.397270 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:40.440282 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.440176 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/400e8653-54f3-46da-a278-f0f9abb2686e-config-file\") pod \"limitador-limitador-64c94fd64f-tkmt4\" (UID: \"400e8653-54f3-46da-a278-f0f9abb2686e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" Jul 01 22:19:40.440282 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.440228 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gwmp\" (UniqueName: \"kubernetes.io/projected/400e8653-54f3-46da-a278-f0f9abb2686e-kube-api-access-6gwmp\") pod \"limitador-limitador-64c94fd64f-tkmt4\" (UID: \"400e8653-54f3-46da-a278-f0f9abb2686e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" Jul 01 22:19:40.440922 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.440899 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/400e8653-54f3-46da-a278-f0f9abb2686e-config-file\") pod \"limitador-limitador-64c94fd64f-tkmt4\" (UID: \"400e8653-54f3-46da-a278-f0f9abb2686e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" Jul 01 22:19:40.452319 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.452292 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gwmp\" (UniqueName: \"kubernetes.io/projected/400e8653-54f3-46da-a278-f0f9abb2686e-kube-api-access-6gwmp\") pod \"limitador-limitador-64c94fd64f-tkmt4\" (UID: \"400e8653-54f3-46da-a278-f0f9abb2686e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" Jul 01 22:19:40.498464 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.498433 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" Jul 01 22:19:40.501328 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.501299 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:40.607147 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.607107 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:40.660715 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.660685 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkmt4"] Jul 01 22:19:40.662011 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:19:40.661987 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400e8653_54f3_46da_a278_f0f9abb2686e.slice/crio-dbfd6fb0335f95ef4c36ae2e983b1df9187bf1186af39f398c2b56c2372b982c WatchSource:0}: Error finding container dbfd6fb0335f95ef4c36ae2e983b1df9187bf1186af39f398c2b56c2372b982c: Status 404 returned error can't find the container with id dbfd6fb0335f95ef4c36ae2e983b1df9187bf1186af39f398c2b56c2372b982c Jul 01 22:19:40.938096 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:40.938055 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" event={"ID":"400e8653-54f3-46da-a278-f0f9abb2686e","Type":"ContainerStarted","Data":"dbfd6fb0335f95ef4c36ae2e983b1df9187bf1186af39f398c2b56c2372b982c"} Jul 01 22:19:41.184249 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:41.184213 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-qgkkr"] Jul 01 22:19:41.187945 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:41.187923 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qgkkr" Jul 01 22:19:41.191554 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:41.191490 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7bzlt\"" Jul 01 22:19:41.216459 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:41.216424 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qgkkr"] Jul 01 22:19:41.234350 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:41.234305 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:41.245125 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:41.245097 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg4sc\" (UniqueName: \"kubernetes.io/projected/49241790-97b2-42b2-8e8f-b0c88f444bcf-kube-api-access-jg4sc\") pod \"authorino-58cd955675-qgkkr\" (UID: \"49241790-97b2-42b2-8e8f-b0c88f444bcf\") " pod="kuadrant-system/authorino-58cd955675-qgkkr" Jul 01 22:19:41.331966 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:41.331918 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:41.346167 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:41.346101 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg4sc\" (UniqueName: \"kubernetes.io/projected/49241790-97b2-42b2-8e8f-b0c88f444bcf-kube-api-access-jg4sc\") pod \"authorino-58cd955675-qgkkr\" (UID: \"49241790-97b2-42b2-8e8f-b0c88f444bcf\") " pod="kuadrant-system/authorino-58cd955675-qgkkr" Jul 01 22:19:41.363298 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:41.363270 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg4sc\" (UniqueName: \"kubernetes.io/projected/49241790-97b2-42b2-8e8f-b0c88f444bcf-kube-api-access-jg4sc\") pod \"authorino-58cd955675-qgkkr\" (UID: \"49241790-97b2-42b2-8e8f-b0c88f444bcf\") " pod="kuadrant-system/authorino-58cd955675-qgkkr" Jul 01 22:19:41.497474 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:41.497388 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qgkkr" Jul 01 22:19:41.712329 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:41.711928 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qgkkr"] Jul 01 22:19:41.716820 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:19:41.715693 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49241790_97b2_42b2_8e8f_b0c88f444bcf.slice/crio-e72c7d94da3427b8edb0ede162861c2386e9420b64bdea9938c3ed341868cc47 WatchSource:0}: Error finding container e72c7d94da3427b8edb0ede162861c2386e9420b64bdea9938c3ed341868cc47: Status 404 returned error can't find the container with id e72c7d94da3427b8edb0ede162861c2386e9420b64bdea9938c3ed341868cc47 Jul 01 22:19:41.944451 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:41.944410 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qgkkr" event={"ID":"49241790-97b2-42b2-8e8f-b0c88f444bcf","Type":"ContainerStarted","Data":"e72c7d94da3427b8edb0ede162861c2386e9420b64bdea9938c3ed341868cc47"} Jul 01 22:19:42.925155 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:42.925028 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:42.999790 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:42.999755 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:43.958965 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:43.958925 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" event={"ID":"400e8653-54f3-46da-a278-f0f9abb2686e","Type":"ContainerStarted","Data":"affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093"} Jul 01 22:19:43.959534 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:43.959467 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" Jul 01 22:19:43.981487 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:43.981425 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" podStartSLOduration=1.12732208 podStartE2EDuration="3.981403184s" totalImagesPullingTime="2.854081104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:19:43.979174742 +0000 UTC m=+487.066452226" watchObservedRunningTime="2026-07-01 22:19:43.981403184 +0000 UTC m=+487.068680670" Jul 01 22:19:45.575430 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:45.575385 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qgkkr"] Jul 01 22:19:45.971194 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:45.971158 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qgkkr" event={"ID":"49241790-97b2-42b2-8e8f-b0c88f444bcf","Type":"ContainerStarted","Data":"4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02"} Jul 01 22:19:46.003101 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:46.003049 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-qgkkr" podStartSLOduration=1.290748553 podStartE2EDuration="5.003033384s" totalImagesPullingTime="3.712284831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:19:46.000221793 +0000 UTC m=+489.087499297" watchObservedRunningTime="2026-07-01 22:19:46.003033384 +0000 UTC m=+489.090310869" Jul 01 22:19:46.976401 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:46.976351 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-qgkkr" podUID="49241790-97b2-42b2-8e8f-b0c88f444bcf" containerName="authorino" containerID="cri-o://4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02" gracePeriod=30 Jul 01 22:19:47.225872 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.225848 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qgkkr" Jul 01 22:19:47.297710 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.297615 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg4sc\" (UniqueName: \"kubernetes.io/projected/49241790-97b2-42b2-8e8f-b0c88f444bcf-kube-api-access-jg4sc\") pod \"49241790-97b2-42b2-8e8f-b0c88f444bcf\" (UID: \"49241790-97b2-42b2-8e8f-b0c88f444bcf\") " Jul 01 22:19:47.299706 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.299669 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49241790-97b2-42b2-8e8f-b0c88f444bcf-kube-api-access-jg4sc" (OuterVolumeSpecName: "kube-api-access-jg4sc") pod "49241790-97b2-42b2-8e8f-b0c88f444bcf" (UID: "49241790-97b2-42b2-8e8f-b0c88f444bcf"). InnerVolumeSpecName "kube-api-access-jg4sc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:19:47.398968 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.398932 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg4sc\" (UniqueName: \"kubernetes.io/projected/49241790-97b2-42b2-8e8f-b0c88f444bcf-kube-api-access-jg4sc\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:19:47.657387 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.657269 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:47.748888 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.748839 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:47.982333 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.982297 2568 generic.go:356] "Generic (PLEG): container finished" podID="49241790-97b2-42b2-8e8f-b0c88f444bcf" containerID="4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02" exitCode=0 Jul 01 22:19:47.982779 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.982340 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qgkkr" Jul 01 22:19:47.982779 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.982339 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qgkkr" event={"ID":"49241790-97b2-42b2-8e8f-b0c88f444bcf","Type":"ContainerDied","Data":"4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02"} Jul 01 22:19:47.982779 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.982466 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qgkkr" event={"ID":"49241790-97b2-42b2-8e8f-b0c88f444bcf","Type":"ContainerDied","Data":"e72c7d94da3427b8edb0ede162861c2386e9420b64bdea9938c3ed341868cc47"} Jul 01 22:19:47.982779 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.982491 2568 scope.go:117] "RemoveContainer" containerID="4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02" Jul 01 22:19:47.991749 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.991727 2568 scope.go:117] "RemoveContainer" containerID="4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02" Jul 01 22:19:47.992025 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:47.992002 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02\": container with ID starting with 4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02 not found: ID does not exist" containerID="4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02" Jul 01 22:19:47.992081 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:47.992036 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02"} err="failed to get container status \"4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02\": rpc error: code = NotFound desc = could not find container \"4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02\": container with ID starting with 4bad0225a82f0d727001ea507542aeee78e475c3309284c43707cac47976be02 not found: ID does not exist" Jul 01 22:19:48.005934 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:48.005903 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qgkkr"] Jul 01 22:19:48.008857 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:48.008824 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-qgkkr"] Jul 01 22:19:48.564395 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:48.564361 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49241790-97b2-42b2-8e8f-b0c88f444bcf" path="/var/lib/kubelet/pods/49241790-97b2-42b2-8e8f-b0c88f444bcf/volumes" Jul 01 22:19:54.816974 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:54.816939 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkmt4"] Jul 01 22:19:54.817414 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:54.817132 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" podUID="400e8653-54f3-46da-a278-f0f9abb2686e" containerName="limitador" containerID="cri-o://affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093" gracePeriod=30 Jul 01 22:19:54.817882 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:54.817862 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" Jul 01 22:19:55.371006 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:55.370976 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" Jul 01 22:19:55.469279 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:55.469249 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gwmp\" (UniqueName: \"kubernetes.io/projected/400e8653-54f3-46da-a278-f0f9abb2686e-kube-api-access-6gwmp\") pod \"400e8653-54f3-46da-a278-f0f9abb2686e\" (UID: \"400e8653-54f3-46da-a278-f0f9abb2686e\") " Jul 01 22:19:55.469523 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:55.469292 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/400e8653-54f3-46da-a278-f0f9abb2686e-config-file\") pod \"400e8653-54f3-46da-a278-f0f9abb2686e\" (UID: \"400e8653-54f3-46da-a278-f0f9abb2686e\") " Jul 01 22:19:55.469745 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:55.469681 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/400e8653-54f3-46da-a278-f0f9abb2686e-config-file" (OuterVolumeSpecName: "config-file") pod "400e8653-54f3-46da-a278-f0f9abb2686e" (UID: "400e8653-54f3-46da-a278-f0f9abb2686e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:19:55.471372 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:55.471350 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/400e8653-54f3-46da-a278-f0f9abb2686e-kube-api-access-6gwmp" (OuterVolumeSpecName: "kube-api-access-6gwmp") pod "400e8653-54f3-46da-a278-f0f9abb2686e" (UID: "400e8653-54f3-46da-a278-f0f9abb2686e"). InnerVolumeSpecName "kube-api-access-6gwmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:19:55.570917 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:55.570871 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gwmp\" (UniqueName: \"kubernetes.io/projected/400e8653-54f3-46da-a278-f0f9abb2686e-kube-api-access-6gwmp\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:19:55.570917 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:55.570909 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/400e8653-54f3-46da-a278-f0f9abb2686e-config-file\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:19:56.022038 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.022004 2568 generic.go:356] "Generic (PLEG): container finished" podID="400e8653-54f3-46da-a278-f0f9abb2686e" containerID="affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093" exitCode=0 Jul 01 22:19:56.022443 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.022050 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" Jul 01 22:19:56.022443 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.022094 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" event={"ID":"400e8653-54f3-46da-a278-f0f9abb2686e","Type":"ContainerDied","Data":"affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093"} Jul 01 22:19:56.022443 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.022148 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkmt4" event={"ID":"400e8653-54f3-46da-a278-f0f9abb2686e","Type":"ContainerDied","Data":"dbfd6fb0335f95ef4c36ae2e983b1df9187bf1186af39f398c2b56c2372b982c"} Jul 01 22:19:56.022443 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.022171 2568 scope.go:117] "RemoveContainer" containerID="affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093" Jul 01 22:19:56.030996 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.030977 2568 scope.go:117] "RemoveContainer" containerID="affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093" Jul 01 22:19:56.031276 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:19:56.031255 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093\": container with ID starting with affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093 not found: ID does not exist" containerID="affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093" Jul 01 22:19:56.031329 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.031286 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093"} err="failed to get container status \"affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093\": rpc error: code = NotFound desc = could not find container \"affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093\": container with ID starting with affe318469002129900d1584984169c8826c5a34fac00402b9664c46f50c7093 not found: ID does not exist" Jul 01 22:19:56.045172 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.045146 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkmt4"] Jul 01 22:19:56.050611 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.050587 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkmt4"] Jul 01 22:19:56.433193 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.433152 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-s6qs6"] Jul 01 22:19:56.433528 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.433514 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49241790-97b2-42b2-8e8f-b0c88f444bcf" containerName="authorino" Jul 01 22:19:56.433576 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.433531 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="49241790-97b2-42b2-8e8f-b0c88f444bcf" containerName="authorino" Jul 01 22:19:56.433576 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.433558 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="400e8653-54f3-46da-a278-f0f9abb2686e" containerName="limitador" Jul 01 22:19:56.433576 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.433568 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="400e8653-54f3-46da-a278-f0f9abb2686e" containerName="limitador" Jul 01 22:19:56.433689 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.433681 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="400e8653-54f3-46da-a278-f0f9abb2686e" containerName="limitador" Jul 01 22:19:56.433751 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.433694 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="49241790-97b2-42b2-8e8f-b0c88f444bcf" containerName="authorino" Jul 01 22:19:56.438017 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.437996 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-s6qs6" Jul 01 22:19:56.440876 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.440839 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 01 22:19:56.440998 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.440919 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ncpjj\"" Jul 01 22:19:56.447950 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.447925 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-s6qs6"] Jul 01 22:19:56.480860 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.480815 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f45d23ed-6f88-4edd-ab5d-e518ba9b1a29-data\") pod \"postgres-69fb4594cf-s6qs6\" (UID: \"f45d23ed-6f88-4edd-ab5d-e518ba9b1a29\") " pod="opendatahub/postgres-69fb4594cf-s6qs6" Jul 01 22:19:56.481039 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.480870 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtxg9\" (UniqueName: \"kubernetes.io/projected/f45d23ed-6f88-4edd-ab5d-e518ba9b1a29-kube-api-access-gtxg9\") pod \"postgres-69fb4594cf-s6qs6\" (UID: \"f45d23ed-6f88-4edd-ab5d-e518ba9b1a29\") " pod="opendatahub/postgres-69fb4594cf-s6qs6" Jul 01 22:19:56.484128 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.484102 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:19:56.564063 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.564028 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="400e8653-54f3-46da-a278-f0f9abb2686e" path="/var/lib/kubelet/pods/400e8653-54f3-46da-a278-f0f9abb2686e/volumes" Jul 01 22:19:56.581348 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.581307 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtxg9\" (UniqueName: \"kubernetes.io/projected/f45d23ed-6f88-4edd-ab5d-e518ba9b1a29-kube-api-access-gtxg9\") pod \"postgres-69fb4594cf-s6qs6\" (UID: \"f45d23ed-6f88-4edd-ab5d-e518ba9b1a29\") " pod="opendatahub/postgres-69fb4594cf-s6qs6" Jul 01 22:19:56.581520 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.581400 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f45d23ed-6f88-4edd-ab5d-e518ba9b1a29-data\") pod \"postgres-69fb4594cf-s6qs6\" (UID: \"f45d23ed-6f88-4edd-ab5d-e518ba9b1a29\") " pod="opendatahub/postgres-69fb4594cf-s6qs6" Jul 01 22:19:56.581783 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.581765 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f45d23ed-6f88-4edd-ab5d-e518ba9b1a29-data\") pod \"postgres-69fb4594cf-s6qs6\" (UID: \"f45d23ed-6f88-4edd-ab5d-e518ba9b1a29\") " pod="opendatahub/postgres-69fb4594cf-s6qs6" Jul 01 22:19:56.591325 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.591294 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtxg9\" (UniqueName: \"kubernetes.io/projected/f45d23ed-6f88-4edd-ab5d-e518ba9b1a29-kube-api-access-gtxg9\") pod \"postgres-69fb4594cf-s6qs6\" (UID: \"f45d23ed-6f88-4edd-ab5d-e518ba9b1a29\") " pod="opendatahub/postgres-69fb4594cf-s6qs6" Jul 01 22:19:56.748292 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.748204 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-s6qs6" Jul 01 22:19:56.913970 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:56.913937 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-s6qs6"] Jul 01 22:19:56.915498 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:19:56.915474 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45d23ed_6f88_4edd_ab5d_e518ba9b1a29.slice/crio-a28e40f265b2103c2fa7b061b96bd02bcf58e9543ef02beaa0a4ef487c4e757e WatchSource:0}: Error finding container a28e40f265b2103c2fa7b061b96bd02bcf58e9543ef02beaa0a4ef487c4e757e: Status 404 returned error can't find the container with id a28e40f265b2103c2fa7b061b96bd02bcf58e9543ef02beaa0a4ef487c4e757e Jul 01 22:19:57.030088 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:19:57.030005 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-s6qs6" event={"ID":"f45d23ed-6f88-4edd-ab5d-e518ba9b1a29","Type":"ContainerStarted","Data":"a28e40f265b2103c2fa7b061b96bd02bcf58e9543ef02beaa0a4ef487c4e757e"} Jul 01 22:20:03.061293 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:03.061258 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-s6qs6" event={"ID":"f45d23ed-6f88-4edd-ab5d-e518ba9b1a29","Type":"ContainerStarted","Data":"ab266ad74f1638b8a10a293f1823cd20bf8901524130e936732b387cc912fcc6"} Jul 01 22:20:03.061703 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:03.061380 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-s6qs6" Jul 01 22:20:03.085160 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:03.085109 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-s6qs6" podStartSLOduration=1.7809926950000001 podStartE2EDuration="7.085092361s" totalImagesPullingTime="5.304099666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:20:03.082098629 +0000 UTC m=+506.169376112" watchObservedRunningTime="2026-07-01 22:20:03.085092361 +0000 UTC m=+506.172369845" Jul 01 22:20:09.096634 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:09.096601 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-s6qs6" Jul 01 22:20:09.458471 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:09.458432 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:20:09.641152 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:09.641112 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:20:09.793161 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:09.793069 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:20:19.434276 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:19.434235 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-nbdf7"] Jul 01 22:20:19.464277 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:19.464247 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-nbdf7"] Jul 01 22:20:19.464453 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:19.464344 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-nbdf7" Jul 01 22:20:19.467639 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:19.467603 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 22:20:19.467843 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:19.467603 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 22:20:19.468943 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:19.468924 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-q8zrj\"" Jul 01 22:20:19.593142 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:19.593102 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj4sn\" (UniqueName: \"kubernetes.io/projected/b6955f74-9816-44c1-bc9b-28a4952bbfd3-kube-api-access-vj4sn\") pod \"keycloak-operator-d8b9d7b4d-nbdf7\" (UID: \"b6955f74-9816-44c1-bc9b-28a4952bbfd3\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-nbdf7" Jul 01 22:20:19.694381 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:19.694293 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj4sn\" (UniqueName: \"kubernetes.io/projected/b6955f74-9816-44c1-bc9b-28a4952bbfd3-kube-api-access-vj4sn\") pod \"keycloak-operator-d8b9d7b4d-nbdf7\" (UID: \"b6955f74-9816-44c1-bc9b-28a4952bbfd3\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-nbdf7" Jul 01 22:20:19.711092 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:19.711059 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj4sn\" (UniqueName: \"kubernetes.io/projected/b6955f74-9816-44c1-bc9b-28a4952bbfd3-kube-api-access-vj4sn\") pod \"keycloak-operator-d8b9d7b4d-nbdf7\" (UID: \"b6955f74-9816-44c1-bc9b-28a4952bbfd3\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-nbdf7" Jul 01 22:20:19.774854 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:19.774809 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-nbdf7" Jul 01 22:20:19.919477 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:19.919450 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-nbdf7"] Jul 01 22:20:19.922188 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:20:19.922158 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6955f74_9816_44c1_bc9b_28a4952bbfd3.slice/crio-61c94c7eb714128f948d106ec6dc692297f7f8d5a67599c2d3d0fd61d2b3a71b WatchSource:0}: Error finding container 61c94c7eb714128f948d106ec6dc692297f7f8d5a67599c2d3d0fd61d2b3a71b: Status 404 returned error can't find the container with id 61c94c7eb714128f948d106ec6dc692297f7f8d5a67599c2d3d0fd61d2b3a71b Jul 01 22:20:20.146607 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:20.146515 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-nbdf7" event={"ID":"b6955f74-9816-44c1-bc9b-28a4952bbfd3","Type":"ContainerStarted","Data":"61c94c7eb714128f948d106ec6dc692297f7f8d5a67599c2d3d0fd61d2b3a71b"} Jul 01 22:20:26.189629 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:26.189581 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-nbdf7" event={"ID":"b6955f74-9816-44c1-bc9b-28a4952bbfd3","Type":"ContainerStarted","Data":"216d0ea6e6122877b37856c80f9aed7d204c7e8e53608b856ae78349de175884"} Jul 01 22:20:26.211422 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:26.211370 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-nbdf7" podStartSLOduration=1.512039235 podStartE2EDuration="7.211354847s" totalImagesPullingTime="5.699315612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:20:26.209936468 +0000 UTC m=+529.297213956" watchObservedRunningTime="2026-07-01 22:20:26.211354847 +0000 UTC m=+529.298632330" Jul 01 22:20:34.541228 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:34.541136 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:20:34.642863 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:20:34.642826 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:04.042167 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.042126 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:04.289460 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.289420 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-29z4k"] Jul 01 22:21:04.293047 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.293004 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-29z4k" Jul 01 22:21:04.296215 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.296193 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7bzlt\"" Jul 01 22:21:04.306260 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.306230 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-29z4k"] Jul 01 22:21:04.388358 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.388324 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhb2n\" (UniqueName: \"kubernetes.io/projected/cf1b7f8a-1ff9-4532-be45-524aa57430bd-kube-api-access-vhb2n\") pod \"authorino-5d4b67c446-29z4k\" (UID: \"cf1b7f8a-1ff9-4532-be45-524aa57430bd\") " pod="kuadrant-system/authorino-5d4b67c446-29z4k" Jul 01 22:21:04.431806 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.431764 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:04.488971 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.488931 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhb2n\" (UniqueName: \"kubernetes.io/projected/cf1b7f8a-1ff9-4532-be45-524aa57430bd-kube-api-access-vhb2n\") pod \"authorino-5d4b67c446-29z4k\" (UID: \"cf1b7f8a-1ff9-4532-be45-524aa57430bd\") " pod="kuadrant-system/authorino-5d4b67c446-29z4k" Jul 01 22:21:04.498083 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.498058 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhb2n\" (UniqueName: \"kubernetes.io/projected/cf1b7f8a-1ff9-4532-be45-524aa57430bd-kube-api-access-vhb2n\") pod \"authorino-5d4b67c446-29z4k\" (UID: \"cf1b7f8a-1ff9-4532-be45-524aa57430bd\") " pod="kuadrant-system/authorino-5d4b67c446-29z4k" Jul 01 22:21:04.511889 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.511859 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-29z4k"] Jul 01 22:21:04.512171 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.512160 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-29z4k" Jul 01 22:21:04.547315 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.547241 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b885584c4-rfpsv"] Jul 01 22:21:04.550926 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.550907 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b885584c4-rfpsv" Jul 01 22:21:04.567234 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.567207 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b885584c4-rfpsv"] Jul 01 22:21:04.658725 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.658687 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-29z4k"] Jul 01 22:21:04.662396 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:21:04.662363 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf1b7f8a_1ff9_4532_be45_524aa57430bd.slice/crio-7a2da725c5b8a724aae6f1d25efef89e0499a17130edcc7d4b87fcc545d4dc28 WatchSource:0}: Error finding container 7a2da725c5b8a724aae6f1d25efef89e0499a17130edcc7d4b87fcc545d4dc28: Status 404 returned error can't find the container with id 7a2da725c5b8a724aae6f1d25efef89e0499a17130edcc7d4b87fcc545d4dc28 Jul 01 22:21:04.690214 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.690183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5fpj\" (UniqueName: \"kubernetes.io/projected/0155d0ab-d800-4b75-ad71-a56e077f9b95-kube-api-access-w5fpj\") pod \"authorino-5b885584c4-rfpsv\" (UID: \"0155d0ab-d800-4b75-ad71-a56e077f9b95\") " pod="kuadrant-system/authorino-5b885584c4-rfpsv" Jul 01 22:21:04.790672 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.790632 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5fpj\" (UniqueName: \"kubernetes.io/projected/0155d0ab-d800-4b75-ad71-a56e077f9b95-kube-api-access-w5fpj\") pod \"authorino-5b885584c4-rfpsv\" (UID: \"0155d0ab-d800-4b75-ad71-a56e077f9b95\") " pod="kuadrant-system/authorino-5b885584c4-rfpsv" Jul 01 22:21:04.803878 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.803806 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5fpj\" (UniqueName: \"kubernetes.io/projected/0155d0ab-d800-4b75-ad71-a56e077f9b95-kube-api-access-w5fpj\") pod \"authorino-5b885584c4-rfpsv\" (UID: \"0155d0ab-d800-4b75-ad71-a56e077f9b95\") " pod="kuadrant-system/authorino-5b885584c4-rfpsv" Jul 01 22:21:04.863795 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.863760 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b885584c4-rfpsv" Jul 01 22:21:04.871644 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.871616 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b885584c4-rfpsv"] Jul 01 22:21:04.904479 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.904443 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d5446866b-bsp5v"] Jul 01 22:21:04.908241 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.908215 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d5446866b-bsp5v" Jul 01 22:21:04.911197 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.911170 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 01 22:21:04.920990 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.920953 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d5446866b-bsp5v"] Jul 01 22:21:04.993337 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.993309 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v667f\" (UniqueName: \"kubernetes.io/projected/d3e62efc-c5c6-4052-ace9-8d51d70abf26-kube-api-access-v667f\") pod \"authorino-5d5446866b-bsp5v\" (UID: \"d3e62efc-c5c6-4052-ace9-8d51d70abf26\") " pod="kuadrant-system/authorino-5d5446866b-bsp5v" Jul 01 22:21:04.993464 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:04.993351 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3e62efc-c5c6-4052-ace9-8d51d70abf26-tls-cert\") pod \"authorino-5d5446866b-bsp5v\" (UID: \"d3e62efc-c5c6-4052-ace9-8d51d70abf26\") " pod="kuadrant-system/authorino-5d5446866b-bsp5v" Jul 01 22:21:05.006643 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.006616 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b885584c4-rfpsv"] Jul 01 22:21:05.009161 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:21:05.009133 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0155d0ab_d800_4b75_ad71_a56e077f9b95.slice/crio-5a18c4ca01c96656ea4fc4b13612d484d22a054f4aa250569ae6ce40b3abdf00 WatchSource:0}: Error finding container 5a18c4ca01c96656ea4fc4b13612d484d22a054f4aa250569ae6ce40b3abdf00: Status 404 returned error can't find the container with id 5a18c4ca01c96656ea4fc4b13612d484d22a054f4aa250569ae6ce40b3abdf00 Jul 01 22:21:05.094918 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.094829 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3e62efc-c5c6-4052-ace9-8d51d70abf26-tls-cert\") pod \"authorino-5d5446866b-bsp5v\" (UID: \"d3e62efc-c5c6-4052-ace9-8d51d70abf26\") " pod="kuadrant-system/authorino-5d5446866b-bsp5v" Jul 01 22:21:05.095368 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.094991 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v667f\" (UniqueName: \"kubernetes.io/projected/d3e62efc-c5c6-4052-ace9-8d51d70abf26-kube-api-access-v667f\") pod \"authorino-5d5446866b-bsp5v\" (UID: \"d3e62efc-c5c6-4052-ace9-8d51d70abf26\") " pod="kuadrant-system/authorino-5d5446866b-bsp5v" Jul 01 22:21:05.097406 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.097384 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3e62efc-c5c6-4052-ace9-8d51d70abf26-tls-cert\") pod \"authorino-5d5446866b-bsp5v\" (UID: \"d3e62efc-c5c6-4052-ace9-8d51d70abf26\") " pod="kuadrant-system/authorino-5d5446866b-bsp5v" Jul 01 22:21:05.105404 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.105375 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v667f\" (UniqueName: \"kubernetes.io/projected/d3e62efc-c5c6-4052-ace9-8d51d70abf26-kube-api-access-v667f\") pod \"authorino-5d5446866b-bsp5v\" (UID: \"d3e62efc-c5c6-4052-ace9-8d51d70abf26\") " pod="kuadrant-system/authorino-5d5446866b-bsp5v" Jul 01 22:21:05.226440 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.226408 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d5446866b-bsp5v" Jul 01 22:21:05.368293 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.368265 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d5446866b-bsp5v"] Jul 01 22:21:05.370401 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:21:05.370361 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3e62efc_c5c6_4052_ace9_8d51d70abf26.slice/crio-49313509b43d3a63cc1f2587dcc3ce2b9654e6d6cccf744f59664d51ce4a7e8c WatchSource:0}: Error finding container 49313509b43d3a63cc1f2587dcc3ce2b9654e6d6cccf744f59664d51ce4a7e8c: Status 404 returned error can't find the container with id 49313509b43d3a63cc1f2587dcc3ce2b9654e6d6cccf744f59664d51ce4a7e8c Jul 01 22:21:05.387497 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.387468 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b885584c4-rfpsv" event={"ID":"0155d0ab-d800-4b75-ad71-a56e077f9b95","Type":"ContainerStarted","Data":"5a18c4ca01c96656ea4fc4b13612d484d22a054f4aa250569ae6ce40b3abdf00"} Jul 01 22:21:05.388560 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.388534 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d5446866b-bsp5v" event={"ID":"d3e62efc-c5c6-4052-ace9-8d51d70abf26","Type":"ContainerStarted","Data":"49313509b43d3a63cc1f2587dcc3ce2b9654e6d6cccf744f59664d51ce4a7e8c"} Jul 01 22:21:05.389986 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.389968 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-29z4k" event={"ID":"cf1b7f8a-1ff9-4532-be45-524aa57430bd","Type":"ContainerStarted","Data":"90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9"} Jul 01 22:21:05.390060 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.389994 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-29z4k" event={"ID":"cf1b7f8a-1ff9-4532-be45-524aa57430bd","Type":"ContainerStarted","Data":"7a2da725c5b8a724aae6f1d25efef89e0499a17130edcc7d4b87fcc545d4dc28"} Jul 01 22:21:05.390117 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.390053 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-29z4k" podUID="cf1b7f8a-1ff9-4532-be45-524aa57430bd" containerName="authorino" containerID="cri-o://90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9" gracePeriod=30 Jul 01 22:21:05.407369 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.407326 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-29z4k" podStartSLOduration=1.101827548 podStartE2EDuration="1.40731096s" totalImagesPullingTime="305.483412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:21:05.406848168 +0000 UTC m=+568.494125654" watchObservedRunningTime="2026-07-01 22:21:05.40731096 +0000 UTC m=+568.494588445" Jul 01 22:21:05.649270 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.649241 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-29z4k" Jul 01 22:21:05.800374 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.800337 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhb2n\" (UniqueName: \"kubernetes.io/projected/cf1b7f8a-1ff9-4532-be45-524aa57430bd-kube-api-access-vhb2n\") pod \"cf1b7f8a-1ff9-4532-be45-524aa57430bd\" (UID: \"cf1b7f8a-1ff9-4532-be45-524aa57430bd\") " Jul 01 22:21:05.802481 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.802454 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1b7f8a-1ff9-4532-be45-524aa57430bd-kube-api-access-vhb2n" (OuterVolumeSpecName: "kube-api-access-vhb2n") pod "cf1b7f8a-1ff9-4532-be45-524aa57430bd" (UID: "cf1b7f8a-1ff9-4532-be45-524aa57430bd"). InnerVolumeSpecName "kube-api-access-vhb2n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:21:05.901497 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:05.901472 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhb2n\" (UniqueName: \"kubernetes.io/projected/cf1b7f8a-1ff9-4532-be45-524aa57430bd-kube-api-access-vhb2n\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:21:06.396766 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.396721 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b885584c4-rfpsv" event={"ID":"0155d0ab-d800-4b75-ad71-a56e077f9b95","Type":"ContainerStarted","Data":"5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b"} Jul 01 22:21:06.397224 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.396773 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5b885584c4-rfpsv" podUID="0155d0ab-d800-4b75-ad71-a56e077f9b95" containerName="authorino" containerID="cri-o://5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b" gracePeriod=30 Jul 01 22:21:06.398289 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.398264 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d5446866b-bsp5v" event={"ID":"d3e62efc-c5c6-4052-ace9-8d51d70abf26","Type":"ContainerStarted","Data":"daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118"} Jul 01 22:21:06.399731 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.399704 2568 generic.go:356] "Generic (PLEG): container finished" podID="cf1b7f8a-1ff9-4532-be45-524aa57430bd" containerID="90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9" exitCode=0 Jul 01 22:21:06.399815 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.399763 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-29z4k" event={"ID":"cf1b7f8a-1ff9-4532-be45-524aa57430bd","Type":"ContainerDied","Data":"90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9"} Jul 01 22:21:06.399815 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.399793 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-29z4k" event={"ID":"cf1b7f8a-1ff9-4532-be45-524aa57430bd","Type":"ContainerDied","Data":"7a2da725c5b8a724aae6f1d25efef89e0499a17130edcc7d4b87fcc545d4dc28"} Jul 01 22:21:06.399893 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.399821 2568 scope.go:117] "RemoveContainer" containerID="90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9" Jul 01 22:21:06.399953 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.399941 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-29z4k" Jul 01 22:21:06.409643 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.409622 2568 scope.go:117] "RemoveContainer" containerID="90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9" Jul 01 22:21:06.409966 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:21:06.409946 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9\": container with ID starting with 90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9 not found: ID does not exist" containerID="90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9" Jul 01 22:21:06.410034 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.409972 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9"} err="failed to get container status \"90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9\": rpc error: code = NotFound desc = could not find container \"90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9\": container with ID starting with 90a3582a2b4cd87e45e05941348d25e5e596438ffc0ae058ddf3763fd51415e9 not found: ID does not exist" Jul 01 22:21:06.414620 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.414565 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b885584c4-rfpsv" podStartSLOduration=2.039579431 podStartE2EDuration="2.414551395s" totalImagesPullingTime="374.971964ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:21:06.412565562 +0000 UTC m=+569.499843051" watchObservedRunningTime="2026-07-01 22:21:06.414551395 +0000 UTC m=+569.501828904" Jul 01 22:21:06.435475 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.435424 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d5446866b-bsp5v" podStartSLOduration=1.9332266599999999 podStartE2EDuration="2.435409086s" totalImagesPullingTime="502.182426ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:21:06.434510202 +0000 UTC m=+569.521787686" watchObservedRunningTime="2026-07-01 22:21:06.435409086 +0000 UTC m=+569.522686602" Jul 01 22:21:06.478772 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.478737 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-29z4k"] Jul 01 22:21:06.482300 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.482270 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-29z4k"] Jul 01 22:21:06.565264 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.565229 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf1b7f8a-1ff9-4532-be45-524aa57430bd" path="/var/lib/kubelet/pods/cf1b7f8a-1ff9-4532-be45-524aa57430bd/volumes" Jul 01 22:21:06.664619 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.664594 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b885584c4-rfpsv" Jul 01 22:21:06.808182 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.808156 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5fpj\" (UniqueName: \"kubernetes.io/projected/0155d0ab-d800-4b75-ad71-a56e077f9b95-kube-api-access-w5fpj\") pod \"0155d0ab-d800-4b75-ad71-a56e077f9b95\" (UID: \"0155d0ab-d800-4b75-ad71-a56e077f9b95\") " Jul 01 22:21:06.810106 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.810077 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0155d0ab-d800-4b75-ad71-a56e077f9b95-kube-api-access-w5fpj" (OuterVolumeSpecName: "kube-api-access-w5fpj") pod "0155d0ab-d800-4b75-ad71-a56e077f9b95" (UID: "0155d0ab-d800-4b75-ad71-a56e077f9b95"). InnerVolumeSpecName "kube-api-access-w5fpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:21:06.909538 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:06.909455 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5fpj\" (UniqueName: \"kubernetes.io/projected/0155d0ab-d800-4b75-ad71-a56e077f9b95-kube-api-access-w5fpj\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:21:07.405339 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:07.405302 2568 generic.go:356] "Generic (PLEG): container finished" podID="0155d0ab-d800-4b75-ad71-a56e077f9b95" containerID="5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b" exitCode=0 Jul 01 22:21:07.405794 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:07.405346 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b885584c4-rfpsv" Jul 01 22:21:07.405794 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:07.405388 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b885584c4-rfpsv" event={"ID":"0155d0ab-d800-4b75-ad71-a56e077f9b95","Type":"ContainerDied","Data":"5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b"} Jul 01 22:21:07.405794 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:07.405429 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b885584c4-rfpsv" event={"ID":"0155d0ab-d800-4b75-ad71-a56e077f9b95","Type":"ContainerDied","Data":"5a18c4ca01c96656ea4fc4b13612d484d22a054f4aa250569ae6ce40b3abdf00"} Jul 01 22:21:07.405794 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:07.405444 2568 scope.go:117] "RemoveContainer" containerID="5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b" Jul 01 22:21:07.419200 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:07.419177 2568 scope.go:117] "RemoveContainer" containerID="5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b" Jul 01 22:21:07.419504 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:21:07.419484 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b\": container with ID starting with 5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b not found: ID does not exist" containerID="5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b" Jul 01 22:21:07.419561 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:07.419511 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b"} err="failed to get container status \"5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b\": rpc error: code = NotFound desc = could not find container \"5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b\": container with ID starting with 5ca1db436dd31dee57bcd15ffb49c1e06cc85991f11884ae7b1b8b125439047b not found: ID does not exist" Jul 01 22:21:07.437556 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:07.437529 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b885584c4-rfpsv"] Jul 01 22:21:07.440372 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:07.440343 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b885584c4-rfpsv"] Jul 01 22:21:08.564058 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:08.564025 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0155d0ab-d800-4b75-ad71-a56e077f9b95" path="/var/lib/kubelet/pods/0155d0ab-d800-4b75-ad71-a56e077f9b95/volumes" Jul 01 22:21:08.752240 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:08.752210 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:10.907027 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:10.906958 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:11.008560 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:11.008513 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:11.106631 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:11.106596 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:11.501591 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:11.501555 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:14.904093 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:14.904057 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:14.995515 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:14.995473 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:38.377140 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:38.377107 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/1.log" Jul 01 22:21:38.377639 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:38.377231 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/1.log" Jul 01 22:21:45.677083 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:45.677049 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:46.262918 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:46.262880 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:46.403879 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:46.403834 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:46.775580 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:46.775544 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:46.874850 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:46.874811 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:21:54.639897 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:54.639860 2568 generic.go:356] "Generic (PLEG): container finished" podID="c3c2af52-8690-4324-9ffc-05b654476041" containerID="0b6a6733c5cc4e70dcaf97a245039abcf1795159792ad03c6a72deeb8a34ba2f" exitCode=0 Jul 01 22:21:54.640295 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:54.639937 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" event={"ID":"c3c2af52-8690-4324-9ffc-05b654476041","Type":"ContainerDied","Data":"0b6a6733c5cc4e70dcaf97a245039abcf1795159792ad03c6a72deeb8a34ba2f"} Jul 01 22:21:54.640406 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:54.640392 2568 scope.go:117] "RemoveContainer" containerID="0b6a6733c5cc4e70dcaf97a245039abcf1795159792ad03c6a72deeb8a34ba2f" Jul 01 22:21:54.641481 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:54.641454 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 22:21:54.641581 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:54.641523 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 22:21:54.641581 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:54.641556 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 22:21:54.932417 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:54.932382 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:21:55.647495 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:55.647457 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" event={"ID":"c3c2af52-8690-4324-9ffc-05b654476041","Type":"ContainerStarted","Data":"76c0302909f652e8f8b4c8c043669b4723efbc97e8f8863a2d3508115b74ddee"} Jul 01 22:21:56.118753 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:56.118709 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:21:56.119871 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:56.119842 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jgpdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 01 22:21:56.120007 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:56.119894 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" podUID="c3c2af52-8690-4324-9ffc-05b654476041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 01 22:21:57.119194 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:57.119154 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jgpdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 01 22:21:57.119599 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:57.119211 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" podUID="c3c2af52-8690-4324-9ffc-05b654476041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 01 22:21:58.118619 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:58.118575 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jgpdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 01 22:21:58.118830 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:58.118634 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" podUID="c3c2af52-8690-4324-9ffc-05b654476041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 01 22:21:59.118436 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:59.118345 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jgpdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 01 22:21:59.118436 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:21:59.118421 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" podUID="c3c2af52-8690-4324-9ffc-05b654476041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 01 22:22:00.122314 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:00.122279 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:22:00.122765 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:00.122616 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:22:00.123262 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:00.123245 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jgpdj" Jul 01 22:22:08.420542 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:08.420502 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:22:20.177916 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:20.177875 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:22:20.274899 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:20.274863 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:22:33.531682 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.531636 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65d9f8ddbd-lns9v"] Jul 01 22:22:33.532062 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.532038 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1b7f8a-1ff9-4532-be45-524aa57430bd" containerName="authorino" Jul 01 22:22:33.532062 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.532051 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1b7f8a-1ff9-4532-be45-524aa57430bd" containerName="authorino" Jul 01 22:22:33.532142 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.532070 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0155d0ab-d800-4b75-ad71-a56e077f9b95" containerName="authorino" Jul 01 22:22:33.532142 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.532076 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0155d0ab-d800-4b75-ad71-a56e077f9b95" containerName="authorino" Jul 01 22:22:33.532209 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.532143 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1b7f8a-1ff9-4532-be45-524aa57430bd" containerName="authorino" Jul 01 22:22:33.532209 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.532153 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0155d0ab-d800-4b75-ad71-a56e077f9b95" containerName="authorino" Jul 01 22:22:33.535252 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.535232 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:22:33.538414 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.538392 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 01 22:22:33.546267 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.546243 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65d9f8ddbd-lns9v"] Jul 01 22:22:33.558733 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.558701 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-oidc-ca\") pod \"authorino-65d9f8ddbd-lns9v\" (UID: \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\") " pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:22:33.558883 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.558764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-tls-cert\") pod \"authorino-65d9f8ddbd-lns9v\" (UID: \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\") " pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:22:33.558883 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.558798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj949\" (UniqueName: \"kubernetes.io/projected/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-kube-api-access-kj949\") pod \"authorino-65d9f8ddbd-lns9v\" (UID: \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\") " pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:22:33.659292 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.659247 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj949\" (UniqueName: \"kubernetes.io/projected/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-kube-api-access-kj949\") pod \"authorino-65d9f8ddbd-lns9v\" (UID: \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\") " pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:22:33.659539 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.659510 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-oidc-ca\") pod \"authorino-65d9f8ddbd-lns9v\" (UID: \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\") " pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:22:33.659702 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.659596 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-tls-cert\") pod \"authorino-65d9f8ddbd-lns9v\" (UID: \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\") " pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:22:33.660246 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.660221 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-oidc-ca\") pod \"authorino-65d9f8ddbd-lns9v\" (UID: \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\") " pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:22:33.661987 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.661961 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-tls-cert\") pod \"authorino-65d9f8ddbd-lns9v\" (UID: \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\") " pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:22:33.668178 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.668159 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj949\" (UniqueName: \"kubernetes.io/projected/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-kube-api-access-kj949\") pod \"authorino-65d9f8ddbd-lns9v\" (UID: \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\") " pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:22:33.844349 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.844266 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:22:33.983611 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.983583 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65d9f8ddbd-lns9v"] Jul 01 22:22:33.985770 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:22:33.985744 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f20ae3a_0ee5_420b_9b3a_c9af039397b6.slice/crio-be6c1a456419f564c4a1ee89a67005c75a0f0447884ef7a8617959e8fd630980 WatchSource:0}: Error finding container be6c1a456419f564c4a1ee89a67005c75a0f0447884ef7a8617959e8fd630980: Status 404 returned error can't find the container with id be6c1a456419f564c4a1ee89a67005c75a0f0447884ef7a8617959e8fd630980 Jul 01 22:22:33.987512 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:33.987486 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 22:22:34.853814 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:34.853717 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" event={"ID":"5f20ae3a-0ee5-420b-9b3a-c9af039397b6","Type":"ContainerStarted","Data":"24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2"} Jul 01 22:22:34.853814 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:34.853771 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" event={"ID":"5f20ae3a-0ee5-420b-9b3a-c9af039397b6","Type":"ContainerStarted","Data":"be6c1a456419f564c4a1ee89a67005c75a0f0447884ef7a8617959e8fd630980"} Jul 01 22:22:34.873036 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:34.872987 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" podStartSLOduration=1.376909835 podStartE2EDuration="1.872971534s" totalImagesPullingTime="496.061699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:22:34.871231953 +0000 UTC m=+657.958509437" watchObservedRunningTime="2026-07-01 22:22:34.872971534 +0000 UTC m=+657.960249022" Jul 01 22:22:34.898663 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:34.898630 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d5446866b-bsp5v"] Jul 01 22:22:34.898844 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:34.898822 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d5446866b-bsp5v" podUID="d3e62efc-c5c6-4052-ace9-8d51d70abf26" containerName="authorino" containerID="cri-o://daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118" gracePeriod=30 Jul 01 22:22:35.162042 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.162015 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d5446866b-bsp5v" Jul 01 22:22:35.170830 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.170795 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v667f\" (UniqueName: \"kubernetes.io/projected/d3e62efc-c5c6-4052-ace9-8d51d70abf26-kube-api-access-v667f\") pod \"d3e62efc-c5c6-4052-ace9-8d51d70abf26\" (UID: \"d3e62efc-c5c6-4052-ace9-8d51d70abf26\") " Jul 01 22:22:35.170975 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.170845 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3e62efc-c5c6-4052-ace9-8d51d70abf26-tls-cert\") pod \"d3e62efc-c5c6-4052-ace9-8d51d70abf26\" (UID: \"d3e62efc-c5c6-4052-ace9-8d51d70abf26\") " Jul 01 22:22:35.173000 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.172970 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3e62efc-c5c6-4052-ace9-8d51d70abf26-kube-api-access-v667f" (OuterVolumeSpecName: "kube-api-access-v667f") pod "d3e62efc-c5c6-4052-ace9-8d51d70abf26" (UID: "d3e62efc-c5c6-4052-ace9-8d51d70abf26"). InnerVolumeSpecName "kube-api-access-v667f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:22:35.182222 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.182193 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3e62efc-c5c6-4052-ace9-8d51d70abf26-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d3e62efc-c5c6-4052-ace9-8d51d70abf26" (UID: "d3e62efc-c5c6-4052-ace9-8d51d70abf26"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:22:35.272393 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.272353 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v667f\" (UniqueName: \"kubernetes.io/projected/d3e62efc-c5c6-4052-ace9-8d51d70abf26-kube-api-access-v667f\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:22:35.272393 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.272384 2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3e62efc-c5c6-4052-ace9-8d51d70abf26-tls-cert\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:22:35.558286 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.558249 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:22:35.656223 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.656186 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:22:35.868011 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.867921 2568 generic.go:356] "Generic (PLEG): container finished" podID="d3e62efc-c5c6-4052-ace9-8d51d70abf26" containerID="daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118" exitCode=0 Jul 01 22:22:35.868011 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.867973 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d5446866b-bsp5v" Jul 01 22:22:35.868473 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.868005 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d5446866b-bsp5v" event={"ID":"d3e62efc-c5c6-4052-ace9-8d51d70abf26","Type":"ContainerDied","Data":"daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118"} Jul 01 22:22:35.868473 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.868044 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d5446866b-bsp5v" event={"ID":"d3e62efc-c5c6-4052-ace9-8d51d70abf26","Type":"ContainerDied","Data":"49313509b43d3a63cc1f2587dcc3ce2b9654e6d6cccf744f59664d51ce4a7e8c"} Jul 01 22:22:35.868473 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.868066 2568 scope.go:117] "RemoveContainer" containerID="daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118" Jul 01 22:22:35.877054 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.877033 2568 scope.go:117] "RemoveContainer" containerID="daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118" Jul 01 22:22:35.877334 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:22:35.877314 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118\": container with ID starting with daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118 not found: ID does not exist" containerID="daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118" Jul 01 22:22:35.877393 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.877340 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118"} err="failed to get container status \"daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118\": rpc error: code = NotFound desc = could not find container \"daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118\": container with ID starting with daa432d67129dcca033c842e507f1025a3de2900ea5ff2090b9e95da2a390118 not found: ID does not exist" Jul 01 22:22:35.893179 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.893156 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d5446866b-bsp5v"] Jul 01 22:22:35.897313 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:35.897289 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d5446866b-bsp5v"] Jul 01 22:22:36.566830 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:36.566797 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3e62efc-c5c6-4052-ace9-8d51d70abf26" path="/var/lib/kubelet/pods/d3e62efc-c5c6-4052-ace9-8d51d70abf26/volumes" Jul 01 22:22:37.732727 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:37.732686 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:22:37.834242 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:37.834189 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:22:41.023375 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:22:41.023339 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:23:02.818947 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:23:02.818909 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:23:09.931957 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:23:09.931893 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:23:30.418682 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:23:30.418573 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:23:55.910371 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:23:55.910324 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:24:02.885290 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:02.885247 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74"] Jul 01 22:24:02.886082 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:02.885644 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3e62efc-c5c6-4052-ace9-8d51d70abf26" containerName="authorino" Jul 01 22:24:02.886082 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:02.885671 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3e62efc-c5c6-4052-ace9-8d51d70abf26" containerName="authorino" Jul 01 22:24:02.886082 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:02.885739 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3e62efc-c5c6-4052-ace9-8d51d70abf26" containerName="authorino" Jul 01 22:24:02.888803 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:02.888787 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:02.892331 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:02.892304 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 22:24:02.893622 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:02.893601 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 01 22:24:02.893756 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:02.893683 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-llwzh\"" Jul 01 22:24:02.893756 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:02.893684 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 22:24:02.900277 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:02.900250 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74"] Jul 01 22:24:03.002907 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.002860 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:24:03.065715 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.065652 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.065890 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.065728 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdn44\" (UniqueName: \"kubernetes.io/projected/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-kube-api-access-kdn44\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.065890 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.065788 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.065890 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.065816 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.066008 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.065890 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.066008 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.065926 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.166977 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.166888 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.166977 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.166929 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.166977 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.166969 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.167266 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.166995 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.167266 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.167026 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.167266 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.167051 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdn44\" (UniqueName: \"kubernetes.io/projected/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-kube-api-access-kdn44\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.167493 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.167466 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.167557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.167489 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.167557 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.167499 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.169287 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.169262 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.169713 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.169690 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.176086 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.176062 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdn44\" (UniqueName: \"kubernetes.io/projected/e6474d9d-e593-422c-b3ab-a47fc16ed9ec-kube-api-access-kdn44\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n4b74\" (UID: \"e6474d9d-e593-422c-b3ab-a47fc16ed9ec\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.200433 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.200397 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:03.340937 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:03.340911 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74"] Jul 01 22:24:03.343137 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:24:03.343109 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6474d9d_e593_422c_b3ab_a47fc16ed9ec.slice/crio-42626918730c5f2557bf61a20d637cb66cdbc2a5b58c5372df235de58b5a14f6 WatchSource:0}: Error finding container 42626918730c5f2557bf61a20d637cb66cdbc2a5b58c5372df235de58b5a14f6: Status 404 returned error can't find the container with id 42626918730c5f2557bf61a20d637cb66cdbc2a5b58c5372df235de58b5a14f6 Jul 01 22:24:04.309799 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:04.309761 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" event={"ID":"e6474d9d-e593-422c-b3ab-a47fc16ed9ec","Type":"ContainerStarted","Data":"42626918730c5f2557bf61a20d637cb66cdbc2a5b58c5372df235de58b5a14f6"} Jul 01 22:24:05.315940 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:05.315895 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" event={"ID":"e6474d9d-e593-422c-b3ab-a47fc16ed9ec","Type":"ContainerStarted","Data":"33e131b1943b70b8225a5850ac9b657f0e6539349e2a106da92f8676e4562940"} Jul 01 22:24:05.339084 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:05.339033 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" podStartSLOduration=2.30107225 podStartE2EDuration="3.339017065s" totalImagesPullingTime="1.037944815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:24:05.336916675 +0000 UTC m=+748.424194159" watchObservedRunningTime="2026-07-01 22:24:05.339017065 +0000 UTC m=+748.426294550" Jul 01 22:24:13.201349 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:13.201303 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:13.201874 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:13.201367 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:13.214018 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:13.213990 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:13.372031 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:13.372003 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n4b74" Jul 01 22:24:14.139077 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:24:14.139041 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:25:20.199568 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.199530 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8568dfd5df-zr8h5"] Jul 01 22:25:20.203083 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.203062 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8568dfd5df-zr8h5" Jul 01 22:25:20.214509 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.214483 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8568dfd5df-zr8h5"] Jul 01 22:25:20.260756 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.260725 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5kb7\" (UniqueName: \"kubernetes.io/projected/5a5bc98d-f07a-42a9-964d-f786a9097aa9-kube-api-access-w5kb7\") pod \"authorino-8568dfd5df-zr8h5\" (UID: \"5a5bc98d-f07a-42a9-964d-f786a9097aa9\") " pod="kuadrant-system/authorino-8568dfd5df-zr8h5" Jul 01 22:25:20.260956 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.260768 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a5bc98d-f07a-42a9-964d-f786a9097aa9-tls-cert\") pod \"authorino-8568dfd5df-zr8h5\" (UID: \"5a5bc98d-f07a-42a9-964d-f786a9097aa9\") " pod="kuadrant-system/authorino-8568dfd5df-zr8h5" Jul 01 22:25:20.260956 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.260860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5a5bc98d-f07a-42a9-964d-f786a9097aa9-oidc-ca\") pod \"authorino-8568dfd5df-zr8h5\" (UID: \"5a5bc98d-f07a-42a9-964d-f786a9097aa9\") " pod="kuadrant-system/authorino-8568dfd5df-zr8h5" Jul 01 22:25:20.361623 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.361584 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5kb7\" (UniqueName: \"kubernetes.io/projected/5a5bc98d-f07a-42a9-964d-f786a9097aa9-kube-api-access-w5kb7\") pod \"authorino-8568dfd5df-zr8h5\" (UID: \"5a5bc98d-f07a-42a9-964d-f786a9097aa9\") " pod="kuadrant-system/authorino-8568dfd5df-zr8h5" Jul 01 22:25:20.361623 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.361628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a5bc98d-f07a-42a9-964d-f786a9097aa9-tls-cert\") pod \"authorino-8568dfd5df-zr8h5\" (UID: \"5a5bc98d-f07a-42a9-964d-f786a9097aa9\") " pod="kuadrant-system/authorino-8568dfd5df-zr8h5" Jul 01 22:25:20.361900 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.361693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5a5bc98d-f07a-42a9-964d-f786a9097aa9-oidc-ca\") pod \"authorino-8568dfd5df-zr8h5\" (UID: \"5a5bc98d-f07a-42a9-964d-f786a9097aa9\") " pod="kuadrant-system/authorino-8568dfd5df-zr8h5" Jul 01 22:25:20.362440 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.362419 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5a5bc98d-f07a-42a9-964d-f786a9097aa9-oidc-ca\") pod \"authorino-8568dfd5df-zr8h5\" (UID: \"5a5bc98d-f07a-42a9-964d-f786a9097aa9\") " pod="kuadrant-system/authorino-8568dfd5df-zr8h5" Jul 01 22:25:20.364203 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.364179 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a5bc98d-f07a-42a9-964d-f786a9097aa9-tls-cert\") pod \"authorino-8568dfd5df-zr8h5\" (UID: \"5a5bc98d-f07a-42a9-964d-f786a9097aa9\") " pod="kuadrant-system/authorino-8568dfd5df-zr8h5" Jul 01 22:25:20.370098 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.370075 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5kb7\" (UniqueName: \"kubernetes.io/projected/5a5bc98d-f07a-42a9-964d-f786a9097aa9-kube-api-access-w5kb7\") pod \"authorino-8568dfd5df-zr8h5\" (UID: \"5a5bc98d-f07a-42a9-964d-f786a9097aa9\") " pod="kuadrant-system/authorino-8568dfd5df-zr8h5" Jul 01 22:25:20.512284 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.512198 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8568dfd5df-zr8h5" Jul 01 22:25:20.665951 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.665915 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8568dfd5df-zr8h5"] Jul 01 22:25:20.667060 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:25:20.666998 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a5bc98d_f07a_42a9_964d_f786a9097aa9.slice/crio-bc5413332306df23219d41343d7c210305c71fab31fcc299cc7792c15d9dc2f8 WatchSource:0}: Error finding container bc5413332306df23219d41343d7c210305c71fab31fcc299cc7792c15d9dc2f8: Status 404 returned error can't find the container with id bc5413332306df23219d41343d7c210305c71fab31fcc299cc7792c15d9dc2f8 Jul 01 22:25:20.696608 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.696574 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:25:20.698253 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.698223 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8568dfd5df-zr8h5" event={"ID":"5a5bc98d-f07a-42a9-964d-f786a9097aa9","Type":"ContainerStarted","Data":"bc5413332306df23219d41343d7c210305c71fab31fcc299cc7792c15d9dc2f8"} Jul 01 22:25:20.797072 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:20.796974 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:25:21.708446 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:21.708401 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8568dfd5df-zr8h5" event={"ID":"5a5bc98d-f07a-42a9-964d-f786a9097aa9","Type":"ContainerStarted","Data":"3e80f8754361e8ffba05e21a172cfb891b1113badc5c3bcf6e5c2a7e9693b295"} Jul 01 22:25:21.733176 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:21.733090 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8568dfd5df-zr8h5" podStartSLOduration=1.239950506 podStartE2EDuration="1.733067429s" totalImagesPullingTime="493.116923ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 22:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:25:21.731364497 +0000 UTC m=+824.818641981" watchObservedRunningTime="2026-07-01 22:25:21.733067429 +0000 UTC m=+824.820344915" Jul 01 22:25:21.769710 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:21.769673 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65d9f8ddbd-lns9v"] Jul 01 22:25:21.770006 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:21.769975 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" podUID="5f20ae3a-0ee5-420b-9b3a-c9af039397b6" containerName="authorino" containerID="cri-o://24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2" gracePeriod=30 Jul 01 22:25:21.862068 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:21.862023 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:25:21.951853 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:21.951817 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:25:22.055868 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.055838 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:25:22.178358 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.178324 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj949\" (UniqueName: \"kubernetes.io/projected/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-kube-api-access-kj949\") pod \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\" (UID: \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\") " Jul 01 22:25:22.178548 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.178368 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-oidc-ca\") pod \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\" (UID: \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\") " Jul 01 22:25:22.178548 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.178511 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-tls-cert\") pod \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\" (UID: \"5f20ae3a-0ee5-420b-9b3a-c9af039397b6\") " Jul 01 22:25:22.181196 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.180890 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-kube-api-access-kj949" (OuterVolumeSpecName: "kube-api-access-kj949") pod "5f20ae3a-0ee5-420b-9b3a-c9af039397b6" (UID: "5f20ae3a-0ee5-420b-9b3a-c9af039397b6"). InnerVolumeSpecName "kube-api-access-kj949". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 22:25:22.184387 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.184351 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "5f20ae3a-0ee5-420b-9b3a-c9af039397b6" (UID: "5f20ae3a-0ee5-420b-9b3a-c9af039397b6"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 22:25:22.189859 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.189834 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5f20ae3a-0ee5-420b-9b3a-c9af039397b6" (UID: "5f20ae3a-0ee5-420b-9b3a-c9af039397b6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 22:25:22.279706 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.279579 2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-tls-cert\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:25:22.279706 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.279623 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj949\" (UniqueName: \"kubernetes.io/projected/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-kube-api-access-kj949\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:25:22.279706 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.279640 2568 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5f20ae3a-0ee5-420b-9b3a-c9af039397b6-oidc-ca\") on node \"ip-10-0-133-116.ec2.internal\" DevicePath \"\"" Jul 01 22:25:22.715232 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.715196 2568 generic.go:356] "Generic (PLEG): container finished" podID="5f20ae3a-0ee5-420b-9b3a-c9af039397b6" containerID="24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2" exitCode=0 Jul 01 22:25:22.715232 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.715235 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" Jul 01 22:25:22.715788 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.715283 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" event={"ID":"5f20ae3a-0ee5-420b-9b3a-c9af039397b6","Type":"ContainerDied","Data":"24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2"} Jul 01 22:25:22.715788 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.715324 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65d9f8ddbd-lns9v" event={"ID":"5f20ae3a-0ee5-420b-9b3a-c9af039397b6","Type":"ContainerDied","Data":"be6c1a456419f564c4a1ee89a67005c75a0f0447884ef7a8617959e8fd630980"} Jul 01 22:25:22.715788 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.715346 2568 scope.go:117] "RemoveContainer" containerID="24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2" Jul 01 22:25:22.726390 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.726367 2568 scope.go:117] "RemoveContainer" containerID="24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2" Jul 01 22:25:22.726771 ip-10-0-133-116 kubenswrapper[2568]: E0701 22:25:22.726751 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2\": container with ID starting with 24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2 not found: ID does not exist" containerID="24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2" Jul 01 22:25:22.726849 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.726785 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2"} err="failed to get container status \"24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2\": rpc error: code = NotFound desc = could not find container \"24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2\": container with ID starting with 24f820731ebbd51df596d3d514d37f97638286fe95361b7363df969118ca84d2 not found: ID does not exist" Jul 01 22:25:22.739158 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.739116 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65d9f8ddbd-lns9v"] Jul 01 22:25:22.747008 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:22.746983 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-65d9f8ddbd-lns9v"] Jul 01 22:25:24.564590 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:24.564546 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f20ae3a-0ee5-420b-9b3a-c9af039397b6" path="/var/lib/kubelet/pods/5f20ae3a-0ee5-420b-9b3a-c9af039397b6/volumes" Jul 01 22:25:29.495153 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:25:29.495114 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:26:00.216227 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:00.216191 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8568dfd5df-zr8h5_5a5bc98d-f07a-42a9-964d-f786a9097aa9/authorino/0.log" Jul 01 22:26:04.765359 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:04.765329 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g9tx8_a4185069-1aa6-40f7-b0a4-f2048f52071c/manager/0.log" Jul 01 22:26:05.265051 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:05.265024 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tgtr8_97dc65a9-6f2a-4e13-94aa-7a041b9f6e23/server/0.log" Jul 01 22:26:05.392355 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:05.392317 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jt699_570160c7-a6d7-49d9-83a7-78e8df973289/manager/0.log" Jul 01 22:26:05.747761 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:05.747724 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddbccb87-z5fgs_d3bc568f-be58-4ef6-baae-471c0fac6ddb/copy-manifests/0.log" Jul 01 22:26:05.755190 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:05.755162 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddbccb87-z5fgs_d3bc568f-be58-4ef6-baae-471c0fac6ddb/manager/0.log" Jul 01 22:26:05.871405 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:05.871371 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-s6qs6_f45d23ed-6f88-4edd-ab5d-e518ba9b1a29/postgres/0.log" Jul 01 22:26:07.139895 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:07.139864 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8568dfd5df-zr8h5_5a5bc98d-f07a-42a9-964d-f786a9097aa9/authorino/0.log" Jul 01 22:26:07.269938 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:07.269901 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zgcpl_f9342327-964b-4742-98ac-913f6553563b/manager/0.log" Jul 01 22:26:07.380762 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:07.380721 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kl7bq_6b020979-438f-4d95-a818-95caefb56ed6/manager/0.log" Jul 01 22:26:07.610020 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:07.609986 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5vtl5_935162f7-8488-4d32-a06f-b52fdd6684af/registry-server/0.log" Jul 01 22:26:07.980275 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:07.980221 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7vhrr_4ba47b17-94fa-4e43-937c-3446fa214898/manager/0.log" Jul 01 22:26:08.322848 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:08.322762 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf49zjb9_38ba54ff-8e3a-4474-a05b-d6d11cea6993/istio-proxy/0.log" Jul 01 22:26:08.660751 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:08.660641 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dd7845ff-wwvj5_4292d888-30df-4f38-bc5e-4ffc6c85fb00/kube-auth-proxy/0.log" Jul 01 22:26:08.775570 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:08.775539 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jgpdj_c3c2af52-8690-4324-9ffc-05b654476041/istio-proxy/1.log" Jul 01 22:26:09.102686 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:09.102642 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-745b957bc7-5mptn_e3b2eda9-57a2-435f-8b5b-273e643baf4e/router/0.log" Jul 01 22:26:09.890940 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:09.890905 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-n4b74_e6474d9d-e593-422c-b3ab-a47fc16ed9ec/main/0.log" Jul 01 22:26:14.019577 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:14.019538 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:26:14.095404 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:14.095366 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" limit=1024 Jul 01 22:26:16.926673 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:16.926620 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nj76z_d65a4b07-191f-4737-93c7-d08be8e1794e/global-pull-secret-syncer/0.log" Jul 01 22:26:16.975689 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:16.975618 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fc8gq_bdc4d51c-db3d-4a64-bd97-74bf81067492/konnectivity-agent/0.log" Jul 01 22:26:17.053488 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:17.053457 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-116.ec2.internal_2ce2be86fb4a38cffeeb63b45a890e95/haproxy/0.log" Jul 01 22:26:21.833789 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:21.833750 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8568dfd5df-zr8h5_5a5bc98d-f07a-42a9-964d-f786a9097aa9/authorino/0.log" Jul 01 22:26:21.894673 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:21.894616 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zgcpl_f9342327-964b-4742-98ac-913f6553563b/manager/0.log" Jul 01 22:26:21.936812 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:21.936781 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kl7bq_6b020979-438f-4d95-a818-95caefb56ed6/manager/0.log" Jul 01 22:26:22.008553 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:22.008521 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5vtl5_935162f7-8488-4d32-a06f-b52fdd6684af/registry-server/0.log" Jul 01 22:26:22.123141 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:22.123045 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7vhrr_4ba47b17-94fa-4e43-937c-3446fa214898/manager/0.log" Jul 01 22:26:23.935449 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:23.935417 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-g7tcz_f6c316bc-3ae8-4c89-bf25-ee43411dad9d/cluster-monitoring-operator/0.log" Jul 01 22:26:24.158863 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:24.158836 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8424v_42d354db-b3d2-46fb-a3f7-a245154ac462/node-exporter/0.log" Jul 01 22:26:24.183450 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:24.183424 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8424v_42d354db-b3d2-46fb-a3f7-a245154ac462/kube-rbac-proxy/0.log" Jul 01 22:26:24.211279 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:24.211256 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8424v_42d354db-b3d2-46fb-a3f7-a245154ac462/init-textfile/0.log" Jul 01 22:26:26.328529 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:26.328494 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-kp2sr_85fe5172-c260-471b-ad47-c24df99b38a1/networking-console-plugin/0.log" Jul 01 22:26:27.030670 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.030633 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/1.log" Jul 01 22:26:27.039012 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.038968 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/2.log" Jul 01 22:26:27.200651 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.200617 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8"] Jul 01 22:26:27.201072 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.201057 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f20ae3a-0ee5-420b-9b3a-c9af039397b6" containerName="authorino" Jul 01 22:26:27.201072 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.201073 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f20ae3a-0ee5-420b-9b3a-c9af039397b6" containerName="authorino" Jul 01 22:26:27.201169 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.201143 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f20ae3a-0ee5-420b-9b3a-c9af039397b6" containerName="authorino" Jul 01 22:26:27.204395 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.204377 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.207575 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.207550 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mjtbf\"/\"default-dockercfg-5nrb2\"" Jul 01 22:26:27.207736 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.207577 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mjtbf\"/\"kube-root-ca.crt\"" Jul 01 22:26:27.207736 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.207612 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mjtbf\"/\"openshift-service-ca.crt\"" Jul 01 22:26:27.213547 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.213523 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8"] Jul 01 22:26:27.359829 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.359733 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-podres\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.359829 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.359772 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml98r\" (UniqueName: \"kubernetes.io/projected/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-kube-api-access-ml98r\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.359829 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.359800 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-sys\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.360271 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.359886 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-proc\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.360271 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.359922 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-lib-modules\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.461011 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.460968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-lib-modules\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.461178 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.461097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-podres\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.461178 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.461124 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml98r\" (UniqueName: \"kubernetes.io/projected/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-kube-api-access-ml98r\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.461178 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.461167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-sys\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.461297 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.461200 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-proc\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.461297 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.461167 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-lib-modules\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.461297 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.461247 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-podres\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.461297 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.461271 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-proc\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.461463 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.461368 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-sys\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.470372 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.470349 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml98r\" (UniqueName: \"kubernetes.io/projected/20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10-kube-api-access-ml98r\") pod \"perf-node-gather-daemonset-9ncs8\" (UID: \"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10\") " pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.535028 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.534988 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:27.642896 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.642867 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-l5xzg_39f81c8d-3ba9-48e7-8bc3-b826e993c369/download-server/0.log" Jul 01 22:26:27.674825 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:27.674799 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8"] Jul 01 22:26:27.676795 ip-10-0-133-116 kubenswrapper[2568]: W0701 22:26:27.676768 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod20c1cb03_f4fe_4c54_8c0d_5dd7a801ed10.slice/crio-9df25f52165c6a638b4f6f565fe9640dfed29824e1b2a89583984a9c0a7509de WatchSource:0}: Error finding container 9df25f52165c6a638b4f6f565fe9640dfed29824e1b2a89583984a9c0a7509de: Status 404 returned error can't find the container with id 9df25f52165c6a638b4f6f565fe9640dfed29824e1b2a89583984a9c0a7509de Jul 01 22:26:28.048133 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:28.048100 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" event={"ID":"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10","Type":"ContainerStarted","Data":"9d34e21ec2cdaabaf6f17745429b32e8416c2e6b8f033cc56f0596e9a2dd71fc"} Jul 01 22:26:28.048347 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:28.048228 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:28.048347 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:28.048261 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" event={"ID":"20c1cb03-f4fe-4c54-8c0d-5dd7a801ed10","Type":"ContainerStarted","Data":"9df25f52165c6a638b4f6f565fe9640dfed29824e1b2a89583984a9c0a7509de"} Jul 01 22:26:28.066721 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:28.066651 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" podStartSLOduration=1.066636036 podStartE2EDuration="1.066636036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 22:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 22:26:28.065560952 +0000 UTC m=+891.152838437" watchObservedRunningTime="2026-07-01 22:26:28.066636036 +0000 UTC m=+891.153913519" Jul 01 22:26:28.291131 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:28.291103 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-x4d2p_dba8fa25-e947-44e5-b2bc-ceae57514e6a/volume-data-source-validator/0.log" Jul 01 22:26:29.393781 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:29.393691 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gslj7_e22595d9-5db0-4470-9253-2efe2469c3b4/dns/0.log" Jul 01 22:26:29.416999 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:29.416965 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gslj7_e22595d9-5db0-4470-9253-2efe2469c3b4/kube-rbac-proxy/0.log" Jul 01 22:26:29.510455 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:29.510421 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6q954_c76adfcf-f1a2-4fb9-8e7c-e0a2d68b4476/dns-node-resolver/0.log" Jul 01 22:26:30.200695 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:30.200649 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6fgns_873029f8-0544-4b82-9ee1-c84e63aa34f7/node-ca/0.log" Jul 01 22:26:31.193870 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:31.193839 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf49zjb9_38ba54ff-8e3a-4474-a05b-d6d11cea6993/istio-proxy/0.log" Jul 01 22:26:31.290843 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:31.290814 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dd7845ff-wwvj5_4292d888-30df-4f38-bc5e-4ffc6c85fb00/kube-auth-proxy/0.log" Jul 01 22:26:31.319536 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:31.319507 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jgpdj_c3c2af52-8690-4324-9ffc-05b654476041/istio-proxy/1.log" Jul 01 22:26:31.320016 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:31.319985 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jgpdj_c3c2af52-8690-4324-9ffc-05b654476041/istio-proxy/0.log" Jul 01 22:26:31.397218 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:31.397186 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-745b957bc7-5mptn_e3b2eda9-57a2-435f-8b5b-273e643baf4e/router/0.log" Jul 01 22:26:32.103194 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:32.103165 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rmqxv_cc46767a-a90e-429a-9288-c41b1fc4e90a/serve-healthcheck-canary/0.log" Jul 01 22:26:32.619963 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:32.619917 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-rr67r_d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc/insights-operator/1.log" Jul 01 22:26:32.620384 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:32.620096 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-rr67r_d8939c3e-44b9-4eb8-aa2a-6145bca8e4fc/insights-operator/0.log" Jul 01 22:26:32.719570 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:32.719535 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpmzx_753915d6-e023-4dbd-804e-7832002f1a59/kube-rbac-proxy/0.log" Jul 01 22:26:32.742287 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:32.742254 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpmzx_753915d6-e023-4dbd-804e-7832002f1a59/exporter/0.log" Jul 01 22:26:32.768077 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:32.768051 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpmzx_753915d6-e023-4dbd-804e-7832002f1a59/extractor/0.log" Jul 01 22:26:34.062729 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:34.062699 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mjtbf/perf-node-gather-daemonset-9ncs8" Jul 01 22:26:35.016793 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:35.016766 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g9tx8_a4185069-1aa6-40f7-b0a4-f2048f52071c/manager/0.log" Jul 01 22:26:35.148150 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:35.148116 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tgtr8_97dc65a9-6f2a-4e13-94aa-7a041b9f6e23/server/0.log" Jul 01 22:26:35.219181 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:35.219147 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jt699_570160c7-a6d7-49d9-83a7-78e8df973289/manager/0.log" Jul 01 22:26:35.441439 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:35.441402 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddbccb87-z5fgs_d3bc568f-be58-4ef6-baae-471c0fac6ddb/manager/0.log" Jul 01 22:26:35.471457 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:35.471433 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cddbccb87-z5fgs_d3bc568f-be58-4ef6-baae-471c0fac6ddb/copy-manifests/0.log" Jul 01 22:26:35.511635 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:35.511605 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-s6qs6_f45d23ed-6f88-4edd-ab5d-e518ba9b1a29/postgres/0.log" Jul 01 22:26:37.436860 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:37.436830 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf49zjb9_38ba54ff-8e3a-4474-a05b-d6d11cea6993/istio-proxy/0.log" Jul 01 22:26:37.518453 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:37.518425 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dd7845ff-wwvj5_4292d888-30df-4f38-bc5e-4ffc6c85fb00/kube-auth-proxy/0.log" Jul 01 22:26:37.540397 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:37.540368 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jgpdj_c3c2af52-8690-4324-9ffc-05b654476041/istio-proxy/1.log" Jul 01 22:26:37.540906 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:37.540887 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jgpdj_c3c2af52-8690-4324-9ffc-05b654476041/istio-proxy/0.log" Jul 01 22:26:37.591496 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:37.591470 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-745b957bc7-5mptn_e3b2eda9-57a2-435f-8b5b-273e643baf4e/router/0.log" Jul 01 22:26:38.408903 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:38.408872 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/1.log" Jul 01 22:26:38.410750 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:38.410725 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-crb5t_d85fb1e7-081a-469e-93bc-d6a08338daba/console-operator/1.log" Jul 01 22:26:38.684009 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:38.683981 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf49zjb9_38ba54ff-8e3a-4474-a05b-d6d11cea6993/istio-proxy/0.log" Jul 01 22:26:38.760774 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:38.760739 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dd7845ff-wwvj5_4292d888-30df-4f38-bc5e-4ffc6c85fb00/kube-auth-proxy/0.log" Jul 01 22:26:38.786379 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:38.786351 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jgpdj_c3c2af52-8690-4324-9ffc-05b654476041/istio-proxy/1.log" Jul 01 22:26:38.786563 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:38.786544 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jgpdj_c3c2af52-8690-4324-9ffc-05b654476041/istio-proxy/0.log" Jul 01 22:26:38.835074 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:38.835049 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-745b957bc7-5mptn_e3b2eda9-57a2-435f-8b5b-273e643baf4e/router/0.log" Jul 01 22:26:42.353383 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:42.353352 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-mjkdr_3d3cf9ab-a1b4-4fd3-b53a-a2582c62cce4/migrator/0.log" Jul 01 22:26:42.377902 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:42.377874 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-mjkdr_3d3cf9ab-a1b4-4fd3-b53a-a2582c62cce4/graceful-termination/0.log" Jul 01 22:26:42.731988 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:42.731943 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-7zx7k_5fcbd7f4-17ea-40c3-a234-5278cd77e7e7/kube-storage-version-migrator-operator/1.log" Jul 01 22:26:42.733547 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:42.733517 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-7zx7k_5fcbd7f4-17ea-40c3-a234-5278cd77e7e7/kube-storage-version-migrator-operator/0.log" Jul 01 22:26:43.829353 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:43.829277 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-96n9s_a6f38a5a-299f-4ec2-9b52-d4fc37dee6a8/kube-multus/0.log" Jul 01 22:26:43.888923 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:43.888899 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b5p2_852c4923-fad2-40f7-a57c-3c4674890b1f/kube-multus-additional-cni-plugins/0.log" Jul 01 22:26:43.912027 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:43.912006 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b5p2_852c4923-fad2-40f7-a57c-3c4674890b1f/egress-router-binary-copy/0.log" Jul 01 22:26:43.935621 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:43.935584 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b5p2_852c4923-fad2-40f7-a57c-3c4674890b1f/cni-plugins/0.log" Jul 01 22:26:43.960031 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:43.960002 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b5p2_852c4923-fad2-40f7-a57c-3c4674890b1f/bond-cni-plugin/0.log" Jul 01 22:26:43.983678 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:43.983625 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b5p2_852c4923-fad2-40f7-a57c-3c4674890b1f/routeoverride-cni/0.log" Jul 01 22:26:44.010338 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:44.010310 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b5p2_852c4923-fad2-40f7-a57c-3c4674890b1f/whereabouts-cni-bincopy/0.log" Jul 01 22:26:44.033641 ip-10-0-133-116 kubenswrapper[2568]: I0701 22:26:44.033613 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5b5p2_852c4923-fad2-40f7-a57c-3c4674890b1f/whereabouts-cni/0.log"