Jul 02 13:39:21.272937 ip-10-0-131-54 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 13:39:21.272951 ip-10-0-131-54 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 13:39:21.272961 ip-10-0-131-54 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 13:39:21.273289 ip-10-0-131-54 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 13:39:31.276923 ip-10-0-131-54 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 13:39:31.276941 ip-10-0-131-54 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 14c2b93a0ec24a32984704bafd8ecb5d -- Jul 02 13:41:28.738227 ip-10-0-131-54 systemd[1]: Starting Kubernetes Kubelet... Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.233541 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245336 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245350 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245354 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245360 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245364 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245367 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245370 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:41:29.359977 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245374 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:41:29.353089 ip-10-0-131-54 systemd[1]: Started Kubernetes Kubelet. Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245376 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245379 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245400 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245405 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245409 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245414 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245417 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245420 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245423 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245426 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245429 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245432 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245435 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245438 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245440 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245443 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245446 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245448 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:41:29.361299 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245452 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245455 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245458 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245462 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245465 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245467 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245470 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245473 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245476 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245479 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245482 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245485 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245488 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245491 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245494 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245497 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245502 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245505 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245508 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245511 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:41:29.362848 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245514 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245517 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245520 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245522 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245525 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245528 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245531 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245533 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245536 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245539 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245542 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245545 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245547 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245550 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245553 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245556 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245559 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245562 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245566 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245569 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:41:29.363730 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245572 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245575 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245578 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245580 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245583 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245592 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245595 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245598 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245601 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245603 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245606 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245609 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245612 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245621 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245624 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245627 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245630 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245632 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245635 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245637 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:41:29.364592 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245640 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245643 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245646 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245649 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245652 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245655 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245658 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245661 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245665 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245669 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245672 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245675 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.245678 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246520 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246529 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246533 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246537 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246541 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246546 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:41:29.365296 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246549 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246552 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246556 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246560 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246564 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246567 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246570 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246574 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246577 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246580 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246583 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246586 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246588 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246591 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246594 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246597 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246599 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246602 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246605 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:41:29.365821 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246608 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246611 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246614 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246617 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246619 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246622 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246625 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246629 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246632 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246635 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246638 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246640 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246643 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246646 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246649 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246653 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246656 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246659 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246661 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246664 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:41:29.366446 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246667 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246669 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246672 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246675 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246678 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246681 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246684 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246686 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246690 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246693 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246695 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246698 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246701 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246704 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246707 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246710 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246712 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246715 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246718 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246720 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:41:29.367028 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246723 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246725 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246728 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246730 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246733 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246736 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246740 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246743 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246746 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246748 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246754 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246757 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246760 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246762 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246765 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246768 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246771 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246773 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246776 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246779 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:41:29.368025 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246782 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246784 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246787 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246791 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246796 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246799 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246802 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246804 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246807 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246810 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246812 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246815 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246818 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.246820 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247276 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247283 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247286 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247291 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247296 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:41:29.369032 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247299 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247302 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247305 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247310 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247313 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247316 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247320 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247323 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247326 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247329 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247332 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247335 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247338 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247340 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247343 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247346 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247349 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247352 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247355 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247357 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:41:29.369986 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247360 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247362 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247365 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247368 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247371 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247374 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247376 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247379 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247381 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247384 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247387 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247389 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247392 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247396 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247398 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247403 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247407 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247410 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247415 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:41:29.370991 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247418 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247420 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247423 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247426 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247429 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247431 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247434 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247437 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247439 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247442 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247446 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247449 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247452 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247454 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247457 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247460 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247462 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247465 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247469 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247472 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:41:29.372051 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247475 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247492 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247496 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247499 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247502 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247505 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247509 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247512 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247516 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247519 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247522 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247526 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247529 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247531 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247534 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247537 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247540 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247543 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247546 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:41:29.373224 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247548 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247551 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247554 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247557 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247560 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247563 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247566 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247569 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247571 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247574 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247577 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247579 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247582 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247585 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247588 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.247590 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247658 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247666 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247672 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247676 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247681 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 13:41:29.374378 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247686 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247691 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247695 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247700 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247704 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247708 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247712 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247715 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247718 2573 flags.go:64] FLAG: --cgroup-root="" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247721 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247725 2573 flags.go:64] FLAG: --client-ca-file="" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247728 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247731 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247736 2573 flags.go:64] FLAG: --cluster-domain="" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247739 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247743 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247746 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247750 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247754 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247757 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247761 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247764 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247767 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247770 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 13:41:29.376277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247773 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247777 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247780 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247784 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247787 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247791 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247794 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247797 2573 flags.go:64] FLAG: --enable-server="true" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247802 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247806 2573 flags.go:64] FLAG: --event-burst="100" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247810 2573 flags.go:64] FLAG: --event-qps="50" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247814 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247817 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247821 2573 flags.go:64] FLAG: --eviction-hard="" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247825 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247828 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247831 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247834 2573 flags.go:64] FLAG: --eviction-soft="" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247837 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247840 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247843 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247846 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247849 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247853 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247856 2573 flags.go:64] FLAG: --feature-gates="" Jul 02 13:41:29.377273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247859 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247862 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247866 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247869 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247872 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247875 2573 flags.go:64] FLAG: --help="false" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247878 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247882 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247885 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247888 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247892 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247895 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247899 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247902 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247904 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247908 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247912 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247915 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247919 2573 flags.go:64] FLAG: --kube-reserved="" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247923 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247926 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247929 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247932 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247935 2573 flags.go:64] FLAG: --lock-file="" Jul 02 13:41:29.379528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247938 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247940 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247944 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247949 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247952 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247955 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247958 2573 flags.go:64] FLAG: --logging-format="text" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247961 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247964 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247967 2573 flags.go:64] FLAG: --manifest-url="" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247970 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247975 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247978 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247982 2573 flags.go:64] FLAG: --max-pods="110" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247985 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247988 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.247991 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248008 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248012 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248016 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248019 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248026 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248029 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248034 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 13:41:29.380650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248038 2573 flags.go:64] FLAG: --pod-cidr="" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248041 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248049 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248052 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248056 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248059 2573 flags.go:64] FLAG: --port="10250" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248062 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248065 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02f1949151d030b79" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248069 2573 flags.go:64] FLAG: --qos-reserved="" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248072 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248075 2573 flags.go:64] FLAG: --register-node="true" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248078 2573 flags.go:64] FLAG: --register-with-taints="" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248082 2573 flags.go:64] FLAG: --registry-burst="10" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248085 2573 flags.go:64] FLAG: --registry-qps="5" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248088 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248091 2573 flags.go:64] FLAG: --reserved-memory="" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248095 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248098 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248101 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248104 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248107 2573 flags.go:64] FLAG: --runonce="false" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248110 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248113 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248116 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248119 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 13:41:29.489066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248122 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248126 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248129 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248132 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248135 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248137 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248140 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248146 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248149 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248154 2573 flags.go:64] FLAG: --system-cgroups="" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248157 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248163 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248166 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248169 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248173 2573 flags.go:64] FLAG: --tls-min-version="" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248176 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248179 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248182 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248185 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248188 2573 flags.go:64] FLAG: --v="2" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248192 2573 flags.go:64] FLAG: --version="false" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248196 2573 flags.go:64] FLAG: --vmodule="" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248200 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.248204 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248327 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:41:29.511205 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248330 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248333 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248336 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248339 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248342 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248345 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248348 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248351 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248353 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248356 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248359 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248362 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248364 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248367 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248371 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248374 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248378 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248381 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248384 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248387 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:41:29.512137 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248390 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248393 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248395 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248398 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248401 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248403 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248406 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248409 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248411 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248416 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248420 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248423 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248426 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248429 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248432 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248435 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248438 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248440 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248443 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248446 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:41:29.512826 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248449 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248452 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248455 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248457 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248460 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248462 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248467 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248470 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248474 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248476 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248480 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248482 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248485 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248488 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248491 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248494 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248497 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248499 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248502 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:41:29.513531 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248505 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248508 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248510 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248513 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248515 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248518 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248521 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248525 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248529 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248532 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248535 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248539 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248542 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248545 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248548 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248550 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248553 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248556 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248558 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248562 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:41:29.515027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248565 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248570 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248573 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248576 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248579 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248582 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248586 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248590 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248593 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248596 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248598 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248601 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248604 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248606 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248609 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248611 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248614 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248617 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:41:29.515937 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.248620 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.249496 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.261255 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.261270 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.261290 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.261295 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261354 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261359 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261363 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261367 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261370 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261374 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261377 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261380 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261383 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:41:29.516609 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261386 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261389 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261393 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261398 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261401 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261404 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261407 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261410 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261413 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261416 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261419 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261422 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261427 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261430 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261433 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261436 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261439 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261441 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261444 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:41:29.517273 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261447 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261451 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261455 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261458 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261462 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261465 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261468 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261471 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261474 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261477 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261479 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261482 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261486 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261488 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261491 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261494 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261497 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261500 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261503 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:41:29.518608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261505 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261508 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261511 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261514 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261517 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261519 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261524 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261526 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261529 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261532 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261535 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261538 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261541 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261544 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261546 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261550 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261553 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261556 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261558 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261561 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:41:29.519284 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261564 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261567 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261570 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261572 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261575 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261578 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261580 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261583 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261586 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261589 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261591 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261594 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261597 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261600 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261603 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261606 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261608 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261611 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261615 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261618 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:41:29.520597 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261621 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261623 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261626 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261629 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261632 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261634 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261637 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261640 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261644 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261647 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261651 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261655 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.261661 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261777 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261781 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:41:29.521286 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261784 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261787 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261790 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261793 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261796 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261799 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261802 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261804 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261807 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261810 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261813 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261816 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261818 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261821 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261824 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261826 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261830 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261833 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261836 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261839 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:41:29.521803 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261841 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261844 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261847 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261850 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261852 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261856 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261860 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261863 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261866 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261868 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261871 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261874 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261876 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261879 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261882 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261884 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261887 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261890 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261893 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261895 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:41:29.522479 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261898 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261901 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261904 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261907 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261909 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261912 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261915 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261917 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261921 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261924 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261926 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261929 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261932 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261934 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261937 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261940 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261943 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261946 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261949 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261953 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:41:29.523149 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261957 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261960 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261964 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261968 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261972 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261975 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261978 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261981 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261984 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261987 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261989 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.261992 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262010 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262014 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262017 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262021 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262024 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262026 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262030 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:41:29.523782 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262033 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262039 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262042 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262044 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262048 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262052 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262055 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262059 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262062 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262065 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262069 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262072 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262075 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262078 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262081 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262084 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262087 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:41:29.524410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:29.262089 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:41:29.524933 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.262095 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 13:41:29.524933 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.262202 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 13:41:29.524933 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.264657 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 13:41:29.524933 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.266087 2573 server.go:1019] "Starting client certificate rotation" Jul 02 13:41:29.524933 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.266207 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 13:41:29.524933 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.266253 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 13:41:29.524933 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.277871 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 13:41:29.524933 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.279127 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 13:41:29.524933 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.297677 2573 log.go:25] "Validated CRI v1 runtime API" Jul 02 13:41:29.524933 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.299946 2573 log.go:25] "Validated CRI v1 image API" Jul 02 13:41:29.524933 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.300853 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 13:41:29.524933 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.304167 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 13:41:29.525552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.313464 2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e1ab5f5e-2e5d-4da4-ae42-b376c2290f0c:/dev/nvme0n1p3 e985e966-b19b-4dd9-a0f8-53f52701dc1c:/dev/nvme0n1p4] Jul 02 13:41:29.525552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.313480 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.320209 2573 manager.go:216] Machine: {Timestamp:2026-07-02 13:41:29.31892255 +0000 UTC m=+0.451814108 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3058884 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec228c3e685ccf23decf482b0810839f SystemUUID:ec228c3e-685c-cf23-decf-482b0810839f BootID:14c2b93a-0ec2-4a32-9847-04bafd8ecb5d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:5d:af:f5:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:5d:af:f5:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:fa:62:27:5e:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.320317 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.320400 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.323899 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.323933 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-54.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.325598 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bplwj" Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.325930 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.325941 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.325951 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.326809 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.327896 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.331675 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.331791 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.331827 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.331843 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.331862 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 13:41:29.525736 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.331881 2573 kubelet.go:398] "Adding apiserver pod source" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.331890 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.332397 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.332415 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.335230 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bplwj" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.338163 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.339770 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.339799 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.340551 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.340569 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.340579 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.340588 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.340600 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.340609 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.348012 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.348024 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.348043 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.348049 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.348058 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.348067 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.348023 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.348922 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.348930 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.350461 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.352173 2573 server.go:1268] "Started kubelet" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.352293 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.352399 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.352414 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.354400 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.356302 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.358611 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-54.ec2.internal" not found Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:29.364304 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.367070 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.367089 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:29.367201 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-54.ec2.internal\" not found" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.367880 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.367896 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.367883 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.367969 2573 factory.go:55] Registering systemd factory Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.368005 2573 factory.go:223] Registration of the systemd container factory successfully Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.368070 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.368079 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.368295 2573 factory.go:153] Registering CRI-O factory Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.368321 2573 factory.go:223] Registration of the crio container factory successfully Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.368397 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.368424 2573 factory.go:103] Registering Raw factory Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.368446 2573 manager.go:1196] Started watching for new ooms in manager Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.368888 2573 manager.go:349] Starting recovery of all containers Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.370117 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:29.373871 2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-54.ec2.internal\" not found" node="ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.378027 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-54.ec2.internal" not found Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.387565 2573 manager.go:354] Recovery completed Jul 02 13:41:29.526326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.391851 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.394253 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.394281 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.394297 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.394779 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.394788 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.394805 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.394857 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.395720 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.395749 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.395762 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.396253 2573 policy_none.go:49] "None policy: Start" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.396266 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.396276 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.397889 2573 policy_none.go:47] "Start" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.437991 2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-54.ec2.internal" not found Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.457663 2573 manager.go:337] "Starting Device Plugin manager" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:29.457708 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.457721 2573 server.go:87] "Starting device plugin registration server" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.458015 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.458027 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.458195 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.458291 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.458302 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:29.458954 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:29.458993 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-54.ec2.internal\" not found" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.470854 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.472450 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.472496 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.472525 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:29.472561 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 13:41:29.527934 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.475394 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.558513 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.559558 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.559591 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.559601 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.559626 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.572661 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal"] Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.572724 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.573592 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:29.573611 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-54.ec2.internal\": node \"ip-10-0-131-54.ec2.internal\" not found" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.573889 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.573916 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.573926 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.575415 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.576477 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.603146 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.608539 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.618829 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 13:41:29.655360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.623150 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 13:41:29.808499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.672062 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.808499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.672168 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5269c938c5beed95562af588e625c306-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal\" (UID: \"5269c938c5beed95562af588e625c306\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.808499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.688804 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 13:41:29.808499 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:29.688840 2573 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.808499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.688852 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.808499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.706568 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 13:41:29.808499 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:29.706603 2573 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-54.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.808499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.773227 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/29c61269dc44284c55ddf8a33477c594-config\") pod \"kube-apiserver-proxy-ip-10-0-131-54.ec2.internal\" (UID: \"29c61269dc44284c55ddf8a33477c594\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.808499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.773268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5269c938c5beed95562af588e625c306-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal\" (UID: \"5269c938c5beed95562af588e625c306\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.808499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.773321 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5269c938c5beed95562af588e625c306-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal\" (UID: \"5269c938c5beed95562af588e625c306\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.808499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.773332 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5269c938c5beed95562af588e625c306-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal\" (UID: \"5269c938c5beed95562af588e625c306\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.937708 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.874378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/29c61269dc44284c55ddf8a33477c594-config\") pod \"kube-apiserver-proxy-ip-10-0-131-54.ec2.internal\" (UID: \"29c61269dc44284c55ddf8a33477c594\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.937708 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.874421 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5269c938c5beed95562af588e625c306-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal\" (UID: \"5269c938c5beed95562af588e625c306\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.937708 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.874462 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5269c938c5beed95562af588e625c306-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal\" (UID: \"5269c938c5beed95562af588e625c306\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.937708 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.874380 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/29c61269dc44284c55ddf8a33477c594-config\") pod \"kube-apiserver-proxy-ip-10-0-131-54.ec2.internal\" (UID: \"29c61269dc44284c55ddf8a33477c594\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.937708 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.924733 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" Jul 02 13:41:29.937708 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:29.927722 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal" Jul 02 13:41:30.330822 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.265512 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 13:41:30.330822 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.265670 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 13:41:30.330822 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.265671 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 13:41:30.330822 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.265678 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.333313 2573 apiserver.go:52] "Watching apiserver" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.339602 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 13:36:29 +0000 UTC" deadline="2028-03-16 08:59:32.738593092 +0000 UTC" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.339631 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14947h18m2.398965631s" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.343039 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.343392 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-v2d9m","openshift-network-diagnostics/network-check-target-kp57h","openshift-network-operator/iptables-alerter-9s4l2","openshift-ovn-kubernetes/ovnkube-node-l7fgt","kube-system/global-pull-secret-syncer-fkm9t","kube-system/konnectivity-agent-lhrtf","kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl","openshift-cluster-node-tuning-operator/tuned-kpw4g","openshift-image-registry/node-ca-jd9tr","openshift-multus/multus-596nb","openshift-multus/multus-additional-cni-plugins-9ddp8","openshift-dns/node-resolver-7cf2b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal"] Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.344886 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.344964 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.345848 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.345888 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.346967 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9s4l2" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.348427 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.349582 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.351102 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.351251 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.351361 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.351493 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-864hb\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.351664 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.351685 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.351822 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tskfc\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.351896 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.352244 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.352885 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.355560 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.355612 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.356871 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lhrtf" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.358269 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.359102 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.359199 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 13:41:30.438657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.359268 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lwz8h\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.360707 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.361042 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.361259 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v9v6c\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.361403 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.367694 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.367990 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.369618 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jd9tr" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.370287 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.370397 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.370416 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fpr7r\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.371178 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-596nb" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.371709 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.371780 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.371787 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ffn6m\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.372043 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.372747 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.373436 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.373565 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.373635 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.373791 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pq58h\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.373834 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.374176 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7cf2b" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.374978 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.375129 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r7fgh\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.375208 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376283 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376373 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376547 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x7dmx\"" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376592 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d092476-9613-4e39-ab3b-9f2fdf62db80-agent-certs\") pod \"konnectivity-agent-lhrtf\" (UID: \"1d092476-9613-4e39-ab3b-9f2fdf62db80\") " pod="kube-system/konnectivity-agent-lhrtf" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba071132-90b3-495e-974e-b39eb437b1e9-iptables-alerter-script\") pod \"iptables-alerter-9s4l2\" (UID: \"ba071132-90b3-495e-974e-b39eb437b1e9\") " pod="openshift-network-operator/iptables-alerter-9s4l2" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376659 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fncpx\" (UniqueName: \"kubernetes.io/projected/b559aa27-2922-474b-98e6-3a00eb31f57c-kube-api-access-fncpx\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:30.441552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376700 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-kubelet\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376730 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-run-systemd\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376770 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-run-netns\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376790 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e68fa2ab-0d34-4558-94e4-277fb555cff1-ovn-node-metrics-cert\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376807 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-lib-modules\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376824 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb20c425-42ed-4904-9458-52a9e7c40993-etc-tuned\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376861 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba071132-90b3-495e-974e-b39eb437b1e9-host-slash\") pod \"iptables-alerter-9s4l2\" (UID: \"ba071132-90b3-495e-974e-b39eb437b1e9\") " pod="openshift-network-operator/iptables-alerter-9s4l2" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376897 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-node-log\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376920 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-cni-netd\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376970 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.376993 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-var-lib-openvswitch\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377028 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-run-openvswitch\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377057 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-device-dir\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377076 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vspl4\" (UniqueName: \"kubernetes.io/projected/9ee8265a-3e32-4a2c-8e3a-32863899271e-kube-api-access-vspl4\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377095 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-sysconfig\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.442759 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377118 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-run\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377146 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377170 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377191 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-cni-bin\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377212 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e68fa2ab-0d34-4558-94e4-277fb555cff1-ovnkube-config\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-sysctl-d\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpsc5\" (UniqueName: \"kubernetes.io/projected/18745f0d-e7b8-4f0e-bfc8-021979556351-kube-api-access-qpsc5\") pod \"node-ca-jd9tr\" (UID: \"18745f0d-e7b8-4f0e-bfc8-021979556351\") " pod="openshift-image-registry/node-ca-jd9tr" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377303 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5qtz\" (UniqueName: \"kubernetes.io/projected/ba071132-90b3-495e-974e-b39eb437b1e9-kube-api-access-r5qtz\") pod \"iptables-alerter-9s4l2\" (UID: \"ba071132-90b3-495e-974e-b39eb437b1e9\") " pod="openshift-network-operator/iptables-alerter-9s4l2" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377327 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-kubelet-config\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377352 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v727\" (UniqueName: \"kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727\") pod \"network-check-target-kp57h\" (UID: \"cb257e85-b36f-4233-8e80-0fab80099be6\") " pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377392 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-systemd-units\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-etc-openvswitch\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377445 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e68fa2ab-0d34-4558-94e4-277fb555cff1-env-overrides\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377471 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-systemd\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377494 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-var-lib-kubelet\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377522 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb20c425-42ed-4904-9458-52a9e7c40993-tmp\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.443366 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377548 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-slash\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377572 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-registration-dir\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377610 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-sysctl-conf\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-sys\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18745f0d-e7b8-4f0e-bfc8-021979556351-host\") pod \"node-ca-jd9tr\" (UID: \"18745f0d-e7b8-4f0e-bfc8-021979556351\") " pod="openshift-image-registry/node-ca-jd9tr" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377704 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-run-ovn\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377742 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-run-ovn-kubernetes\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-kubernetes\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377809 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfgkv\" (UniqueName: \"kubernetes.io/projected/e68fa2ab-0d34-4558-94e4-277fb555cff1-kube-api-access-mfgkv\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377831 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-dbus\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377855 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-socket-dir\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-modprobe-d\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377924 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d092476-9613-4e39-ab3b-9f2fdf62db80-konnectivity-ca\") pod \"konnectivity-agent-lhrtf\" (UID: \"1d092476-9613-4e39-ab3b-9f2fdf62db80\") " pod="kube-system/konnectivity-agent-lhrtf" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377968 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7fn9\" (UniqueName: \"kubernetes.io/projected/cb20c425-42ed-4904-9458-52a9e7c40993-kube-api-access-l7fn9\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.377994 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18745f0d-e7b8-4f0e-bfc8-021979556351-serviceca\") pod \"node-ca-jd9tr\" (UID: \"18745f0d-e7b8-4f0e-bfc8-021979556351\") " pod="openshift-image-registry/node-ca-jd9tr" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.378027 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e68fa2ab-0d34-4558-94e4-277fb555cff1-ovnkube-script-lib\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.443981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.378062 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-log-socket\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.444485 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.378089 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.444485 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.378110 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-sys-fs\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.444485 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.378149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-host\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.444485 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.378620 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 13:41:30.444485 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.402088 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t46fh" Jul 02 13:41:30.444485 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.411559 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t46fh" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.469035 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.478726 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5299a8ec-cec6-42be-bd4c-533005533331-cni-binary-copy\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.478750 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/635ded76-12ca-4c08-9766-b4f11093f394-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.478773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-run-netns\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.478790 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e68fa2ab-0d34-4558-94e4-277fb555cff1-ovn-node-metrics-cert\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.478807 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-lib-modules\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.478835 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb20c425-42ed-4904-9458-52a9e7c40993-etc-tuned\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.478862 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-run-netns\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.478864 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-var-lib-cni-multus\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.478900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61d94ef8-11f8-46ee-b67d-7aa90e074512-hosts-file\") pod \"node-resolver-7cf2b\" (UID: \"61d94ef8-11f8-46ee-b67d-7aa90e074512\") " pod="openshift-dns/node-resolver-7cf2b" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479017 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-lib-modules\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479041 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba071132-90b3-495e-974e-b39eb437b1e9-host-slash\") pod \"iptables-alerter-9s4l2\" (UID: \"ba071132-90b3-495e-974e-b39eb437b1e9\") " pod="openshift-network-operator/iptables-alerter-9s4l2" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479060 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-etc-kubernetes\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479077 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwrd8\" (UniqueName: \"kubernetes.io/projected/5299a8ec-cec6-42be-bd4c-533005533331-kube-api-access-xwrd8\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479085 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba071132-90b3-495e-974e-b39eb437b1e9-host-slash\") pod \"iptables-alerter-9s4l2\" (UID: \"ba071132-90b3-495e-974e-b39eb437b1e9\") " pod="openshift-network-operator/iptables-alerter-9s4l2" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479097 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-node-log\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-cni-netd\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.542124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479136 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-node-log\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479152 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-var-lib-openvswitch\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479132 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-run-openvswitch\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479196 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-device-dir\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479204 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-var-lib-openvswitch\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.479211 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479235 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-run-openvswitch\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479279 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-device-dir\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.479287 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs podName:b559aa27-2922-474b-98e6-3a00eb31f57c nodeName:}" failed. No retries permitted until 2026-07-02 13:41:30.979267994 +0000 UTC m=+2.112159539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs") pod "network-metrics-daemon-v2d9m" (UID: "b559aa27-2922-474b-98e6-3a00eb31f57c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479170 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-cni-netd\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vspl4\" (UniqueName: \"kubernetes.io/projected/9ee8265a-3e32-4a2c-8e3a-32863899271e-kube-api-access-vspl4\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479322 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-sysconfig\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479339 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-run\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479355 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479373 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.542720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-run-netns\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479428 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479442 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-sysconfig\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479461 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-cni-bin\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479488 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e68fa2ab-0d34-4558-94e4-277fb555cff1-ovnkube-config\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479512 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-run\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479532 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-sysctl-d\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479553 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpsc5\" (UniqueName: \"kubernetes.io/projected/18745f0d-e7b8-4f0e-bfc8-021979556351-kube-api-access-qpsc5\") pod \"node-ca-jd9tr\" (UID: \"18745f0d-e7b8-4f0e-bfc8-021979556351\") " pod="openshift-image-registry/node-ca-jd9tr" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479563 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-cni-bin\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479570 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5qtz\" (UniqueName: \"kubernetes.io/projected/ba071132-90b3-495e-974e-b39eb437b1e9-kube-api-access-r5qtz\") pod \"iptables-alerter-9s4l2\" (UID: \"ba071132-90b3-495e-974e-b39eb437b1e9\") " pod="openshift-network-operator/iptables-alerter-9s4l2" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479600 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-run-k8s-cni-cncf-io\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479628 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-sysctl-d\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479707 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-hostroot\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/635ded76-12ca-4c08-9766-b4f11093f394-os-release\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-kubelet-config\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v727\" (UniqueName: \"kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727\") pod \"network-check-target-kp57h\" (UID: \"cb257e85-b36f-4233-8e80-0fab80099be6\") " pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:30.543330 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479841 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-systemd-units\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479814 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-kubelet-config\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479867 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-etc-openvswitch\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479903 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e68fa2ab-0d34-4558-94e4-277fb555cff1-env-overrides\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479918 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-etc-openvswitch\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479918 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-systemd-units\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479934 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-systemd\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.479980 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-var-lib-kubelet\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480003 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb20c425-42ed-4904-9458-52a9e7c40993-tmp\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480034 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-slash\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480036 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-systemd\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480057 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-var-lib-kubelet\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480094 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e68fa2ab-0d34-4558-94e4-277fb555cff1-ovnkube-config\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-registration-dir\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480114 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-registration-dir\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480144 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-slash\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-sysctl-conf\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480208 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-sys\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.543814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480233 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18745f0d-e7b8-4f0e-bfc8-021979556351-host\") pod \"node-ca-jd9tr\" (UID: \"18745f0d-e7b8-4f0e-bfc8-021979556351\") " pod="openshift-image-registry/node-ca-jd9tr" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480259 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-sysctl-conf\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480274 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-sys\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480277 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-multus-conf-dir\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18745f0d-e7b8-4f0e-bfc8-021979556351-host\") pod \"node-ca-jd9tr\" (UID: \"18745f0d-e7b8-4f0e-bfc8-021979556351\") " pod="openshift-image-registry/node-ca-jd9tr" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480323 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/635ded76-12ca-4c08-9766-b4f11093f394-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480336 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e68fa2ab-0d34-4558-94e4-277fb555cff1-env-overrides\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480353 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdk67\" (UniqueName: \"kubernetes.io/projected/61d94ef8-11f8-46ee-b67d-7aa90e074512-kube-api-access-qdk67\") pod \"node-resolver-7cf2b\" (UID: \"61d94ef8-11f8-46ee-b67d-7aa90e074512\") " pod="openshift-dns/node-resolver-7cf2b" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480380 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-run-ovn\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480404 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-run-ovn-kubernetes\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480428 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-kubernetes\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5299a8ec-cec6-42be-bd4c-533005533331-multus-daemon-config\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480495 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-run-ovn-kubernetes\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/635ded76-12ca-4c08-9766-b4f11093f394-system-cni-dir\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480538 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfgkv\" (UniqueName: \"kubernetes.io/projected/e68fa2ab-0d34-4558-94e4-277fb555cff1-kube-api-access-mfgkv\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480548 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-run-ovn\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480563 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-dbus\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:30.544370 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480594 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-socket-dir\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480607 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-kubernetes\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480616 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-modprobe-d\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480640 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d092476-9613-4e39-ab3b-9f2fdf62db80-konnectivity-ca\") pod \"konnectivity-agent-lhrtf\" (UID: \"1d092476-9613-4e39-ab3b-9f2fdf62db80\") " pod="kube-system/konnectivity-agent-lhrtf" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480738 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-socket-dir\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.481026 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-etc-modprobe-d\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.481613 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d092476-9613-4e39-ab3b-9f2fdf62db80-konnectivity-ca\") pod \"konnectivity-agent-lhrtf\" (UID: \"1d092476-9613-4e39-ab3b-9f2fdf62db80\") " pod="kube-system/konnectivity-agent-lhrtf" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.483042 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb20c425-42ed-4904-9458-52a9e7c40993-tmp\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.484078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e68fa2ab-0d34-4558-94e4-277fb555cff1-ovn-node-metrics-cert\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-cnibin\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.486731 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-multus-socket-dir-parent\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.486755 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-var-lib-kubelet\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.486779 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7fn9\" (UniqueName: \"kubernetes.io/projected/cb20c425-42ed-4904-9458-52a9e7c40993-kube-api-access-l7fn9\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.480719 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-dbus\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.486820 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-multus-cni-dir\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.486844 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-run-multus-certs\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.486872 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/635ded76-12ca-4c08-9766-b4f11093f394-cnibin\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.544849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.486898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/635ded76-12ca-4c08-9766-b4f11093f394-cni-binary-copy\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.486916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/635ded76-12ca-4c08-9766-b4f11093f394-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.486938 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d94ef8-11f8-46ee-b67d-7aa90e074512-tmp-dir\") pod \"node-resolver-7cf2b\" (UID: \"61d94ef8-11f8-46ee-b67d-7aa90e074512\") " pod="openshift-dns/node-resolver-7cf2b" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.486971 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18745f0d-e7b8-4f0e-bfc8-021979556351-serviceca\") pod \"node-ca-jd9tr\" (UID: \"18745f0d-e7b8-4f0e-bfc8-021979556351\") " pod="openshift-image-registry/node-ca-jd9tr" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487014 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e68fa2ab-0d34-4558-94e4-277fb555cff1-ovnkube-script-lib\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487040 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-var-lib-cni-bin\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487070 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-log-socket\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487093 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487118 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-sys-fs\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-host\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487175 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d092476-9613-4e39-ab3b-9f2fdf62db80-agent-certs\") pod \"konnectivity-agent-lhrtf\" (UID: \"1d092476-9613-4e39-ab3b-9f2fdf62db80\") " pod="kube-system/konnectivity-agent-lhrtf" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-system-cni-dir\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487228 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrxs6\" (UniqueName: \"kubernetes.io/projected/635ded76-12ca-4c08-9766-b4f11093f394-kube-api-access-rrxs6\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487256 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba071132-90b3-495e-974e-b39eb437b1e9-iptables-alerter-script\") pod \"iptables-alerter-9s4l2\" (UID: \"ba071132-90b3-495e-974e-b39eb437b1e9\") " pod="openshift-network-operator/iptables-alerter-9s4l2" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-os-release\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fncpx\" (UniqueName: \"kubernetes.io/projected/b559aa27-2922-474b-98e6-3a00eb31f57c-kube-api-access-fncpx\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-kubelet\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.545361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-run-systemd\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487390 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487453 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e68fa2ab-0d34-4558-94e4-277fb555cff1-ovnkube-script-lib\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.487497 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18745f0d-e7b8-4f0e-bfc8-021979556351-serviceca\") pod \"node-ca-jd9tr\" (UID: \"18745f0d-e7b8-4f0e-bfc8-021979556351\") " pod="openshift-image-registry/node-ca-jd9tr" Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.489796 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-run-systemd\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.489819 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.489784 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.489868 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-host-kubelet\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.489870 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.489878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb20c425-42ed-4904-9458-52a9e7c40993-host\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.489895 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2v727 for pod openshift-network-diagnostics/network-check-target-kp57h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.489872 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.489837 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e68fa2ab-0d34-4558-94e4-277fb555cff1-log-socket\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.489970 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ee8265a-3e32-4a2c-8e3a-32863899271e-sys-fs\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.490293 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727 podName:cb257e85-b36f-4233-8e80-0fab80099be6 nodeName:}" failed. No retries permitted until 2026-07-02 13:41:30.990270914 +0000 UTC m=+2.123162466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2v727" (UniqueName: "kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727") pod "network-check-target-kp57h" (UID: "cb257e85-b36f-4233-8e80-0fab80099be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.490333 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret podName:cd777315-3f9e-4c1d-bbeb-d9587d0e62b3 nodeName:}" failed. No retries permitted until 2026-07-02 13:41:30.990321265 +0000 UTC m=+2.123212825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret") pod "global-pull-secret-syncer-fkm9t" (UID: "cd777315-3f9e-4c1d-bbeb-d9587d0e62b3") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.490696 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba071132-90b3-495e-974e-b39eb437b1e9-iptables-alerter-script\") pod \"iptables-alerter-9s4l2\" (UID: \"ba071132-90b3-495e-974e-b39eb437b1e9\") " pod="openshift-network-operator/iptables-alerter-9s4l2" Jul 02 13:41:30.545876 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.492137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb20c425-42ed-4904-9458-52a9e7c40993-etc-tuned\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.546400 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.492569 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5qtz\" (UniqueName: \"kubernetes.io/projected/ba071132-90b3-495e-974e-b39eb437b1e9-kube-api-access-r5qtz\") pod \"iptables-alerter-9s4l2\" (UID: \"ba071132-90b3-495e-974e-b39eb437b1e9\") " pod="openshift-network-operator/iptables-alerter-9s4l2" Jul 02 13:41:30.546400 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.492664 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d092476-9613-4e39-ab3b-9f2fdf62db80-agent-certs\") pod \"konnectivity-agent-lhrtf\" (UID: \"1d092476-9613-4e39-ab3b-9f2fdf62db80\") " pod="kube-system/konnectivity-agent-lhrtf" Jul 02 13:41:30.546400 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.492694 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vspl4\" (UniqueName: \"kubernetes.io/projected/9ee8265a-3e32-4a2c-8e3a-32863899271e-kube-api-access-vspl4\") pod \"aws-ebs-csi-driver-node-qqfpl\" (UID: \"9ee8265a-3e32-4a2c-8e3a-32863899271e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.546400 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.493064 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpsc5\" (UniqueName: \"kubernetes.io/projected/18745f0d-e7b8-4f0e-bfc8-021979556351-kube-api-access-qpsc5\") pod \"node-ca-jd9tr\" (UID: \"18745f0d-e7b8-4f0e-bfc8-021979556351\") " pod="openshift-image-registry/node-ca-jd9tr" Jul 02 13:41:30.546400 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.493451 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfgkv\" (UniqueName: \"kubernetes.io/projected/e68fa2ab-0d34-4558-94e4-277fb555cff1-kube-api-access-mfgkv\") pod \"ovnkube-node-l7fgt\" (UID: \"e68fa2ab-0d34-4558-94e4-277fb555cff1\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.546400 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.493965 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jd9tr" Jul 02 13:41:30.546400 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.495737 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7fn9\" (UniqueName: \"kubernetes.io/projected/cb20c425-42ed-4904-9458-52a9e7c40993-kube-api-access-l7fn9\") pod \"tuned-kpw4g\" (UID: \"cb20c425-42ed-4904-9458-52a9e7c40993\") " pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.546400 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.497848 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fncpx\" (UniqueName: \"kubernetes.io/projected/b559aa27-2922-474b-98e6-3a00eb31f57c-kube-api-access-fncpx\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:30.591202 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.590998 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5299a8ec-cec6-42be-bd4c-533005533331-cni-binary-copy\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591202 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591036 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/635ded76-12ca-4c08-9766-b4f11093f394-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.591202 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591064 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-var-lib-cni-multus\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591202 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591086 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61d94ef8-11f8-46ee-b67d-7aa90e074512-hosts-file\") pod \"node-resolver-7cf2b\" (UID: \"61d94ef8-11f8-46ee-b67d-7aa90e074512\") " pod="openshift-dns/node-resolver-7cf2b" Jul 02 13:41:30.591202 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591112 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-etc-kubernetes\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591202 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591137 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwrd8\" (UniqueName: \"kubernetes.io/projected/5299a8ec-cec6-42be-bd4c-533005533331-kube-api-access-xwrd8\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591202 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591153 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-var-lib-cni-multus\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591202 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-run-netns\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591231 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-run-netns\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591241 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-run-k8s-cni-cncf-io\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-hostroot\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591267 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61d94ef8-11f8-46ee-b67d-7aa90e074512-hosts-file\") pod \"node-resolver-7cf2b\" (UID: \"61d94ef8-11f8-46ee-b67d-7aa90e074512\") " pod="openshift-dns/node-resolver-7cf2b" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591293 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/635ded76-12ca-4c08-9766-b4f11093f394-os-release\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591333 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-etc-kubernetes\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591339 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-multus-conf-dir\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/635ded76-12ca-4c08-9766-b4f11093f394-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591373 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-hostroot\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591395 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdk67\" (UniqueName: \"kubernetes.io/projected/61d94ef8-11f8-46ee-b67d-7aa90e074512-kube-api-access-qdk67\") pod \"node-resolver-7cf2b\" (UID: \"61d94ef8-11f8-46ee-b67d-7aa90e074512\") " pod="openshift-dns/node-resolver-7cf2b" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-run-k8s-cni-cncf-io\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591422 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5299a8ec-cec6-42be-bd4c-533005533331-multus-daemon-config\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591445 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/635ded76-12ca-4c08-9766-b4f11093f394-system-cni-dir\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591455 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-multus-conf-dir\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591541 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/635ded76-12ca-4c08-9766-b4f11093f394-os-release\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591631 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/635ded76-12ca-4c08-9766-b4f11093f394-system-cni-dir\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.591696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591691 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-cnibin\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591721 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-multus-socket-dir-parent\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/635ded76-12ca-4c08-9766-b4f11093f394-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591740 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-cnibin\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591745 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-var-lib-kubelet\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591787 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5299a8ec-cec6-42be-bd4c-533005533331-cni-binary-copy\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591798 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-multus-socket-dir-parent\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-multus-cni-dir\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591865 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-run-multus-certs\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591892 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-multus-cni-dir\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591907 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-var-lib-kubelet\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591950 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/635ded76-12ca-4c08-9766-b4f11093f394-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591974 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-run-multus-certs\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.591979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/635ded76-12ca-4c08-9766-b4f11093f394-cnibin\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/635ded76-12ca-4c08-9766-b4f11093f394-cnibin\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592015 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/635ded76-12ca-4c08-9766-b4f11093f394-cni-binary-copy\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592042 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/635ded76-12ca-4c08-9766-b4f11093f394-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.592451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592065 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d94ef8-11f8-46ee-b67d-7aa90e074512-tmp-dir\") pod \"node-resolver-7cf2b\" (UID: \"61d94ef8-11f8-46ee-b67d-7aa90e074512\") " pod="openshift-dns/node-resolver-7cf2b" Jul 02 13:41:30.593018 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-var-lib-cni-bin\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.593018 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592135 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-system-cni-dir\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.593018 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrxs6\" (UniqueName: \"kubernetes.io/projected/635ded76-12ca-4c08-9766-b4f11093f394-kube-api-access-rrxs6\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.593018 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592178 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-host-var-lib-cni-bin\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.593018 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592205 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/635ded76-12ca-4c08-9766-b4f11093f394-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.593018 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592215 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-os-release\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.593018 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592240 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-system-cni-dir\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.593018 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592416 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d94ef8-11f8-46ee-b67d-7aa90e074512-tmp-dir\") pod \"node-resolver-7cf2b\" (UID: \"61d94ef8-11f8-46ee-b67d-7aa90e074512\") " pod="openshift-dns/node-resolver-7cf2b" Jul 02 13:41:30.593018 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5299a8ec-cec6-42be-bd4c-533005533331-os-release\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.593018 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592496 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/635ded76-12ca-4c08-9766-b4f11093f394-cni-binary-copy\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.593018 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.592632 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5299a8ec-cec6-42be-bd4c-533005533331-multus-daemon-config\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.601713 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.601687 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrxs6\" (UniqueName: \"kubernetes.io/projected/635ded76-12ca-4c08-9766-b4f11093f394-kube-api-access-rrxs6\") pod \"multus-additional-cni-plugins-9ddp8\" (UID: \"635ded76-12ca-4c08-9766-b4f11093f394\") " pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.601915 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.601897 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdk67\" (UniqueName: \"kubernetes.io/projected/61d94ef8-11f8-46ee-b67d-7aa90e074512-kube-api-access-qdk67\") pod \"node-resolver-7cf2b\" (UID: \"61d94ef8-11f8-46ee-b67d-7aa90e074512\") " pod="openshift-dns/node-resolver-7cf2b" Jul 02 13:41:30.602042 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.602026 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwrd8\" (UniqueName: \"kubernetes.io/projected/5299a8ec-cec6-42be-bd4c-533005533331-kube-api-access-xwrd8\") pod \"multus-596nb\" (UID: \"5299a8ec-cec6-42be-bd4c-533005533331\") " pod="openshift-multus/multus-596nb" Jul 02 13:41:30.685949 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:30.685907 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5269c938c5beed95562af588e625c306.slice/crio-edff48d492e546633394368c0c8a5e089e678e12eb811cb0be31cc129535ce7b WatchSource:0}: Error finding container edff48d492e546633394368c0c8a5e089e678e12eb811cb0be31cc129535ce7b: Status 404 returned error can't find the container with id edff48d492e546633394368c0c8a5e089e678e12eb811cb0be31cc129535ce7b Jul 02 13:41:30.686322 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:30.686295 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c61269dc44284c55ddf8a33477c594.slice/crio-e5d6cd55191ae060811a4227f019abee940d5a67d7bd8239c303f44de1547173 WatchSource:0}: Error finding container e5d6cd55191ae060811a4227f019abee940d5a67d7bd8239c303f44de1547173: Status 404 returned error can't find the container with id e5d6cd55191ae060811a4227f019abee940d5a67d7bd8239c303f44de1547173 Jul 02 13:41:30.688483 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.688463 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9s4l2" Jul 02 13:41:30.690519 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.690492 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 13:41:30.696332 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:30.696314 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba071132_90b3_495e_974e_b39eb437b1e9.slice/crio-82692bced78992fb2b6089d39b9993c1e90c98d602bda5e3bb8f484b6980de37 WatchSource:0}: Error finding container 82692bced78992fb2b6089d39b9993c1e90c98d602bda5e3bb8f484b6980de37: Status 404 returned error can't find the container with id 82692bced78992fb2b6089d39b9993c1e90c98d602bda5e3bb8f484b6980de37 Jul 02 13:41:30.711125 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.711101 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:30.718580 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:30.718538 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68fa2ab_0d34_4558_94e4_277fb555cff1.slice/crio-8b021400b4c474a723bba810217c3b125ab675fcd9a4f3e56832af2b285313e4 WatchSource:0}: Error finding container 8b021400b4c474a723bba810217c3b125ab675fcd9a4f3e56832af2b285313e4: Status 404 returned error can't find the container with id 8b021400b4c474a723bba810217c3b125ab675fcd9a4f3e56832af2b285313e4 Jul 02 13:41:30.733620 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.733597 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lhrtf" Jul 02 13:41:30.740603 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.740577 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" Jul 02 13:41:30.741783 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:30.741760 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d092476_9613_4e39_ab3b_9f2fdf62db80.slice/crio-f3cc82c57039ba6bbf6f36cd96eab2ce210332330addfa6f0307b2ca4fdf5f93 WatchSource:0}: Error finding container f3cc82c57039ba6bbf6f36cd96eab2ce210332330addfa6f0307b2ca4fdf5f93: Status 404 returned error can't find the container with id f3cc82c57039ba6bbf6f36cd96eab2ce210332330addfa6f0307b2ca4fdf5f93 Jul 02 13:41:30.749203 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:30.749181 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee8265a_3e32_4a2c_8e3a_32863899271e.slice/crio-2d1b6b2d6dd2f6bc6cac615f591ac6e94332a027f735c16494b9b928596e317d WatchSource:0}: Error finding container 2d1b6b2d6dd2f6bc6cac615f591ac6e94332a027f735c16494b9b928596e317d: Status 404 returned error can't find the container with id 2d1b6b2d6dd2f6bc6cac615f591ac6e94332a027f735c16494b9b928596e317d Jul 02 13:41:30.759403 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.759381 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" Jul 02 13:41:30.766211 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:30.766188 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb20c425_42ed_4904_9458_52a9e7c40993.slice/crio-7575ab43175d32f52d5b0e62e91e9d5f8ce0a4c7109cf26af9658beb9e9fdefd WatchSource:0}: Error finding container 7575ab43175d32f52d5b0e62e91e9d5f8ce0a4c7109cf26af9658beb9e9fdefd: Status 404 returned error can't find the container with id 7575ab43175d32f52d5b0e62e91e9d5f8ce0a4c7109cf26af9658beb9e9fdefd Jul 02 13:41:30.821572 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.821541 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-596nb" Jul 02 13:41:30.829085 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:30.829059 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5299a8ec_cec6_42be_bd4c_533005533331.slice/crio-7d33c7e24b41f2a15721770dad67e8fa7793406fbb29d7c7910e7203e67991c2 WatchSource:0}: Error finding container 7d33c7e24b41f2a15721770dad67e8fa7793406fbb29d7c7910e7203e67991c2: Status 404 returned error can't find the container with id 7d33c7e24b41f2a15721770dad67e8fa7793406fbb29d7c7910e7203e67991c2 Jul 02 13:41:30.852968 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.852891 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9ddp8" Jul 02 13:41:30.858153 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.858127 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7cf2b" Jul 02 13:41:30.861012 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:30.860985 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod635ded76_12ca_4c08_9766_b4f11093f394.slice/crio-a25abc6b22f1366e2c13c191e772a7b42148e3ac196f3afa22da69e60645568c WatchSource:0}: Error finding container a25abc6b22f1366e2c13c191e772a7b42148e3ac196f3afa22da69e60645568c: Status 404 returned error can't find the container with id a25abc6b22f1366e2c13c191e772a7b42148e3ac196f3afa22da69e60645568c Jul 02 13:41:30.865977 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:30.865956 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d94ef8_11f8_46ee_b67d_7aa90e074512.slice/crio-1b3cd569a329a34ee51f0a8f608b334902d9a1db67f0665e67f5e820b6f34c69 WatchSource:0}: Error finding container 1b3cd569a329a34ee51f0a8f608b334902d9a1db67f0665e67f5e820b6f34c69: Status 404 returned error can't find the container with id 1b3cd569a329a34ee51f0a8f608b334902d9a1db67f0665e67f5e820b6f34c69 Jul 02 13:41:30.996438 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.996395 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:30.996626 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.996455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v727\" (UniqueName: \"kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727\") pod \"network-check-target-kp57h\" (UID: \"cb257e85-b36f-4233-8e80-0fab80099be6\") " pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:30.996626 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:30.996496 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:30.996626 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.996545 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:41:30.996626 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.996582 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:41:30.996626 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.996616 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs podName:b559aa27-2922-474b-98e6-3a00eb31f57c nodeName:}" failed. No retries permitted until 2026-07-02 13:41:31.996599471 +0000 UTC m=+3.129491038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs") pod "network-metrics-daemon-v2d9m" (UID: "b559aa27-2922-474b-98e6-3a00eb31f57c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:41:30.996869 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.996632 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret podName:cd777315-3f9e-4c1d-bbeb-d9587d0e62b3 nodeName:}" failed. No retries permitted until 2026-07-02 13:41:31.996625009 +0000 UTC m=+3.129516554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret") pod "global-pull-secret-syncer-fkm9t" (UID: "cd777315-3f9e-4c1d-bbeb-d9587d0e62b3") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:41:30.996869 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.996639 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:41:30.996869 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.996660 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:41:30.996869 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.996674 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2v727 for pod openshift-network-diagnostics/network-check-target-kp57h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:41:30.996869 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:30.996744 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727 podName:cb257e85-b36f-4233-8e80-0fab80099be6 nodeName:}" failed. No retries permitted until 2026-07-02 13:41:31.996726537 +0000 UTC m=+3.129618105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2v727" (UniqueName: "kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727") pod "network-check-target-kp57h" (UID: "cb257e85-b36f-4233-8e80-0fab80099be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:41:31.122449 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.122377 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:41:31.134085 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:41:31.134047 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18745f0d_e7b8_4f0e_bfc8_021979556351.slice/crio-1350d80daa7f0c4a06d2529cc1887612a471c1dc5e88c65d11417b74c7d196ef WatchSource:0}: Error finding container 1350d80daa7f0c4a06d2529cc1887612a471c1dc5e88c65d11417b74c7d196ef: Status 404 returned error can't find the container with id 1350d80daa7f0c4a06d2529cc1887612a471c1dc5e88c65d11417b74c7d196ef Jul 02 13:41:31.414276 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.414192 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:41:31.419580 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.419504 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 13:36:30 +0000 UTC" deadline="2028-02-01 03:43:04.710304974 +0000 UTC" Jul 02 13:41:31.419580 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.419561 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13886h1m33.290748631s" Jul 02 13:41:31.474286 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.474256 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:31.475243 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:31.474400 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:31.503411 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.503245 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jd9tr" event={"ID":"18745f0d-e7b8-4f0e-bfc8-021979556351","Type":"ContainerStarted","Data":"1350d80daa7f0c4a06d2529cc1887612a471c1dc5e88c65d11417b74c7d196ef"} Jul 02 13:41:31.507797 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.507764 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ddp8" event={"ID":"635ded76-12ca-4c08-9766-b4f11093f394","Type":"ContainerStarted","Data":"a25abc6b22f1366e2c13c191e772a7b42148e3ac196f3afa22da69e60645568c"} Jul 02 13:41:31.542063 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.542025 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" event={"ID":"cb20c425-42ed-4904-9458-52a9e7c40993","Type":"ContainerStarted","Data":"7575ab43175d32f52d5b0e62e91e9d5f8ce0a4c7109cf26af9658beb9e9fdefd"} Jul 02 13:41:31.576081 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.576039 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" event={"ID":"9ee8265a-3e32-4a2c-8e3a-32863899271e","Type":"ContainerStarted","Data":"2d1b6b2d6dd2f6bc6cac615f591ac6e94332a027f735c16494b9b928596e317d"} Jul 02 13:41:31.583127 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.583082 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lhrtf" event={"ID":"1d092476-9613-4e39-ab3b-9f2fdf62db80","Type":"ContainerStarted","Data":"f3cc82c57039ba6bbf6f36cd96eab2ce210332330addfa6f0307b2ca4fdf5f93"} Jul 02 13:41:31.595649 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.595610 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" event={"ID":"e68fa2ab-0d34-4558-94e4-277fb555cff1","Type":"ContainerStarted","Data":"8b021400b4c474a723bba810217c3b125ab675fcd9a4f3e56832af2b285313e4"} Jul 02 13:41:31.613462 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.613422 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9s4l2" event={"ID":"ba071132-90b3-495e-974e-b39eb437b1e9","Type":"ContainerStarted","Data":"82692bced78992fb2b6089d39b9993c1e90c98d602bda5e3bb8f484b6980de37"} Jul 02 13:41:31.624229 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.624190 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7cf2b" event={"ID":"61d94ef8-11f8-46ee-b67d-7aa90e074512","Type":"ContainerStarted","Data":"1b3cd569a329a34ee51f0a8f608b334902d9a1db67f0665e67f5e820b6f34c69"} Jul 02 13:41:31.640735 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.640698 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-596nb" event={"ID":"5299a8ec-cec6-42be-bd4c-533005533331","Type":"ContainerStarted","Data":"7d33c7e24b41f2a15721770dad67e8fa7793406fbb29d7c7910e7203e67991c2"} Jul 02 13:41:31.658083 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.658044 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal" event={"ID":"29c61269dc44284c55ddf8a33477c594","Type":"ContainerStarted","Data":"e5d6cd55191ae060811a4227f019abee940d5a67d7bd8239c303f44de1547173"} Jul 02 13:41:31.688138 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.688048 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" event={"ID":"5269c938c5beed95562af588e625c306","Type":"ContainerStarted","Data":"edff48d492e546633394368c0c8a5e089e678e12eb811cb0be31cc129535ce7b"} Jul 02 13:41:31.821254 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:31.820775 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:41:32.006810 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:32.006718 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:32.006810 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:32.006787 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v727\" (UniqueName: \"kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727\") pod \"network-check-target-kp57h\" (UID: \"cb257e85-b36f-4233-8e80-0fab80099be6\") " pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:32.007088 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:32.006849 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:32.007088 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:32.006996 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:41:32.007088 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:32.007061 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret podName:cd777315-3f9e-4c1d-bbeb-d9587d0e62b3 nodeName:}" failed. No retries permitted until 2026-07-02 13:41:34.007043334 +0000 UTC m=+5.139934886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret") pod "global-pull-secret-syncer-fkm9t" (UID: "cd777315-3f9e-4c1d-bbeb-d9587d0e62b3") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:41:32.007521 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:32.007499 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:41:32.007599 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:32.007564 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs podName:b559aa27-2922-474b-98e6-3a00eb31f57c nodeName:}" failed. No retries permitted until 2026-07-02 13:41:34.007545986 +0000 UTC m=+5.140437533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs") pod "network-metrics-daemon-v2d9m" (UID: "b559aa27-2922-474b-98e6-3a00eb31f57c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:41:32.007671 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:32.007591 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:41:32.007671 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:32.007616 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:41:32.007671 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:32.007631 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2v727 for pod openshift-network-diagnostics/network-check-target-kp57h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:41:32.007827 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:32.007689 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727 podName:cb257e85-b36f-4233-8e80-0fab80099be6 nodeName:}" failed. No retries permitted until 2026-07-02 13:41:34.007671042 +0000 UTC m=+5.140562605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2v727" (UniqueName: "kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727") pod "network-check-target-kp57h" (UID: "cb257e85-b36f-4233-8e80-0fab80099be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:41:32.419808 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:32.419695 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 13:36:30 +0000 UTC" deadline="2028-04-07 13:24:26.232373252 +0000 UTC" Jul 02 13:41:32.419808 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:32.419760 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15479h42m53.812617451s" Jul 02 13:41:32.473558 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:32.473525 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:32.473753 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:32.473677 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:32.474327 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:32.474127 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:32.474327 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:32.474231 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:33.476151 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:33.476120 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:33.476608 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:33.476251 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:34.024771 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:34.024574 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:34.024771 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:34.024633 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:34.024771 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:34.024673 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v727\" (UniqueName: \"kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727\") pod \"network-check-target-kp57h\" (UID: \"cb257e85-b36f-4233-8e80-0fab80099be6\") " pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:34.025135 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:34.024850 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:41:34.025135 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:34.024869 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:41:34.025135 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:34.024881 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2v727 for pod openshift-network-diagnostics/network-check-target-kp57h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:41:34.025135 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:34.024944 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727 podName:cb257e85-b36f-4233-8e80-0fab80099be6 nodeName:}" failed. No retries permitted until 2026-07-02 13:41:38.024923291 +0000 UTC m=+9.157814856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2v727" (UniqueName: "kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727") pod "network-check-target-kp57h" (UID: "cb257e85-b36f-4233-8e80-0fab80099be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:41:34.025575 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:34.025445 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:41:34.025575 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:34.025504 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret podName:cd777315-3f9e-4c1d-bbeb-d9587d0e62b3 nodeName:}" failed. No retries permitted until 2026-07-02 13:41:38.025487383 +0000 UTC m=+9.158378943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret") pod "global-pull-secret-syncer-fkm9t" (UID: "cd777315-3f9e-4c1d-bbeb-d9587d0e62b3") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:41:34.025575 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:34.025566 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:41:34.025789 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:34.025601 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs podName:b559aa27-2922-474b-98e6-3a00eb31f57c nodeName:}" failed. No retries permitted until 2026-07-02 13:41:38.025588107 +0000 UTC m=+9.158479667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs") pod "network-metrics-daemon-v2d9m" (UID: "b559aa27-2922-474b-98e6-3a00eb31f57c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:41:34.473506 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:34.473424 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:34.473682 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:34.473579 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:34.474038 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:34.474015 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:34.474161 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:34.474137 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:35.474094 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:35.474058 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:35.474582 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:35.474206 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:36.473427 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:36.473393 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:36.473610 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:36.473538 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:36.473943 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:36.473902 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:36.474063 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:36.474036 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:37.474508 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:37.474430 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:37.474966 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:37.474525 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:38.059427 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:38.058811 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:38.059427 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:38.058870 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:38.059427 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:38.058908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v727\" (UniqueName: \"kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727\") pod \"network-check-target-kp57h\" (UID: \"cb257e85-b36f-4233-8e80-0fab80099be6\") " pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:38.059427 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:38.058931 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:41:38.059427 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:38.059011 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret podName:cd777315-3f9e-4c1d-bbeb-d9587d0e62b3 nodeName:}" failed. No retries permitted until 2026-07-02 13:41:46.058988381 +0000 UTC m=+17.191879938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret") pod "global-pull-secret-syncer-fkm9t" (UID: "cd777315-3f9e-4c1d-bbeb-d9587d0e62b3") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:41:38.059427 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:38.059074 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:41:38.059427 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:38.059094 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:41:38.059427 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:38.059107 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2v727 for pod openshift-network-diagnostics/network-check-target-kp57h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:41:38.059427 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:38.059155 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727 podName:cb257e85-b36f-4233-8e80-0fab80099be6 nodeName:}" failed. No retries permitted until 2026-07-02 13:41:46.059138122 +0000 UTC m=+17.192029671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2v727" (UniqueName: "kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727") pod "network-check-target-kp57h" (UID: "cb257e85-b36f-4233-8e80-0fab80099be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:41:38.059427 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:38.059215 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:41:38.059427 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:38.059248 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs podName:b559aa27-2922-474b-98e6-3a00eb31f57c nodeName:}" failed. No retries permitted until 2026-07-02 13:41:46.059235781 +0000 UTC m=+17.192127327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs") pod "network-metrics-daemon-v2d9m" (UID: "b559aa27-2922-474b-98e6-3a00eb31f57c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:41:38.473262 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:38.473187 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:38.473445 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:38.473324 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:38.473749 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:38.473729 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:38.473860 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:38.473841 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:39.473642 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:39.473607 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:39.474116 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:39.473727 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:40.473345 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:40.473311 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:40.473599 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:40.473456 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:40.473599 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:40.473512 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:40.474166 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:40.473644 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:41.473307 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:41.473274 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:41.473482 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:41.473385 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:42.473388 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:42.473356 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:42.473839 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:42.473470 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:42.473839 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:42.473543 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:42.473839 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:42.473680 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:43.473240 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:43.473202 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:43.473444 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:43.473324 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:44.473064 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:44.473033 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:44.473229 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:44.473165 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:44.473229 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:44.473216 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:44.473348 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:44.473317 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:45.473863 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:45.473636 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:45.474276 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:45.473988 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:46.115079 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:46.115033 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:46.115267 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:46.115093 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:46.115267 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:46.115134 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v727\" (UniqueName: \"kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727\") pod \"network-check-target-kp57h\" (UID: \"cb257e85-b36f-4233-8e80-0fab80099be6\") " pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:46.115267 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:46.115207 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:41:46.115267 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:46.115264 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:41:46.115465 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:46.115280 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:41:46.115465 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:46.115294 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2v727 for pod openshift-network-diagnostics/network-check-target-kp57h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:41:46.115465 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:46.115384 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:41:46.115465 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:46.115280 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret podName:cd777315-3f9e-4c1d-bbeb-d9587d0e62b3 nodeName:}" failed. No retries permitted until 2026-07-02 13:42:02.115258999 +0000 UTC m=+33.248150554 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret") pod "global-pull-secret-syncer-fkm9t" (UID: "cd777315-3f9e-4c1d-bbeb-d9587d0e62b3") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:41:46.115465 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:46.115425 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727 podName:cb257e85-b36f-4233-8e80-0fab80099be6 nodeName:}" failed. No retries permitted until 2026-07-02 13:42:02.115411097 +0000 UTC m=+33.248302646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2v727" (UniqueName: "kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727") pod "network-check-target-kp57h" (UID: "cb257e85-b36f-4233-8e80-0fab80099be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:41:46.115465 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:46.115441 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs podName:b559aa27-2922-474b-98e6-3a00eb31f57c nodeName:}" failed. No retries permitted until 2026-07-02 13:42:02.115431338 +0000 UTC m=+33.248322882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs") pod "network-metrics-daemon-v2d9m" (UID: "b559aa27-2922-474b-98e6-3a00eb31f57c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:41:46.473032 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:46.472943 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:46.473188 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:46.472950 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:46.473188 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:46.473045 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:46.473188 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:46.473150 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:47.472860 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:47.472823 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:47.473326 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:47.472968 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:48.473347 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:48.473311 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:48.473347 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:48.473346 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:48.473826 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:48.473466 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:48.473826 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:48.473594 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:49.475219 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:49.475183 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:49.476977 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:49.475832 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:50.473144 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:50.473108 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:50.473332 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:50.473120 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:50.473332 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:50.473224 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:50.473414 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:50.473334 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:51.472791 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:51.472756 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:51.473227 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:51.472891 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:51.744230 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:51.744155 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-596nb" event={"ID":"5299a8ec-cec6-42be-bd4c-533005533331","Type":"ContainerStarted","Data":"af8b7dceb101aa0db42f3396157a80c6e98e959a35b680889c7d379d1c935541"} Jul 02 13:41:51.747155 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:51.746713 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal" event={"ID":"29c61269dc44284c55ddf8a33477c594","Type":"ContainerStarted","Data":"83dbcb0a51c94911ca28cbeb2f412cac2be75f2a0ac417edc11b5d79a5fad64c"} Jul 02 13:41:51.759879 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:51.759850 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" event={"ID":"cb20c425-42ed-4904-9458-52a9e7c40993","Type":"ContainerStarted","Data":"c031e89afa20f92a61a66ece1cad64f8a4947e15124ae1a8f8b33cb29131a204"} Jul 02 13:41:51.768998 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:51.768944 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-596nb" podStartSLOduration=1.400626372 podStartE2EDuration="21.768913743s" totalImagesPullingTime="20.368287371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:41:51.767984595 +0000 UTC m=+22.900876160" watchObservedRunningTime="2026-07-02 13:41:51.768913743 +0000 UTC m=+22.901805310" Jul 02 13:41:51.787451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:51.787408 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kpw4g" podStartSLOduration=1.384965729 podStartE2EDuration="21.787393107s" totalImagesPullingTime="20.402427378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:41:51.786658023 +0000 UTC m=+22.919549589" watchObservedRunningTime="2026-07-02 13:41:51.787393107 +0000 UTC m=+22.920284672" Jul 02 13:41:51.803756 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:51.803704 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-54.ec2.internal" podStartSLOduration=21.803684721 podStartE2EDuration="21.803684721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:41:51.803457474 +0000 UTC m=+22.936349050" watchObservedRunningTime="2026-07-02 13:41:51.803684721 +0000 UTC m=+22.936576289" Jul 02 13:41:52.473752 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.473462 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:52.474407 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.473498 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:52.474407 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:52.473835 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:52.474407 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:52.473913 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:52.763129 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.763096 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jd9tr" event={"ID":"18745f0d-e7b8-4f0e-bfc8-021979556351","Type":"ContainerStarted","Data":"8499fe5bc1c7bdf8f2425f3180378a21d5cb7f0e0c0ff430bcfc7c4e837663bc"} Jul 02 13:41:52.764557 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.764533 2573 generic.go:356] "Generic (PLEG): container finished" podID="635ded76-12ca-4c08-9766-b4f11093f394" containerID="7c99548207bf920daee7279635ba69febfc3c0feeaa9c22e3be4307c930869c3" exitCode=0 Jul 02 13:41:52.764653 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.764596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ddp8" event={"ID":"635ded76-12ca-4c08-9766-b4f11093f394","Type":"ContainerDied","Data":"7c99548207bf920daee7279635ba69febfc3c0feeaa9c22e3be4307c930869c3"} Jul 02 13:41:52.766156 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.766135 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" event={"ID":"9ee8265a-3e32-4a2c-8e3a-32863899271e","Type":"ContainerStarted","Data":"c6d216cc6b4802f6058ecff996e4ab761f404c64692bbb4b068779e67e24aad2"} Jul 02 13:41:52.767541 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.767513 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lhrtf" event={"ID":"1d092476-9613-4e39-ab3b-9f2fdf62db80","Type":"ContainerStarted","Data":"7407623e7b71ff2ee542c69dafd4acf90492a06df8bd2c158dc01898eb0e335f"} Jul 02 13:41:52.770367 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.770342 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-acl-logging/0.log" Jul 02 13:41:52.770677 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.770659 2573 generic.go:356] "Generic (PLEG): container finished" podID="e68fa2ab-0d34-4558-94e4-277fb555cff1" containerID="bd38740fb6eb509881f8971d8640cad7c601f4a5d4044c5dd0c9c2ea53578cbd" exitCode=1 Jul 02 13:41:52.770748 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.770727 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" event={"ID":"e68fa2ab-0d34-4558-94e4-277fb555cff1","Type":"ContainerStarted","Data":"055d477b2296d6b4a274c1c8b8184d1b89514d391bbd37ecbc93246010751546"} Jul 02 13:41:52.770819 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.770803 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" event={"ID":"e68fa2ab-0d34-4558-94e4-277fb555cff1","Type":"ContainerStarted","Data":"6505794f17ec98ca76058e475bb83aa0862775b409892997373e029412f4f7d5"} Jul 02 13:41:52.770873 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.770860 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" event={"ID":"e68fa2ab-0d34-4558-94e4-277fb555cff1","Type":"ContainerStarted","Data":"62c057f75f86077691165eb5a1252ba58a3a7982c48878cb6e61dc7b60681f93"} Jul 02 13:41:52.770911 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.770903 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" event={"ID":"e68fa2ab-0d34-4558-94e4-277fb555cff1","Type":"ContainerStarted","Data":"367fadd3f503a855027c820721099ab2820b66bb01789b7633b8b521a4fc13d3"} Jul 02 13:41:52.770975 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.770959 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" event={"ID":"e68fa2ab-0d34-4558-94e4-277fb555cff1","Type":"ContainerDied","Data":"bd38740fb6eb509881f8971d8640cad7c601f4a5d4044c5dd0c9c2ea53578cbd"} Jul 02 13:41:52.771031 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.771000 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" event={"ID":"e68fa2ab-0d34-4558-94e4-277fb555cff1","Type":"ContainerStarted","Data":"319eb9edcd43160eef29bcd146caef795cc417be47dd8839e9fa9fb3c2fc8b13"} Jul 02 13:41:52.772538 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.772512 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9s4l2" event={"ID":"ba071132-90b3-495e-974e-b39eb437b1e9","Type":"ContainerStarted","Data":"30b9c863c93ba3257eb996459517ba80951d3f9939255b4a183d8f221531554d"} Jul 02 13:41:52.774536 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.774519 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7cf2b" event={"ID":"61d94ef8-11f8-46ee-b67d-7aa90e074512","Type":"ContainerStarted","Data":"60e9e954f713c3850ce7e011c53d36fbd8a5abd5e9e241dcfdcfb7565a7e2977"} Jul 02 13:41:52.775792 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.775772 2573 generic.go:356] "Generic (PLEG): container finished" podID="5269c938c5beed95562af588e625c306" containerID="3251c86d7c23489c1eabe0e1136972889a4b81058d8c566675fcea7340be44e4" exitCode=0 Jul 02 13:41:52.775888 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.775865 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" event={"ID":"5269c938c5beed95562af588e625c306","Type":"ContainerDied","Data":"3251c86d7c23489c1eabe0e1136972889a4b81058d8c566675fcea7340be44e4"} Jul 02 13:41:52.776792 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.776756 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jd9tr" podStartSLOduration=2.748360253 podStartE2EDuration="22.776744878s" totalImagesPullingTime="20.028384625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:41:52.776563897 +0000 UTC m=+23.909455463" watchObservedRunningTime="2026-07-02 13:41:52.776744878 +0000 UTC m=+23.909636442" Jul 02 13:41:52.790376 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.790344 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7cf2b" podStartSLOduration=2.531811772 podStartE2EDuration="22.790333645s" totalImagesPullingTime="20.258521873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:41:52.790022962 +0000 UTC m=+23.922914528" watchObservedRunningTime="2026-07-02 13:41:52.790333645 +0000 UTC m=+23.923225209" Jul 02 13:41:52.841641 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.841584 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9s4l2" podStartSLOduration=2.374794969 podStartE2EDuration="22.841566121s" totalImagesPullingTime="20.466771152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:41:52.841564404 +0000 UTC m=+23.974455973" watchObservedRunningTime="2026-07-02 13:41:52.841566121 +0000 UTC m=+23.974457687" Jul 02 13:41:52.856374 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:52.856336 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lhrtf" podStartSLOduration=2.473832713 podStartE2EDuration="22.856322416s" totalImagesPullingTime="20.382489703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:41:52.856160832 +0000 UTC m=+23.989052396" watchObservedRunningTime="2026-07-02 13:41:52.856322416 +0000 UTC m=+23.989213980" Jul 02 13:41:53.472971 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:53.472943 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:53.473175 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:53.473045 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:53.618558 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:53.618534 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 13:41:53.779994 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:53.779952 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" event={"ID":"5269c938c5beed95562af588e625c306","Type":"ContainerStarted","Data":"ca08842067be934a342c40e0b40e04a0bba7d88709e9c26a10e2375bcdbe6458"} Jul 02 13:41:53.782118 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:53.782092 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" event={"ID":"9ee8265a-3e32-4a2c-8e3a-32863899271e","Type":"ContainerStarted","Data":"011e4668aa126f2e7b2be205be94170439fb82cbadb38f96dcb17373ed370e10"} Jul 02 13:41:53.795036 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:53.794993 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-54.ec2.internal" podStartSLOduration=23.794980584 podStartE2EDuration="23.794980584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:41:53.794485784 +0000 UTC m=+24.927377348" watchObservedRunningTime="2026-07-02 13:41:53.794980584 +0000 UTC m=+24.927872149" Jul 02 13:41:54.473352 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:54.473243 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T13:41:53.618554872Z","UUID":"dcb9e7e2-ae6c-4479-9435-083b989043b0","Handler":null,"Name":"","Endpoint":""} Jul 02 13:41:54.473352 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:54.473341 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:54.473742 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:54.473460 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:54.473742 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:54.473462 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:54.473742 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:54.473567 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:54.476107 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:54.475720 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 13:41:54.476107 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:54.475762 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 13:41:54.787755 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:54.787729 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-acl-logging/0.log" Jul 02 13:41:54.788289 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:54.788260 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" event={"ID":"e68fa2ab-0d34-4558-94e4-277fb555cff1","Type":"ContainerStarted","Data":"4c72aaf5bcc4170ffa98027a2be4cca576e2ea8edf58fa4015f9ab18ad27a82d"} Jul 02 13:41:55.472771 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:55.472738 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:55.472961 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:55.472841 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:55.717314 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:55.717278 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lhrtf" Jul 02 13:41:55.718103 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:55.718084 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lhrtf" Jul 02 13:41:55.795372 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:55.795327 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" event={"ID":"9ee8265a-3e32-4a2c-8e3a-32863899271e","Type":"ContainerStarted","Data":"cae4e4f0601f7889d01017dab84f2dee63ad0bab9cf513ce54a8a1c0a70dc8ea"} Jul 02 13:41:55.815259 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:55.815215 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqfpl" podStartSLOduration=3.036527401 podStartE2EDuration="25.815202294s" totalImagesPullingTime="22.778674893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:41:55.814998824 +0000 UTC m=+26.947890414" watchObservedRunningTime="2026-07-02 13:41:55.815202294 +0000 UTC m=+26.948093856" Jul 02 13:41:56.473600 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:56.473563 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:56.473779 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:56.473577 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:56.473779 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:56.473689 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:56.473880 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:56.473803 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:57.473637 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:57.473483 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:57.474277 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:57.473707 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:57.801243 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:57.801213 2573 generic.go:356] "Generic (PLEG): container finished" podID="635ded76-12ca-4c08-9766-b4f11093f394" containerID="5d2c89b9b0df12ee78bdc370ccc98ef07f867440af16c55905faf33d4afa5c46" exitCode=0 Jul 02 13:41:57.801424 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:57.801304 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ddp8" event={"ID":"635ded76-12ca-4c08-9766-b4f11093f394","Type":"ContainerDied","Data":"5d2c89b9b0df12ee78bdc370ccc98ef07f867440af16c55905faf33d4afa5c46"} Jul 02 13:41:57.804651 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:57.804637 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-acl-logging/0.log" Jul 02 13:41:57.804991 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:57.804972 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" event={"ID":"e68fa2ab-0d34-4558-94e4-277fb555cff1","Type":"ContainerStarted","Data":"f7dd318587bd6bc320bf7f7c0486f449ca561d766f7997c88dffbfca3ae81c91"} Jul 02 13:41:57.805364 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:57.805345 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:57.805488 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:57.805474 2573 scope.go:117] "RemoveContainer" containerID="bd38740fb6eb509881f8971d8640cad7c601f4a5d4044c5dd0c9c2ea53578cbd" Jul 02 13:41:57.820614 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:57.820596 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:58.472825 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:58.472789 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:58.473063 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:58.472832 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:58.473063 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:58.472943 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:58.473149 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:58.473070 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:58.812899 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:58.812734 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-acl-logging/0.log" Jul 02 13:41:58.813305 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:58.813284 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" event={"ID":"e68fa2ab-0d34-4558-94e4-277fb555cff1","Type":"ContainerStarted","Data":"66e645651f88719d08e14018f2e2097ee712e00fc6f1e0f00bda6b57437fcc50"} Jul 02 13:41:58.813685 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:58.813668 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:58.813815 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:58.813803 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:58.828963 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:58.828940 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:41:58.844461 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:58.844419 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" podStartSLOduration=7.802692791 podStartE2EDuration="28.844404707s" totalImagesPullingTime="21.041711916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:41:58.844297196 +0000 UTC m=+29.977188752" watchObservedRunningTime="2026-07-02 13:41:58.844404707 +0000 UTC m=+29.977296271" Jul 02 13:41:59.028988 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:59.028964 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fkm9t"] Jul 02 13:41:59.029125 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:59.029060 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:41:59.029184 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:59.029152 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:41:59.032181 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:59.032158 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kp57h"] Jul 02 13:41:59.032290 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:59.032263 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:41:59.032363 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:59.032347 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:41:59.033085 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:59.033053 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v2d9m"] Jul 02 13:41:59.033199 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:59.033184 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:41:59.033318 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:41:59.033297 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:41:59.585002 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:59.584970 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lhrtf" Jul 02 13:41:59.585187 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:59.585133 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 13:41:59.585566 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:59.585547 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lhrtf" Jul 02 13:41:59.817058 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:59.817023 2573 generic.go:356] "Generic (PLEG): container finished" podID="635ded76-12ca-4c08-9766-b4f11093f394" containerID="710c6c4182c58d155c4533e11a9603cab5a307370a23468dcb61af23e58048ff" exitCode=0 Jul 02 13:41:59.817478 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:41:59.817108 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ddp8" event={"ID":"635ded76-12ca-4c08-9766-b4f11093f394","Type":"ContainerDied","Data":"710c6c4182c58d155c4533e11a9603cab5a307370a23468dcb61af23e58048ff"} Jul 02 13:42:00.472731 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:00.472701 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:42:00.472731 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:00.472723 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:42:00.472731 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:00.472707 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:42:00.473018 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:00.472808 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:42:00.473018 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:00.472987 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:42:00.473143 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:00.473117 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:42:01.823844 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:01.823808 2573 generic.go:356] "Generic (PLEG): container finished" podID="635ded76-12ca-4c08-9766-b4f11093f394" containerID="1bda78832791cce0693fa0f41d43bde5b38bbad1c30ec77e4b0ce68305348ec3" exitCode=0 Jul 02 13:42:01.824242 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:01.823869 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ddp8" event={"ID":"635ded76-12ca-4c08-9766-b4f11093f394","Type":"ContainerDied","Data":"1bda78832791cce0693fa0f41d43bde5b38bbad1c30ec77e4b0ce68305348ec3"} Jul 02 13:42:02.132490 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:02.132447 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:42:02.132490 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:02.132491 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:42:02.132696 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:02.132512 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v727\" (UniqueName: \"kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727\") pod \"network-check-target-kp57h\" (UID: \"cb257e85-b36f-4233-8e80-0fab80099be6\") " pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:42:02.132696 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:02.132605 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:42:02.132696 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:02.132677 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret podName:cd777315-3f9e-4c1d-bbeb-d9587d0e62b3 nodeName:}" failed. No retries permitted until 2026-07-02 13:42:34.132662292 +0000 UTC m=+65.265553835 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret") pod "global-pull-secret-syncer-fkm9t" (UID: "cd777315-3f9e-4c1d-bbeb-d9587d0e62b3") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:42:02.132696 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:02.132605 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:42:02.132826 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:02.132611 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:42:02.132826 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:02.132733 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs podName:b559aa27-2922-474b-98e6-3a00eb31f57c nodeName:}" failed. No retries permitted until 2026-07-02 13:42:34.132720419 +0000 UTC m=+65.265611962 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs") pod "network-metrics-daemon-v2d9m" (UID: "b559aa27-2922-474b-98e6-3a00eb31f57c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:42:02.132826 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:02.132742 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:42:02.132826 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:02.132758 2573 projected.go:196] Error preparing data for projected volume kube-api-access-2v727 for pod openshift-network-diagnostics/network-check-target-kp57h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:42:02.132826 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:02.132814 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727 podName:cb257e85-b36f-4233-8e80-0fab80099be6 nodeName:}" failed. No retries permitted until 2026-07-02 13:42:34.132801183 +0000 UTC m=+65.265692729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2v727" (UniqueName: "kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727") pod "network-check-target-kp57h" (UID: "cb257e85-b36f-4233-8e80-0fab80099be6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:42:02.473562 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:02.473485 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:42:02.473726 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:02.473604 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:42:02.473726 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:02.473617 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:42:02.473726 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:02.473642 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:42:02.473880 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:02.473752 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:42:02.473880 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:02.473838 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:42:04.473747 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.473504 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:42:04.474122 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.473525 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:42:04.474122 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:04.473785 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kp57h" podUID="cb257e85-b36f-4233-8e80-0fab80099be6" Jul 02 13:42:04.474122 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.473571 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:42:04.474122 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:04.473840 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fkm9t" podUID="cd777315-3f9e-4c1d-bbeb-d9587d0e62b3" Jul 02 13:42:04.474122 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:04.473965 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v2d9m" podUID="b559aa27-2922-474b-98e6-3a00eb31f57c" Jul 02 13:42:04.637607 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.637578 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-54.ec2.internal" event="NodeReady" Jul 02 13:42:04.637781 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.637719 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 13:42:04.675186 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.675153 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cd9854cdf-ddckm"] Jul 02 13:42:04.677951 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.677911 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.680569 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.680347 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 13:42:04.680569 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.680393 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4c92h\"" Jul 02 13:42:04.680569 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.680479 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 13:42:04.680806 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.680787 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 13:42:04.688948 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.688907 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 13:42:04.693527 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.693456 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l4hcx"] Jul 02 13:42:04.698867 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.698844 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cd9854cdf-ddckm"] Jul 02 13:42:04.699077 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.699057 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:04.699238 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.699218 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ct4b6"] Jul 02 13:42:04.701101 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.701087 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ct4b6" Jul 02 13:42:04.704222 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.703901 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jsckw\"" Jul 02 13:42:04.704222 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.703911 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 13:42:04.704222 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.703995 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6mf97\"" Jul 02 13:42:04.704222 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.704024 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 13:42:04.704222 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.704071 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 13:42:04.704222 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.704130 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 13:42:04.704222 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.704152 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 13:42:04.710206 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.710149 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l4hcx"] Jul 02 13:42:04.715322 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.715299 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ct4b6"] Jul 02 13:42:04.752794 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.752722 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-ca-trust-extracted\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.752794 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.752754 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-installation-pull-secrets\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.752794 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.752775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-image-registry-private-configuration\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.753096 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.752865 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-trusted-ca\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.753096 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.752903 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz8fk\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-kube-api-access-wz8fk\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.753096 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.752974 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.753096 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.752997 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-certificates\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.753096 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.753020 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-bound-sa-token\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.854017 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.853975 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-trusted-ca\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.854017 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854023 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz8fk\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-kube-api-access-wz8fk\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.854254 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.854254 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-certificates\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.854254 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854122 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-bound-sa-token\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.854254 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854172 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:04.854254 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854213 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/348180ec-a210-44a4-9b94-b14890b5869d-config-volume\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:04.854254 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:04.854223 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:42:04.854254 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854237 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/348180ec-a210-44a4-9b94-b14890b5869d-tmp-dir\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:04.854254 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:04.854245 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd9854cdf-ddckm: secret "image-registry-tls" not found Jul 02 13:42:04.854634 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-ca-trust-extracted\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.854634 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:04.854304 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls podName:5826ee61-33a5-4ecc-bbd0-c6703128c3e3 nodeName:}" failed. No retries permitted until 2026-07-02 13:42:05.3542832 +0000 UTC m=+36.487174757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls") pod "image-registry-6cd9854cdf-ddckm" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3") : secret "image-registry-tls" not found Jul 02 13:42:04.854634 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854327 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-installation-pull-secrets\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.854634 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-image-registry-private-configuration\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.854634 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb57b91a-b68a-45b7-a1d5-1c1aa3693765-cert\") pod \"ingress-canary-ct4b6\" (UID: \"bb57b91a-b68a-45b7-a1d5-1c1aa3693765\") " pod="openshift-ingress-canary/ingress-canary-ct4b6" Jul 02 13:42:04.854634 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854428 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8crvt\" (UniqueName: \"kubernetes.io/projected/bb57b91a-b68a-45b7-a1d5-1c1aa3693765-kube-api-access-8crvt\") pod \"ingress-canary-ct4b6\" (UID: \"bb57b91a-b68a-45b7-a1d5-1c1aa3693765\") " pod="openshift-ingress-canary/ingress-canary-ct4b6" Jul 02 13:42:04.854634 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854454 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpdwk\" (UniqueName: \"kubernetes.io/projected/348180ec-a210-44a4-9b94-b14890b5869d-kube-api-access-vpdwk\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:04.854957 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-ca-trust-extracted\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.854957 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.854775 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-certificates\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.855176 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.855129 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-trusted-ca\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.858778 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.858757 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-installation-pull-secrets\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.858778 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.858783 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-image-registry-private-configuration\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.866090 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.866067 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-bound-sa-token\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.866193 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.866101 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz8fk\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-kube-api-access-wz8fk\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:04.955263 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.955224 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:04.955451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.955278 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/348180ec-a210-44a4-9b94-b14890b5869d-config-volume\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:04.955451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.955303 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/348180ec-a210-44a4-9b94-b14890b5869d-tmp-dir\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:04.955451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.955331 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb57b91a-b68a-45b7-a1d5-1c1aa3693765-cert\") pod \"ingress-canary-ct4b6\" (UID: \"bb57b91a-b68a-45b7-a1d5-1c1aa3693765\") " pod="openshift-ingress-canary/ingress-canary-ct4b6" Jul 02 13:42:04.955451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.955347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8crvt\" (UniqueName: \"kubernetes.io/projected/bb57b91a-b68a-45b7-a1d5-1c1aa3693765-kube-api-access-8crvt\") pod \"ingress-canary-ct4b6\" (UID: \"bb57b91a-b68a-45b7-a1d5-1c1aa3693765\") " pod="openshift-ingress-canary/ingress-canary-ct4b6" Jul 02 13:42:04.955451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.955369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpdwk\" (UniqueName: \"kubernetes.io/projected/348180ec-a210-44a4-9b94-b14890b5869d-kube-api-access-vpdwk\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:04.955451 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:04.955411 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:42:04.955665 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:04.955482 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls podName:348180ec-a210-44a4-9b94-b14890b5869d nodeName:}" failed. No retries permitted until 2026-07-02 13:42:05.455464028 +0000 UTC m=+36.588355575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls") pod "dns-default-l4hcx" (UID: "348180ec-a210-44a4-9b94-b14890b5869d") : secret "dns-default-metrics-tls" not found Jul 02 13:42:04.955753 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.955735 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/348180ec-a210-44a4-9b94-b14890b5869d-tmp-dir\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:04.956005 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.955977 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/348180ec-a210-44a4-9b94-b14890b5869d-config-volume\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:04.958255 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.958233 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb57b91a-b68a-45b7-a1d5-1c1aa3693765-cert\") pod \"ingress-canary-ct4b6\" (UID: \"bb57b91a-b68a-45b7-a1d5-1c1aa3693765\") " pod="openshift-ingress-canary/ingress-canary-ct4b6" Jul 02 13:42:04.966562 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.966533 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpdwk\" (UniqueName: \"kubernetes.io/projected/348180ec-a210-44a4-9b94-b14890b5869d-kube-api-access-vpdwk\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:04.967000 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:04.966981 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8crvt\" (UniqueName: \"kubernetes.io/projected/bb57b91a-b68a-45b7-a1d5-1c1aa3693765-kube-api-access-8crvt\") pod \"ingress-canary-ct4b6\" (UID: \"bb57b91a-b68a-45b7-a1d5-1c1aa3693765\") " pod="openshift-ingress-canary/ingress-canary-ct4b6" Jul 02 13:42:05.017164 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:05.017089 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ct4b6" Jul 02 13:42:05.359539 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:05.359501 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:05.359698 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:05.359652 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:42:05.359698 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:05.359665 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd9854cdf-ddckm: secret "image-registry-tls" not found Jul 02 13:42:05.359809 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:05.359726 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls podName:5826ee61-33a5-4ecc-bbd0-c6703128c3e3 nodeName:}" failed. No retries permitted until 2026-07-02 13:42:06.35970621 +0000 UTC m=+37.492597775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls") pod "image-registry-6cd9854cdf-ddckm" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3") : secret "image-registry-tls" not found Jul 02 13:42:05.460123 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:05.460086 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:05.460296 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:05.460250 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:42:05.460340 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:05.460319 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls podName:348180ec-a210-44a4-9b94-b14890b5869d nodeName:}" failed. No retries permitted until 2026-07-02 13:42:06.460298401 +0000 UTC m=+37.593189944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls") pod "dns-default-l4hcx" (UID: "348180ec-a210-44a4-9b94-b14890b5869d") : secret "dns-default-metrics-tls" not found Jul 02 13:42:06.069180 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.069059 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ct4b6"] Jul 02 13:42:06.071984 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:06.071905 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb57b91a_b68a_45b7_a1d5_1c1aa3693765.slice/crio-091985478a1b34ce40f4e5b218736f584a3049cc869576306c24f05633775c3f WatchSource:0}: Error finding container 091985478a1b34ce40f4e5b218736f584a3049cc869576306c24f05633775c3f: Status 404 returned error can't find the container with id 091985478a1b34ce40f4e5b218736f584a3049cc869576306c24f05633775c3f Jul 02 13:42:06.212173 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.212073 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-62ndc"] Jul 02 13:42:06.213853 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.213833 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" Jul 02 13:42:06.216279 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.216259 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 02 13:42:06.216279 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.216269 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 02 13:42:06.216442 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.216259 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 02 13:42:06.217141 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.217126 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-m8vxs\"" Jul 02 13:42:06.217183 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.217143 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 02 13:42:06.222826 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.222806 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-62ndc"] Jul 02 13:42:06.366901 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.366867 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:06.367110 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.366912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h8nb\" (UniqueName: \"kubernetes.io/projected/6f85dcd9-d3b8-477f-a71d-609c70fe4042-kube-api-access-7h8nb\") pod \"service-ca-7bb4f4bcc7-62ndc\" (UID: \"6f85dcd9-d3b8-477f-a71d-609c70fe4042\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" Jul 02 13:42:06.367110 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.367005 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6f85dcd9-d3b8-477f-a71d-609c70fe4042-signing-key\") pod \"service-ca-7bb4f4bcc7-62ndc\" (UID: \"6f85dcd9-d3b8-477f-a71d-609c70fe4042\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" Jul 02 13:42:06.367110 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.367033 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6f85dcd9-d3b8-477f-a71d-609c70fe4042-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-62ndc\" (UID: \"6f85dcd9-d3b8-477f-a71d-609c70fe4042\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" Jul 02 13:42:06.367110 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:06.367042 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:42:06.367110 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:06.367058 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd9854cdf-ddckm: secret "image-registry-tls" not found Jul 02 13:42:06.367110 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:06.367107 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls podName:5826ee61-33a5-4ecc-bbd0-c6703128c3e3 nodeName:}" failed. No retries permitted until 2026-07-02 13:42:08.367093809 +0000 UTC m=+39.499985352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls") pod "image-registry-6cd9854cdf-ddckm" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3") : secret "image-registry-tls" not found Jul 02 13:42:06.467955 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.467874 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6f85dcd9-d3b8-477f-a71d-609c70fe4042-signing-key\") pod \"service-ca-7bb4f4bcc7-62ndc\" (UID: \"6f85dcd9-d3b8-477f-a71d-609c70fe4042\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" Jul 02 13:42:06.467955 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.467936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6f85dcd9-d3b8-477f-a71d-609c70fe4042-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-62ndc\" (UID: \"6f85dcd9-d3b8-477f-a71d-609c70fe4042\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" Jul 02 13:42:06.468061 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.468023 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h8nb\" (UniqueName: \"kubernetes.io/projected/6f85dcd9-d3b8-477f-a71d-609c70fe4042-kube-api-access-7h8nb\") pod \"service-ca-7bb4f4bcc7-62ndc\" (UID: \"6f85dcd9-d3b8-477f-a71d-609c70fe4042\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" Jul 02 13:42:06.468103 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.468072 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:06.468205 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:06.468188 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:42:06.468268 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:06.468257 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls podName:348180ec-a210-44a4-9b94-b14890b5869d nodeName:}" failed. No retries permitted until 2026-07-02 13:42:08.468238597 +0000 UTC m=+39.601130140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls") pod "dns-default-l4hcx" (UID: "348180ec-a210-44a4-9b94-b14890b5869d") : secret "dns-default-metrics-tls" not found Jul 02 13:42:06.468521 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.468504 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6f85dcd9-d3b8-477f-a71d-609c70fe4042-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-62ndc\" (UID: \"6f85dcd9-d3b8-477f-a71d-609c70fe4042\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" Jul 02 13:42:06.470958 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.470942 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6f85dcd9-d3b8-477f-a71d-609c70fe4042-signing-key\") pod \"service-ca-7bb4f4bcc7-62ndc\" (UID: \"6f85dcd9-d3b8-477f-a71d-609c70fe4042\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" Jul 02 13:42:06.472884 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.472871 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:42:06.472945 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.472896 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:42:06.472985 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.472963 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:42:06.475337 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.475310 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 13:42:06.475337 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.475318 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bhzn5\"" Jul 02 13:42:06.475337 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.475306 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 13:42:06.475555 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.475312 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 13:42:06.475555 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.475403 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tz79z\"" Jul 02 13:42:06.475686 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.475672 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 13:42:06.480147 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.480129 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h8nb\" (UniqueName: \"kubernetes.io/projected/6f85dcd9-d3b8-477f-a71d-609c70fe4042-kube-api-access-7h8nb\") pod \"service-ca-7bb4f4bcc7-62ndc\" (UID: \"6f85dcd9-d3b8-477f-a71d-609c70fe4042\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" Jul 02 13:42:06.522917 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.522889 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" Jul 02 13:42:06.641362 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.641329 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-62ndc"] Jul 02 13:42:06.645079 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:06.645056 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f85dcd9_d3b8_477f_a71d_609c70fe4042.slice/crio-94e1a4f2be4af394c1acc6366b880fe7ab8e063f94e99955f00c98b01e7dfdf2 WatchSource:0}: Error finding container 94e1a4f2be4af394c1acc6366b880fe7ab8e063f94e99955f00c98b01e7dfdf2: Status 404 returned error can't find the container with id 94e1a4f2be4af394c1acc6366b880fe7ab8e063f94e99955f00c98b01e7dfdf2 Jul 02 13:42:06.836984 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.836955 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" event={"ID":"6f85dcd9-d3b8-477f-a71d-609c70fe4042","Type":"ContainerStarted","Data":"94e1a4f2be4af394c1acc6366b880fe7ab8e063f94e99955f00c98b01e7dfdf2"} Jul 02 13:42:06.838042 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.838016 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ct4b6" event={"ID":"bb57b91a-b68a-45b7-a1d5-1c1aa3693765","Type":"ContainerStarted","Data":"091985478a1b34ce40f4e5b218736f584a3049cc869576306c24f05633775c3f"} Jul 02 13:42:06.840688 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.840663 2573 generic.go:356] "Generic (PLEG): container finished" podID="635ded76-12ca-4c08-9766-b4f11093f394" containerID="9a95e8cb3d47d3e6be2447046a34ccf2d6c5630feee3ab04ade90b6add0e93a5" exitCode=0 Jul 02 13:42:06.840755 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:06.840692 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ddp8" event={"ID":"635ded76-12ca-4c08-9766-b4f11093f394","Type":"ContainerDied","Data":"9a95e8cb3d47d3e6be2447046a34ccf2d6c5630feee3ab04ade90b6add0e93a5"} Jul 02 13:42:07.848551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:07.848510 2573 generic.go:356] "Generic (PLEG): container finished" podID="635ded76-12ca-4c08-9766-b4f11093f394" containerID="6a905264f36480561d170ebe25b59316c4a667be03ad2dd42ada802d8697bc65" exitCode=0 Jul 02 13:42:07.849047 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:07.848586 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ddp8" event={"ID":"635ded76-12ca-4c08-9766-b4f11093f394","Type":"ContainerDied","Data":"6a905264f36480561d170ebe25b59316c4a667be03ad2dd42ada802d8697bc65"} Jul 02 13:42:08.390794 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:08.390609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:08.390997 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:08.390776 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:42:08.390997 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:08.390858 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd9854cdf-ddckm: secret "image-registry-tls" not found Jul 02 13:42:08.390997 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:08.390938 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls podName:5826ee61-33a5-4ecc-bbd0-c6703128c3e3 nodeName:}" failed. No retries permitted until 2026-07-02 13:42:12.390901667 +0000 UTC m=+43.523793227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls") pod "image-registry-6cd9854cdf-ddckm" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3") : secret "image-registry-tls" not found Jul 02 13:42:08.491611 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:08.491575 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:08.491780 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:08.491745 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:42:08.491833 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:08.491823 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls podName:348180ec-a210-44a4-9b94-b14890b5869d nodeName:}" failed. No retries permitted until 2026-07-02 13:42:12.49180233 +0000 UTC m=+43.624693878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls") pod "dns-default-l4hcx" (UID: "348180ec-a210-44a4-9b94-b14890b5869d") : secret "dns-default-metrics-tls" not found Jul 02 13:42:08.854848 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:08.854816 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9ddp8" event={"ID":"635ded76-12ca-4c08-9766-b4f11093f394","Type":"ContainerStarted","Data":"38a5dd43fc68ddd5d5145f8548f91b91a7bbe8b59b4a37e90783f202ff8467cf"} Jul 02 13:42:08.883792 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:08.883737 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9ddp8" podStartSLOduration=7.564062349 podStartE2EDuration="38.883722348s" totalImagesPullingTime="31.319659999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:08.882819206 +0000 UTC m=+40.015710772" watchObservedRunningTime="2026-07-02 13:42:08.883722348 +0000 UTC m=+40.016613912" Jul 02 13:42:09.858434 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:09.858329 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" event={"ID":"6f85dcd9-d3b8-477f-a71d-609c70fe4042","Type":"ContainerStarted","Data":"4cb0df9fc49be17acb78fb0e7f2bb9b49ff0bafec961629248db116b496a9463"} Jul 02 13:42:09.860182 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:09.860155 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ct4b6" event={"ID":"bb57b91a-b68a-45b7-a1d5-1c1aa3693765","Type":"ContainerStarted","Data":"910b3a25d344a1e56ffdc1086bee93e9ce9ab983c65a294533774480c477495e"} Jul 02 13:42:09.877675 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:09.877629 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-62ndc" podStartSLOduration=0.919295887 podStartE2EDuration="3.877616008s" totalImagesPullingTime="2.958320121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:09.876737846 +0000 UTC m=+41.009629425" watchObservedRunningTime="2026-07-02 13:42:09.877616008 +0000 UTC m=+41.010507552" Jul 02 13:42:09.893263 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:09.893219 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ct4b6" podStartSLOduration=2.367495979 podStartE2EDuration="5.893204204s" totalImagesPullingTime="3.525708225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:09.892375918 +0000 UTC m=+41.025267484" watchObservedRunningTime="2026-07-02 13:42:09.893204204 +0000 UTC m=+41.026095768" Jul 02 13:42:12.423748 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:12.423706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:12.424214 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:12.423827 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:42:12.424214 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:12.423840 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd9854cdf-ddckm: secret "image-registry-tls" not found Jul 02 13:42:12.424214 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:12.423890 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls podName:5826ee61-33a5-4ecc-bbd0-c6703128c3e3 nodeName:}" failed. No retries permitted until 2026-07-02 13:42:20.423875999 +0000 UTC m=+51.556767555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls") pod "image-registry-6cd9854cdf-ddckm" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3") : secret "image-registry-tls" not found Jul 02 13:42:12.525001 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:12.524966 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:12.525168 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:12.525146 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:42:12.525240 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:12.525229 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls podName:348180ec-a210-44a4-9b94-b14890b5869d nodeName:}" failed. No retries permitted until 2026-07-02 13:42:20.525207418 +0000 UTC m=+51.658098963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls") pod "dns-default-l4hcx" (UID: "348180ec-a210-44a4-9b94-b14890b5869d") : secret "dns-default-metrics-tls" not found Jul 02 13:42:20.486880 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.486841 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:20.490406 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.490380 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls\") pod \"image-registry-6cd9854cdf-ddckm\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:20.587725 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.587692 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:20.589193 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.589162 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:20.589981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.589960 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/348180ec-a210-44a4-9b94-b14890b5869d-metrics-tls\") pod \"dns-default-l4hcx\" (UID: \"348180ec-a210-44a4-9b94-b14890b5869d\") " pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:20.611075 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.611025 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:20.755474 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.755402 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cd9854cdf-ddckm"] Jul 02 13:42:20.758435 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:20.758404 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5826ee61_33a5_4ecc_bbd0_c6703128c3e3.slice/crio-9859b38364d262ba32e87089e1e0e7ff94879d9f8eda5ecf48a6078c728bd267 WatchSource:0}: Error finding container 9859b38364d262ba32e87089e1e0e7ff94879d9f8eda5ecf48a6078c728bd267: Status 404 returned error can't find the container with id 9859b38364d262ba32e87089e1e0e7ff94879d9f8eda5ecf48a6078c728bd267 Jul 02 13:42:20.775646 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.775623 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l4hcx"] Jul 02 13:42:20.778669 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:20.778645 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348180ec_a210_44a4_9b94_b14890b5869d.slice/crio-0e1d236e2c66f63301e71e375cc3d114985a8964826cd1aa489e81008bd03621 WatchSource:0}: Error finding container 0e1d236e2c66f63301e71e375cc3d114985a8964826cd1aa489e81008bd03621: Status 404 returned error can't find the container with id 0e1d236e2c66f63301e71e375cc3d114985a8964826cd1aa489e81008bd03621 Jul 02 13:42:20.889574 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.889545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l4hcx" event={"ID":"348180ec-a210-44a4-9b94-b14890b5869d","Type":"ContainerStarted","Data":"0e1d236e2c66f63301e71e375cc3d114985a8964826cd1aa489e81008bd03621"} Jul 02 13:42:20.890997 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.890974 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" event={"ID":"5826ee61-33a5-4ecc-bbd0-c6703128c3e3","Type":"ContainerStarted","Data":"90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed"} Jul 02 13:42:20.891097 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.891010 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" event={"ID":"5826ee61-33a5-4ecc-bbd0-c6703128c3e3","Type":"ContainerStarted","Data":"9859b38364d262ba32e87089e1e0e7ff94879d9f8eda5ecf48a6078c728bd267"} Jul 02 13:42:20.891144 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.891105 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:20.911431 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:20.911301 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" podStartSLOduration=56.911280181 podStartE2EDuration="56.911280181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:20.910744787 +0000 UTC m=+52.043636352" watchObservedRunningTime="2026-07-02 13:42:20.911280181 +0000 UTC m=+52.044171747" Jul 02 13:42:23.901319 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:23.901279 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l4hcx" event={"ID":"348180ec-a210-44a4-9b94-b14890b5869d","Type":"ContainerStarted","Data":"cba5c90befd258e2a323651b5b3341a4d4a7ab2a6f669ab06c5982bf7b2dcd66"} Jul 02 13:42:23.901729 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:23.901356 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l4hcx" event={"ID":"348180ec-a210-44a4-9b94-b14890b5869d","Type":"ContainerStarted","Data":"1c461d74e3cd5ea6655d2102f6b6b7f47657def8f05a0856c32c0b7522e597eb"} Jul 02 13:42:23.901729 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:23.901414 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:23.919702 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:23.919657 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l4hcx" podStartSLOduration=17.821946666 podStartE2EDuration="19.919644385s" totalImagesPullingTime="2.097697719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:23.918521204 +0000 UTC m=+55.051412769" watchObservedRunningTime="2026-07-02 13:42:23.919644385 +0000 UTC m=+55.052535950" Jul 02 13:42:28.201942 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.201896 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-n66cn"] Jul 02 13:42:28.204740 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.204719 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.208602 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.208574 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 13:42:28.208602 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.208580 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 13:42:28.211830 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.211531 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-l8bx9\"" Jul 02 13:42:28.214157 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.214138 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 13:42:28.214320 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.214158 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 13:42:28.218545 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.217214 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-4w7mc"] Jul 02 13:42:28.219865 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.219700 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.231315 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.231290 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 13:42:28.231464 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.231400 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jx8rv\"" Jul 02 13:42:28.232245 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.232225 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-774678d5c-9htqr"] Jul 02 13:42:28.232352 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.232335 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:42:28.232539 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.232515 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 13:42:28.232632 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.232547 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 13:42:28.233969 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.233951 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.235300 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.235279 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 13:42:28.236280 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.236265 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 13:42:28.236886 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.236860 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 13:42:28.237967 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.237945 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-n66cn"] Jul 02 13:42:28.238246 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.238227 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 13:42:28.238331 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.238284 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 13:42:28.238385 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.238334 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 13:42:28.238446 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.238435 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 13:42:28.238585 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.238572 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5gtv7\"" Jul 02 13:42:28.241217 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.241198 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 13:42:28.246268 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.246248 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-4w7mc"] Jul 02 13:42:28.247517 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.247495 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e017484a-637e-493c-a1fe-b100d1cb714e-tmp\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.247653 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.247621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e017484a-637e-493c-a1fe-b100d1cb714e-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.247760 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.247691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e017484a-637e-493c-a1fe-b100d1cb714e-service-ca-bundle\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.247760 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.247740 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-672bv\" (UniqueName: \"kubernetes.io/projected/e017484a-637e-493c-a1fe-b100d1cb714e-kube-api-access-672bv\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.247904 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.247767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f4c6208-f2de-43e2-9665-ed4538a8f71f-serving-cert\") pod \"console-operator-7fdbdf9c99-4w7mc\" (UID: \"6f4c6208-f2de-43e2-9665-ed4538a8f71f\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.247904 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.247830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e017484a-637e-493c-a1fe-b100d1cb714e-serving-cert\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.247904 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.247860 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cmk6\" (UniqueName: \"kubernetes.io/projected/6f4c6208-f2de-43e2-9665-ed4538a8f71f-kube-api-access-6cmk6\") pod \"console-operator-7fdbdf9c99-4w7mc\" (UID: \"6f4c6208-f2de-43e2-9665-ed4538a8f71f\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.247904 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.247888 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f4c6208-f2de-43e2-9665-ed4538a8f71f-trusted-ca\") pod \"console-operator-7fdbdf9c99-4w7mc\" (UID: \"6f4c6208-f2de-43e2-9665-ed4538a8f71f\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.248080 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.247916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e017484a-637e-493c-a1fe-b100d1cb714e-snapshots\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.248080 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.247956 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f4c6208-f2de-43e2-9665-ed4538a8f71f-config\") pod \"console-operator-7fdbdf9c99-4w7mc\" (UID: \"6f4c6208-f2de-43e2-9665-ed4538a8f71f\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.253185 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.253164 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cd9854cdf-ddckm"] Jul 02 13:42:28.259557 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.259533 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-774678d5c-9htqr"] Jul 02 13:42:28.260161 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.260140 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p"] Jul 02 13:42:28.262051 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.262032 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm"] Jul 02 13:42:28.262199 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.262172 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:28.263975 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.263958 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm" Jul 02 13:42:28.265227 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.265207 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 13:42:28.265594 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.265580 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 02 13:42:28.265691 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.265674 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 13:42:28.266160 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.266124 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 13:42:28.267784 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.267768 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pmghc\"" Jul 02 13:42:28.269231 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.269212 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 02 13:42:28.277720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.277700 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p"] Jul 02 13:42:28.278699 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.278637 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm"] Jul 02 13:42:28.284863 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.284844 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-z5b5x"] Jul 02 13:42:28.286664 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.286640 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-z5b5x" Jul 02 13:42:28.288753 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.288735 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:42:28.289047 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.289032 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 13:42:28.289186 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.289167 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5ngrp\"" Jul 02 13:42:28.305111 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.305087 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-z5b5x"] Jul 02 13:42:28.349264 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349232 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sjb9\" (UniqueName: \"kubernetes.io/projected/a784b7d5-f532-42b7-ab59-b56969969a51-kube-api-access-7sjb9\") pod \"managed-serviceaccount-addon-agent-6467458d8b-87qdm\" (UID: \"a784b7d5-f532-42b7-ab59-b56969969a51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm" Jul 02 13:42:28.349264 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349265 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-metrics-certs\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.349529 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349291 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7c679115-eb88-4a41-96fd-c450f9446448-klusterlet-config\") pod \"klusterlet-addon-workmgr-69cd76cd46-bkn8p\" (UID: \"7c679115-eb88-4a41-96fd-c450f9446448\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:28.349529 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-stats-auth\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.349529 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349367 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e017484a-637e-493c-a1fe-b100d1cb714e-tmp\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.349529 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvzqs\" (UniqueName: \"kubernetes.io/projected/7c679115-eb88-4a41-96fd-c450f9446448-kube-api-access-zvzqs\") pod \"klusterlet-addon-workmgr-69cd76cd46-bkn8p\" (UID: \"7c679115-eb88-4a41-96fd-c450f9446448\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:28.349529 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349495 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c679115-eb88-4a41-96fd-c450f9446448-tmp\") pod \"klusterlet-addon-workmgr-69cd76cd46-bkn8p\" (UID: \"7c679115-eb88-4a41-96fd-c450f9446448\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:28.349811 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349569 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e017484a-637e-493c-a1fe-b100d1cb714e-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.349811 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e017484a-637e-493c-a1fe-b100d1cb714e-service-ca-bundle\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.349811 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349631 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-672bv\" (UniqueName: \"kubernetes.io/projected/e017484a-637e-493c-a1fe-b100d1cb714e-kube-api-access-672bv\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.349811 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349657 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f4c6208-f2de-43e2-9665-ed4538a8f71f-serving-cert\") pod \"console-operator-7fdbdf9c99-4w7mc\" (UID: \"6f4c6208-f2de-43e2-9665-ed4538a8f71f\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.349811 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349689 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e017484a-637e-493c-a1fe-b100d1cb714e-serving-cert\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.349811 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349716 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzvjn\" (UniqueName: \"kubernetes.io/projected/2c665df0-af24-4518-ae1f-2b92507881cb-kube-api-access-xzvjn\") pod \"volume-data-source-validator-69d9f679db-z5b5x\" (UID: \"2c665df0-af24-4518-ae1f-2b92507881cb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-z5b5x" Jul 02 13:42:28.349811 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349746 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cmk6\" (UniqueName: \"kubernetes.io/projected/6f4c6208-f2de-43e2-9665-ed4538a8f71f-kube-api-access-6cmk6\") pod \"console-operator-7fdbdf9c99-4w7mc\" (UID: \"6f4c6208-f2de-43e2-9665-ed4538a8f71f\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.349811 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349771 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-default-certificate\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.349811 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349782 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e017484a-637e-493c-a1fe-b100d1cb714e-tmp\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.349811 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349794 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-service-ca-bundle\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.350294 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349837 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f4c6208-f2de-43e2-9665-ed4538a8f71f-trusted-ca\") pod \"console-operator-7fdbdf9c99-4w7mc\" (UID: \"6f4c6208-f2de-43e2-9665-ed4538a8f71f\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.350294 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349873 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a784b7d5-f532-42b7-ab59-b56969969a51-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6467458d8b-87qdm\" (UID: \"a784b7d5-f532-42b7-ab59-b56969969a51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm" Jul 02 13:42:28.350294 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349903 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpnqt\" (UniqueName: \"kubernetes.io/projected/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-kube-api-access-lpnqt\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.350294 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.349972 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e017484a-637e-493c-a1fe-b100d1cb714e-snapshots\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.350294 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.350000 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f4c6208-f2de-43e2-9665-ed4538a8f71f-config\") pod \"console-operator-7fdbdf9c99-4w7mc\" (UID: \"6f4c6208-f2de-43e2-9665-ed4538a8f71f\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.350575 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.350555 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e017484a-637e-493c-a1fe-b100d1cb714e-service-ca-bundle\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.350700 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.350677 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e017484a-637e-493c-a1fe-b100d1cb714e-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.350738 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.350686 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f4c6208-f2de-43e2-9665-ed4538a8f71f-trusted-ca\") pod \"console-operator-7fdbdf9c99-4w7mc\" (UID: \"6f4c6208-f2de-43e2-9665-ed4538a8f71f\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.350788 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.350770 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f4c6208-f2de-43e2-9665-ed4538a8f71f-config\") pod \"console-operator-7fdbdf9c99-4w7mc\" (UID: \"6f4c6208-f2de-43e2-9665-ed4538a8f71f\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.351264 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.351244 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e017484a-637e-493c-a1fe-b100d1cb714e-snapshots\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.352939 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.352910 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e017484a-637e-493c-a1fe-b100d1cb714e-serving-cert\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.353064 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.352978 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f4c6208-f2de-43e2-9665-ed4538a8f71f-serving-cert\") pod \"console-operator-7fdbdf9c99-4w7mc\" (UID: \"6f4c6208-f2de-43e2-9665-ed4538a8f71f\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.367720 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.367693 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-672bv\" (UniqueName: \"kubernetes.io/projected/e017484a-637e-493c-a1fe-b100d1cb714e-kube-api-access-672bv\") pod \"insights-operator-5f67b55555-n66cn\" (UID: \"e017484a-637e-493c-a1fe-b100d1cb714e\") " pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.371318 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.371294 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cmk6\" (UniqueName: \"kubernetes.io/projected/6f4c6208-f2de-43e2-9665-ed4538a8f71f-kube-api-access-6cmk6\") pod \"console-operator-7fdbdf9c99-4w7mc\" (UID: \"6f4c6208-f2de-43e2-9665-ed4538a8f71f\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.374379 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.374356 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b"] Jul 02 13:42:28.377176 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.377155 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b" Jul 02 13:42:28.378916 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.378896 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b7f449549-z6tw8"] Jul 02 13:42:28.379575 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.379556 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 13:42:28.379789 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.379775 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 13:42:28.379990 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.379971 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:42:28.380432 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.380414 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4slr8\"" Jul 02 13:42:28.380679 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.380660 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.399115 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.399090 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b"] Jul 02 13:42:28.404807 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.404788 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b7f449549-z6tw8"] Jul 02 13:42:28.451058 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451026 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvzqs\" (UniqueName: \"kubernetes.io/projected/7c679115-eb88-4a41-96fd-c450f9446448-kube-api-access-zvzqs\") pod \"klusterlet-addon-workmgr-69cd76cd46-bkn8p\" (UID: \"7c679115-eb88-4a41-96fd-c450f9446448\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:28.451223 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-nrv4b\" (UID: \"6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b" Jul 02 13:42:28.451223 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451103 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsk5n\" (UniqueName: \"kubernetes.io/projected/6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01-kube-api-access-vsk5n\") pod \"cluster-samples-operator-9ddc5ff76-nrv4b\" (UID: \"6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b" Jul 02 13:42:28.451223 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451119 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59753f68-eab8-488e-a8a2-3821df8ebcaa-registry-tls\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.451223 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451143 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c679115-eb88-4a41-96fd-c450f9446448-tmp\") pod \"klusterlet-addon-workmgr-69cd76cd46-bkn8p\" (UID: \"7c679115-eb88-4a41-96fd-c450f9446448\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:28.451223 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451180 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzvjn\" (UniqueName: \"kubernetes.io/projected/2c665df0-af24-4518-ae1f-2b92507881cb-kube-api-access-xzvjn\") pod \"volume-data-source-validator-69d9f679db-z5b5x\" (UID: \"2c665df0-af24-4518-ae1f-2b92507881cb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-z5b5x" Jul 02 13:42:28.451467 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-default-certificate\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.451467 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451343 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-service-ca-bundle\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.451467 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451397 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59753f68-eab8-488e-a8a2-3821df8ebcaa-registry-certificates\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.451467 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a784b7d5-f532-42b7-ab59-b56969969a51-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6467458d8b-87qdm\" (UID: \"a784b7d5-f532-42b7-ab59-b56969969a51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm" Jul 02 13:42:28.451656 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451626 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c679115-eb88-4a41-96fd-c450f9446448-tmp\") pod \"klusterlet-addon-workmgr-69cd76cd46-bkn8p\" (UID: \"7c679115-eb88-4a41-96fd-c450f9446448\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:28.451712 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451686 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpnqt\" (UniqueName: \"kubernetes.io/projected/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-kube-api-access-lpnqt\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.451750 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451730 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59753f68-eab8-488e-a8a2-3821df8ebcaa-bound-sa-token\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.451785 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451759 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59753f68-eab8-488e-a8a2-3821df8ebcaa-ca-trust-extracted\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.451823 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451799 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59753f68-eab8-488e-a8a2-3821df8ebcaa-image-registry-private-configuration\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.451863 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451835 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59753f68-eab8-488e-a8a2-3821df8ebcaa-trusted-ca\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.451911 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59753f68-eab8-488e-a8a2-3821df8ebcaa-installation-pull-secrets\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.452012 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.451888 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25lgr\" (UniqueName: \"kubernetes.io/projected/59753f68-eab8-488e-a8a2-3821df8ebcaa-kube-api-access-25lgr\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.453148 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.452075 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sjb9\" (UniqueName: \"kubernetes.io/projected/a784b7d5-f532-42b7-ab59-b56969969a51-kube-api-access-7sjb9\") pod \"managed-serviceaccount-addon-agent-6467458d8b-87qdm\" (UID: \"a784b7d5-f532-42b7-ab59-b56969969a51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm" Jul 02 13:42:28.453148 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.452721 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-metrics-certs\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.453148 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.452754 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7c679115-eb88-4a41-96fd-c450f9446448-klusterlet-config\") pod \"klusterlet-addon-workmgr-69cd76cd46-bkn8p\" (UID: \"7c679115-eb88-4a41-96fd-c450f9446448\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:28.453148 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.452784 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-stats-auth\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.453651 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.452089 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-service-ca-bundle\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.454383 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.454358 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-default-certificate\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.454519 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.454478 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a784b7d5-f532-42b7-ab59-b56969969a51-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6467458d8b-87qdm\" (UID: \"a784b7d5-f532-42b7-ab59-b56969969a51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm" Jul 02 13:42:28.455851 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.455833 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-stats-auth\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.456299 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.456278 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-metrics-certs\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.456536 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.456516 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7c679115-eb88-4a41-96fd-c450f9446448-klusterlet-config\") pod \"klusterlet-addon-workmgr-69cd76cd46-bkn8p\" (UID: \"7c679115-eb88-4a41-96fd-c450f9446448\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:28.466771 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.466752 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sjb9\" (UniqueName: \"kubernetes.io/projected/a784b7d5-f532-42b7-ab59-b56969969a51-kube-api-access-7sjb9\") pod \"managed-serviceaccount-addon-agent-6467458d8b-87qdm\" (UID: \"a784b7d5-f532-42b7-ab59-b56969969a51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm" Jul 02 13:42:28.474627 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.474605 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzvjn\" (UniqueName: \"kubernetes.io/projected/2c665df0-af24-4518-ae1f-2b92507881cb-kube-api-access-xzvjn\") pod \"volume-data-source-validator-69d9f679db-z5b5x\" (UID: \"2c665df0-af24-4518-ae1f-2b92507881cb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-z5b5x" Jul 02 13:42:28.475654 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.475636 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvzqs\" (UniqueName: \"kubernetes.io/projected/7c679115-eb88-4a41-96fd-c450f9446448-kube-api-access-zvzqs\") pod \"klusterlet-addon-workmgr-69cd76cd46-bkn8p\" (UID: \"7c679115-eb88-4a41-96fd-c450f9446448\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:28.475854 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.475838 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpnqt\" (UniqueName: \"kubernetes.io/projected/0d5f4571-f3ca-407e-9cb2-0c4b0054623a-kube-api-access-lpnqt\") pod \"router-default-774678d5c-9htqr\" (UID: \"0d5f4571-f3ca-407e-9cb2-0c4b0054623a\") " pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.514566 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.514532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-n66cn" Jul 02 13:42:28.528444 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.528418 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:28.544566 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.544536 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:28.554229 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.554120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-nrv4b\" (UID: \"6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b" Jul 02 13:42:28.554229 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.554153 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsk5n\" (UniqueName: \"kubernetes.io/projected/6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01-kube-api-access-vsk5n\") pod \"cluster-samples-operator-9ddc5ff76-nrv4b\" (UID: \"6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b" Jul 02 13:42:28.554229 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.554197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59753f68-eab8-488e-a8a2-3821df8ebcaa-registry-tls\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.554362 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.554256 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59753f68-eab8-488e-a8a2-3821df8ebcaa-registry-certificates\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.554362 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.554288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59753f68-eab8-488e-a8a2-3821df8ebcaa-bound-sa-token\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.554362 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.554312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59753f68-eab8-488e-a8a2-3821df8ebcaa-ca-trust-extracted\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.554362 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.554343 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59753f68-eab8-488e-a8a2-3821df8ebcaa-image-registry-private-configuration\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.554481 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.554373 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59753f68-eab8-488e-a8a2-3821df8ebcaa-trusted-ca\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.554481 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.554402 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59753f68-eab8-488e-a8a2-3821df8ebcaa-installation-pull-secrets\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.554481 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.554426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25lgr\" (UniqueName: \"kubernetes.io/projected/59753f68-eab8-488e-a8a2-3821df8ebcaa-kube-api-access-25lgr\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.555651 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.555124 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59753f68-eab8-488e-a8a2-3821df8ebcaa-registry-certificates\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.555651 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.555442 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59753f68-eab8-488e-a8a2-3821df8ebcaa-ca-trust-extracted\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.555651 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.555554 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59753f68-eab8-488e-a8a2-3821df8ebcaa-trusted-ca\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.557232 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.557201 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59753f68-eab8-488e-a8a2-3821df8ebcaa-image-registry-private-configuration\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.557664 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.557640 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59753f68-eab8-488e-a8a2-3821df8ebcaa-registry-tls\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.558752 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.558725 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-nrv4b\" (UID: \"6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b" Jul 02 13:42:28.559087 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.559065 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59753f68-eab8-488e-a8a2-3821df8ebcaa-installation-pull-secrets\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.568916 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.568866 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59753f68-eab8-488e-a8a2-3821df8ebcaa-bound-sa-token\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.569626 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.569576 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25lgr\" (UniqueName: \"kubernetes.io/projected/59753f68-eab8-488e-a8a2-3821df8ebcaa-kube-api-access-25lgr\") pod \"image-registry-5b7f449549-z6tw8\" (UID: \"59753f68-eab8-488e-a8a2-3821df8ebcaa\") " pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.569975 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.569831 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsk5n\" (UniqueName: \"kubernetes.io/projected/6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01-kube-api-access-vsk5n\") pod \"cluster-samples-operator-9ddc5ff76-nrv4b\" (UID: \"6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b" Jul 02 13:42:28.574870 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.574802 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:28.589463 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.589418 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm" Jul 02 13:42:28.596198 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.595450 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-z5b5x" Jul 02 13:42:28.670505 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.670417 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-n66cn"] Jul 02 13:42:28.690829 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.689769 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b" Jul 02 13:42:28.694220 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.694138 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:28.724182 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.724080 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-4w7mc"] Jul 02 13:42:28.730206 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:28.730160 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4c6208_f2de_43e2_9665_ed4538a8f71f.slice/crio-3adbf6bb8d3d9ce3a6cedaa0f60c9c301afd97d2a9651fa665116aab51b33612 WatchSource:0}: Error finding container 3adbf6bb8d3d9ce3a6cedaa0f60c9c301afd97d2a9651fa665116aab51b33612: Status 404 returned error can't find the container with id 3adbf6bb8d3d9ce3a6cedaa0f60c9c301afd97d2a9651fa665116aab51b33612 Jul 02 13:42:28.769276 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.769176 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-774678d5c-9htqr"] Jul 02 13:42:28.803867 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.803638 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p"] Jul 02 13:42:28.808885 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:28.808858 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c679115_eb88_4a41_96fd_c450f9446448.slice/crio-8f95ecc03123d96c834674be2d720638aeae51b023136774a8b7bf18e7e40d3a WatchSource:0}: Error finding container 8f95ecc03123d96c834674be2d720638aeae51b023136774a8b7bf18e7e40d3a: Status 404 returned error can't find the container with id 8f95ecc03123d96c834674be2d720638aeae51b023136774a8b7bf18e7e40d3a Jul 02 13:42:28.824717 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.824283 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm"] Jul 02 13:42:28.831113 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:28.831068 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda784b7d5_f532_42b7_ab59_b56969969a51.slice/crio-cd7c60547adbc51ed1b6d7efbc713a1c4f7940c46b27fbc9761ef465f7502045 WatchSource:0}: Error finding container cd7c60547adbc51ed1b6d7efbc713a1c4f7940c46b27fbc9761ef465f7502045: Status 404 returned error can't find the container with id cd7c60547adbc51ed1b6d7efbc713a1c4f7940c46b27fbc9761ef465f7502045 Jul 02 13:42:28.840220 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:28.840187 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c665df0_af24_4518_ae1f_2b92507881cb.slice/crio-e5c85c6c699590d68431b1ed3b7f28159cfd88b1099badafc41ea3acdbb31805 WatchSource:0}: Error finding container e5c85c6c699590d68431b1ed3b7f28159cfd88b1099badafc41ea3acdbb31805: Status 404 returned error can't find the container with id e5c85c6c699590d68431b1ed3b7f28159cfd88b1099badafc41ea3acdbb31805 Jul 02 13:42:28.841473 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.841333 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-z5b5x"] Jul 02 13:42:28.884491 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.884422 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b7f449549-z6tw8"] Jul 02 13:42:28.888509 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:28.888481 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59753f68_eab8_488e_a8a2_3821df8ebcaa.slice/crio-5fa75fa70f1dd02c21492ebc5e2d236fedfd612b61e98d96b79eef4cf6fad946 WatchSource:0}: Error finding container 5fa75fa70f1dd02c21492ebc5e2d236fedfd612b61e98d96b79eef4cf6fad946: Status 404 returned error can't find the container with id 5fa75fa70f1dd02c21492ebc5e2d236fedfd612b61e98d96b79eef4cf6fad946 Jul 02 13:42:28.901594 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.901571 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b"] Jul 02 13:42:28.920080 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.920054 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-n66cn" event={"ID":"e017484a-637e-493c-a1fe-b100d1cb714e","Type":"ContainerStarted","Data":"57553109d5f9056324300bbfada33360319b562757551e96dd88b4dcadae4380"} Jul 02 13:42:28.921588 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.921558 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" event={"ID":"59753f68-eab8-488e-a8a2-3821df8ebcaa","Type":"ContainerStarted","Data":"5fa75fa70f1dd02c21492ebc5e2d236fedfd612b61e98d96b79eef4cf6fad946"} Jul 02 13:42:28.923227 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.923179 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-774678d5c-9htqr" event={"ID":"0d5f4571-f3ca-407e-9cb2-0c4b0054623a","Type":"ContainerStarted","Data":"98c97bae9f47fdd518852ff42f108330f8c237f23435d091edf64c7d664e1f1a"} Jul 02 13:42:28.923227 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.923219 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-774678d5c-9htqr" event={"ID":"0d5f4571-f3ca-407e-9cb2-0c4b0054623a","Type":"ContainerStarted","Data":"68d20383ec93135a387d84d668022ca054d2d6a7ccf05a9e0bac0650d6dc1f75"} Jul 02 13:42:28.924966 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.924914 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm" event={"ID":"a784b7d5-f532-42b7-ab59-b56969969a51","Type":"ContainerStarted","Data":"cd7c60547adbc51ed1b6d7efbc713a1c4f7940c46b27fbc9761ef465f7502045"} Jul 02 13:42:28.926195 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.926175 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" event={"ID":"6f4c6208-f2de-43e2-9665-ed4538a8f71f","Type":"ContainerStarted","Data":"3adbf6bb8d3d9ce3a6cedaa0f60c9c301afd97d2a9651fa665116aab51b33612"} Jul 02 13:42:28.927722 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.927697 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-z5b5x" event={"ID":"2c665df0-af24-4518-ae1f-2b92507881cb","Type":"ContainerStarted","Data":"e5c85c6c699590d68431b1ed3b7f28159cfd88b1099badafc41ea3acdbb31805"} Jul 02 13:42:28.929040 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.929015 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" event={"ID":"7c679115-eb88-4a41-96fd-c450f9446448","Type":"ContainerStarted","Data":"8f95ecc03123d96c834674be2d720638aeae51b023136774a8b7bf18e7e40d3a"} Jul 02 13:42:28.945191 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:28.945150 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-774678d5c-9htqr" podStartSLOduration=0.945137069 podStartE2EDuration="945.137069ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:42:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:28.944735177 +0000 UTC m=+60.077626742" watchObservedRunningTime="2026-07-02 13:42:28.945137069 +0000 UTC m=+60.078028633" Jul 02 13:42:29.546401 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:29.546337 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:29.550388 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:29.550201 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:29.943109 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:29.942906 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b" event={"ID":"6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01","Type":"ContainerStarted","Data":"c63efe9862d75c89d4a3ddf1b81fba1c58f93cdabd4454a31d26c109036540b9"} Jul 02 13:42:29.948440 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:29.948062 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" event={"ID":"59753f68-eab8-488e-a8a2-3821df8ebcaa","Type":"ContainerStarted","Data":"9b0149d3375f1181172d94b386a294065ee0aabe899af3c841e1bb759570a65e"} Jul 02 13:42:29.948440 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:29.948376 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:29.948440 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:29.948412 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:29.950071 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:29.950028 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-774678d5c-9htqr" Jul 02 13:42:29.968667 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:29.966843 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" podStartSLOduration=1.966827353 podStartE2EDuration="1.966827353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:42:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:29.966333148 +0000 UTC m=+61.099224714" watchObservedRunningTime="2026-07-02 13:42:29.966827353 +0000 UTC m=+61.099718918" Jul 02 13:42:30.845311 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:30.844033 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7fgt" Jul 02 13:42:33.906427 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:33.906393 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l4hcx" Jul 02 13:42:34.209203 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.209113 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:42:34.209203 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.209167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v727\" (UniqueName: \"kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727\") pod \"network-check-target-kp57h\" (UID: \"cb257e85-b36f-4233-8e80-0fab80099be6\") " pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:42:34.209430 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.209258 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:42:34.211979 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.211949 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 13:42:34.212160 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.212141 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 13:42:34.212257 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.212234 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 13:42:34.222511 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.222488 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559aa27-2922-474b-98e6-3a00eb31f57c-metrics-certs\") pod \"network-metrics-daemon-v2d9m\" (UID: \"b559aa27-2922-474b-98e6-3a00eb31f57c\") " pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:42:34.222646 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.222488 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd777315-3f9e-4c1d-bbeb-d9587d0e62b3-original-pull-secret\") pod \"global-pull-secret-syncer-fkm9t\" (UID: \"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3\") " pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:42:34.222877 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.222850 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 13:42:34.233404 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.233377 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v727\" (UniqueName: \"kubernetes.io/projected/cb257e85-b36f-4233-8e80-0fab80099be6-kube-api-access-2v727\") pod \"network-check-target-kp57h\" (UID: \"cb257e85-b36f-4233-8e80-0fab80099be6\") " pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:42:34.383201 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.383163 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fkm9t" Jul 02 13:42:34.390494 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.390472 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tz79z\"" Jul 02 13:42:34.396858 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.396839 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bhzn5\"" Jul 02 13:42:34.398691 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.398671 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:42:34.405550 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:34.405529 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v2d9m" Jul 02 13:42:35.153619 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.150658 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fkm9t"] Jul 02 13:42:35.161885 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:35.161849 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd777315_3f9e_4c1d_bbeb_d9587d0e62b3.slice/crio-fea1b86026512759ab6259add7ff0871800c4baee80c2b69aad425becbc3dea2 WatchSource:0}: Error finding container fea1b86026512759ab6259add7ff0871800c4baee80c2b69aad425becbc3dea2: Status 404 returned error can't find the container with id fea1b86026512759ab6259add7ff0871800c4baee80c2b69aad425becbc3dea2 Jul 02 13:42:35.197001 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.196858 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v2d9m"] Jul 02 13:42:35.221085 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:35.213724 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb559aa27_2922_474b_98e6_3a00eb31f57c.slice/crio-189a2326fd60f43a02709f2221596961172a98bf6922fc6164f8265cba5d1d2c WatchSource:0}: Error finding container 189a2326fd60f43a02709f2221596961172a98bf6922fc6164f8265cba5d1d2c: Status 404 returned error can't find the container with id 189a2326fd60f43a02709f2221596961172a98bf6922fc6164f8265cba5d1d2c Jul 02 13:42:35.247625 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.246210 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kp57h"] Jul 02 13:42:35.249536 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:35.249501 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb257e85_b36f_4233_8e80_0fab80099be6.slice/crio-b9350efbc4fc7df064285cde18708f884cf8f1726b6cb7d903c8517d8bd94439 WatchSource:0}: Error finding container b9350efbc4fc7df064285cde18708f884cf8f1726b6cb7d903c8517d8bd94439: Status 404 returned error can't find the container with id b9350efbc4fc7df064285cde18708f884cf8f1726b6cb7d903c8517d8bd94439 Jul 02 13:42:35.974238 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.974181 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fkm9t" event={"ID":"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3","Type":"ContainerStarted","Data":"fea1b86026512759ab6259add7ff0871800c4baee80c2b69aad425becbc3dea2"} Jul 02 13:42:35.976663 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.976610 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm" event={"ID":"a784b7d5-f532-42b7-ab59-b56969969a51","Type":"ContainerStarted","Data":"34e8da86bcd61c77429edf2ca32b82c3dbb7f9a0f1864bdbd629f09ee29260d9"} Jul 02 13:42:35.978972 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.978943 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" event={"ID":"6f4c6208-f2de-43e2-9665-ed4538a8f71f","Type":"ContainerStarted","Data":"5890f0c3efee256860b4767a4f9ac73886085e7ef456c4e25f48f73b2c7e9c25"} Jul 02 13:42:35.979669 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.979649 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:35.984149 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.984083 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kp57h" event={"ID":"cb257e85-b36f-4233-8e80-0fab80099be6","Type":"ContainerStarted","Data":"b9350efbc4fc7df064285cde18708f884cf8f1726b6cb7d903c8517d8bd94439"} Jul 02 13:42:35.986842 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.986812 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" Jul 02 13:42:35.988298 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.987754 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-z5b5x" event={"ID":"2c665df0-af24-4518-ae1f-2b92507881cb","Type":"ContainerStarted","Data":"bddd567103899cf65e1c6433e7f6451a086fca33152ca3b9fb3d6b51e1335163"} Jul 02 13:42:35.990616 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.990591 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" event={"ID":"7c679115-eb88-4a41-96fd-c450f9446448","Type":"ContainerStarted","Data":"f1237ebcd7b9cc57fd914883352661da906cf7a4c684754cff70e5efb507effb"} Jul 02 13:42:35.991437 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.991341 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:35.993021 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.992972 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" Jul 02 13:42:35.996498 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.996415 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-n66cn" event={"ID":"e017484a-637e-493c-a1fe-b100d1cb714e","Type":"ContainerStarted","Data":"8e8ed9353da4921069bdf8c2582e6fb67a53bbde6c18eb66e2804fb5d4ca8a12"} Jul 02 13:42:35.996940 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.996704 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6467458d8b-87qdm" podStartSLOduration=1.882797837 podStartE2EDuration="7.996686263s" totalImagesPullingTime="6.113888426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:35.99481792 +0000 UTC m=+67.127709487" watchObservedRunningTime="2026-07-02 13:42:35.996686263 +0000 UTC m=+67.129577826" Jul 02 13:42:35.999448 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.999394 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b" event={"ID":"6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01","Type":"ContainerStarted","Data":"b82e2d97f510a171dacb1eeec63a5cc19171a25881fca084c2c77186e73de913"} Jul 02 13:42:35.999448 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:35.999442 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b" event={"ID":"6bc2c91c-d3e8-41a5-9cc4-7d3cab8c8a01","Type":"ContainerStarted","Data":"614f116282fbc8bb018026cfde7cf7a7e0b445edc8aeedd557a3059aaa1f13b5"} Jul 02 13:42:36.001135 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:36.001053 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v2d9m" event={"ID":"b559aa27-2922-474b-98e6-3a00eb31f57c","Type":"ContainerStarted","Data":"189a2326fd60f43a02709f2221596961172a98bf6922fc6164f8265cba5d1d2c"} Jul 02 13:42:36.021262 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:36.021135 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-4w7mc" podStartSLOduration=1.8182517809999998 podStartE2EDuration="8.021111551s" totalImagesPullingTime="6.20285977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:36.020397956 +0000 UTC m=+67.153289522" watchObservedRunningTime="2026-07-02 13:42:36.021111551 +0000 UTC m=+67.154003116" Jul 02 13:42:36.047650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:36.047530 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69cd76cd46-bkn8p" podStartSLOduration=1.911113266 podStartE2EDuration="8.047507869s" totalImagesPullingTime="6.136394603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:36.046578611 +0000 UTC m=+67.179470178" watchObservedRunningTime="2026-07-02 13:42:36.047507869 +0000 UTC m=+67.180399434" Jul 02 13:42:36.117289 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:36.116776 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-z5b5x" podStartSLOduration=2.075987365 podStartE2EDuration="8.116756533s" totalImagesPullingTime="6.040769168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:36.087952142 +0000 UTC m=+67.220843702" watchObservedRunningTime="2026-07-02 13:42:36.116756533 +0000 UTC m=+67.249648100" Jul 02 13:42:36.149503 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:36.149253 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-nrv4b" podStartSLOduration=2.154777641 podStartE2EDuration="8.149231159s" totalImagesPullingTime="5.994453518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:36.147512416 +0000 UTC m=+67.280403981" watchObservedRunningTime="2026-07-02 13:42:36.149231159 +0000 UTC m=+67.282122725" Jul 02 13:42:36.149729 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:36.149685 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-n66cn" podStartSLOduration=1.913622733 podStartE2EDuration="8.149670557s" totalImagesPullingTime="6.236047824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:36.116593679 +0000 UTC m=+67.249485244" watchObservedRunningTime="2026-07-02 13:42:36.149670557 +0000 UTC m=+67.282562122" Jul 02 13:42:36.884554 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:36.884467 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pq7rc"] Jul 02 13:42:36.890447 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:36.890424 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:36.894754 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:36.894003 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 13:42:36.894754 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:36.894306 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 13:42:36.894754 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:36.894600 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pbpg7\"" Jul 02 13:42:36.901251 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:36.901135 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pq7rc"] Jul 02 13:42:37.008141 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.008043 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v2d9m" event={"ID":"b559aa27-2922-474b-98e6-3a00eb31f57c","Type":"ContainerStarted","Data":"d461d83969960885fa7c81a7619537bfd07df4f77934d12c0efc626665f20a1a"} Jul 02 13:42:37.008141 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.008105 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v2d9m" event={"ID":"b559aa27-2922-474b-98e6-3a00eb31f57c","Type":"ContainerStarted","Data":"f99ddba01c3111e3ecd7a2567a1a33c715875c09613e9dc41ab4b92c1d6e1bfe"} Jul 02 13:42:37.038300 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.038271 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h278v\" (UniqueName: \"kubernetes.io/projected/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-api-access-h278v\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.038481 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.038306 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.038481 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.038353 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-data-volume\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.038481 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.038408 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.038655 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.038499 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-crio-socket\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.139099 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.139012 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-data-volume\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.139099 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.139062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.139099 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.139095 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-crio-socket\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.139373 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.139330 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h278v\" (UniqueName: \"kubernetes.io/projected/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-api-access-h278v\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.139426 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.139381 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.140622 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:37.139468 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:42:37.140622 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:37.139547 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm podName:85ad1bc1-d5b1-423d-8d1d-562dcc86c04e nodeName:}" failed. No retries permitted until 2026-07-02 13:42:37.639523927 +0000 UTC m=+68.772415494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pq7rc" (UID: "85ad1bc1-d5b1-423d-8d1d-562dcc86c04e") : configmap "kube-rbac-proxy" not found Jul 02 13:42:37.140622 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.140143 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-data-volume\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.140622 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:37.140165 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:42:37.140622 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.140219 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-crio-socket\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.140622 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:37.140231 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls podName:85ad1bc1-d5b1-423d-8d1d-562dcc86c04e nodeName:}" failed. No retries permitted until 2026-07-02 13:42:37.640213986 +0000 UTC m=+68.773105549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pq7rc" (UID: "85ad1bc1-d5b1-423d-8d1d-562dcc86c04e") : secret "insights-runtime-extractor-tls" not found Jul 02 13:42:37.149880 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.149854 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h278v\" (UniqueName: \"kubernetes.io/projected/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-api-access-h278v\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.644260 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.644218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.644438 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.644310 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:37.644438 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:37.644395 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:42:37.644438 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:37.644397 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:42:37.644610 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:37.644463 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm podName:85ad1bc1-d5b1-423d-8d1d-562dcc86c04e nodeName:}" failed. No retries permitted until 2026-07-02 13:42:38.644443533 +0000 UTC m=+69.777335090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pq7rc" (UID: "85ad1bc1-d5b1-423d-8d1d-562dcc86c04e") : configmap "kube-rbac-proxy" not found Jul 02 13:42:37.644610 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:37.644481 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls podName:85ad1bc1-d5b1-423d-8d1d-562dcc86c04e nodeName:}" failed. No retries permitted until 2026-07-02 13:42:38.644472192 +0000 UTC m=+69.777363736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pq7rc" (UID: "85ad1bc1-d5b1-423d-8d1d-562dcc86c04e") : secret "insights-runtime-extractor-tls" not found Jul 02 13:42:37.908139 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:37.908055 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l4hcx_348180ec-a210-44a4-9b94-b14890b5869d/dns/0.log" Jul 02 13:42:38.086446 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:38.086414 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l4hcx_348180ec-a210-44a4-9b94-b14890b5869d/kube-rbac-proxy/0.log" Jul 02 13:42:38.260870 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:38.260777 2573 patch_prober.go:28] interesting pod/image-registry-6cd9854cdf-ddckm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 13:42:38.260870 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:38.260839 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" podUID="5826ee61-33a5-4ecc-bbd0-c6703128c3e3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 13:42:38.653782 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:38.653744 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:38.654007 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:38.653856 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:38.654007 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:38.653890 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:42:38.654007 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:38.653985 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:42:38.654007 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:38.653996 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls podName:85ad1bc1-d5b1-423d-8d1d-562dcc86c04e nodeName:}" failed. No retries permitted until 2026-07-02 13:42:40.653973758 +0000 UTC m=+71.786865536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pq7rc" (UID: "85ad1bc1-d5b1-423d-8d1d-562dcc86c04e") : secret "insights-runtime-extractor-tls" not found Jul 02 13:42:38.654244 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:38.654036 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm podName:85ad1bc1-d5b1-423d-8d1d-562dcc86c04e nodeName:}" failed. No retries permitted until 2026-07-02 13:42:40.654020965 +0000 UTC m=+71.786912510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pq7rc" (UID: "85ad1bc1-d5b1-423d-8d1d-562dcc86c04e") : configmap "kube-rbac-proxy" not found Jul 02 13:42:38.885984 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:38.885947 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7cf2b_61d94ef8-11f8-46ee-b67d-7aa90e074512/dns-node-resolver/0.log" Jul 02 13:42:39.285804 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:39.285764 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b7f449549-z6tw8_59753f68-eab8-488e-a8a2-3821df8ebcaa/registry/0.log" Jul 02 13:42:39.485473 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:39.485439 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6cd9854cdf-ddckm_5826ee61-33a5-4ecc-bbd0-c6703128c3e3/registry/0.log" Jul 02 13:42:39.933719 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:39.931640 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v2d9m" podStartSLOduration=68.755463563 podStartE2EDuration="1m9.931619076s" totalImagesPullingTime="1.176155513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:37.025883429 +0000 UTC m=+68.158774995" watchObservedRunningTime="2026-07-02 13:42:39.931619076 +0000 UTC m=+71.064510627" Jul 02 13:42:39.933719 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:39.932307 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l7846"] Jul 02 13:42:39.955820 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:39.955791 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:39.958675 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:39.958100 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 13:42:39.958675 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:39.958417 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 13:42:39.958675 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:39.958470 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 13:42:39.958675 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:39.958598 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 13:42:39.959477 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:39.959455 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g7vx5\"" Jul 02 13:42:39.959607 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:39.959564 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 13:42:39.959749 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:39.959728 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 13:42:40.067397 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.067363 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-wtmp\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.067580 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.067420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.067580 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.067505 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-sys\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.067580 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.067541 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.067754 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.067593 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-textfile\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.067754 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.067634 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-metrics-client-ca\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.067754 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.067694 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbt27\" (UniqueName: \"kubernetes.io/projected/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-kube-api-access-hbt27\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.067754 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.067724 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-tls\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.067976 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.067754 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-root\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.085772 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.085742 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jd9tr_18745f0d-e7b8-4f0e-bfc8-021979556351/node-ca/0.log" Jul 02 13:42:40.169025 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.168991 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-textfile\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.169183 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.169052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-metrics-client-ca\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.169183 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.169103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbt27\" (UniqueName: \"kubernetes.io/projected/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-kube-api-access-hbt27\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.169183 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.169135 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-tls\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.169183 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.169164 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-root\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.169314 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.169196 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-wtmp\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.169314 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.169240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.169314 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.169287 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-sys\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.169406 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.169311 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.169406 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.169368 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-textfile\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.169505 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.169443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-root\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.170118 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.169903 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-metrics-client-ca\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.170118 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.169946 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-sys\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.170118 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.170078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-wtmp\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.175793 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.171516 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.175793 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.172407 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.187837 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.187761 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-node-exporter-tls\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.189143 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.189120 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbt27\" (UniqueName: \"kubernetes.io/projected/3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a-kube-api-access-hbt27\") pod \"node-exporter-l7846\" (UID: \"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a\") " pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.269306 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.269269 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l7846" Jul 02 13:42:40.486367 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.486295 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-774678d5c-9htqr_0d5f4571-f3ca-407e-9cb2-0c4b0054623a/router/0.log" Jul 02 13:42:40.673677 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.673643 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:40.673847 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.673718 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:40.673847 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:40.673796 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:42:40.673847 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:40.673808 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:42:40.673992 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:40.673866 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm podName:85ad1bc1-d5b1-423d-8d1d-562dcc86c04e nodeName:}" failed. No retries permitted until 2026-07-02 13:42:44.673848758 +0000 UTC m=+75.806740314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pq7rc" (UID: "85ad1bc1-d5b1-423d-8d1d-562dcc86c04e") : configmap "kube-rbac-proxy" not found Jul 02 13:42:40.673992 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:40.673884 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls podName:85ad1bc1-d5b1-423d-8d1d-562dcc86c04e nodeName:}" failed. No retries permitted until 2026-07-02 13:42:44.673874701 +0000 UTC m=+75.806766245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pq7rc" (UID: "85ad1bc1-d5b1-423d-8d1d-562dcc86c04e") : secret "insights-runtime-extractor-tls" not found Jul 02 13:42:40.686621 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:40.686598 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ct4b6_bb57b91a-b68a-45b7-a1d5-1c1aa3693765/serve-healthcheck-canary/0.log" Jul 02 13:42:40.746262 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:40.746236 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6cce6b_9eea_4e16_bb65_fca63a6a7b6a.slice/crio-c59db2270f86c7316e6bdbca415691399c0c3b2a9899569eb84bb6ffdd0892e1 WatchSource:0}: Error finding container c59db2270f86c7316e6bdbca415691399c0c3b2a9899569eb84bb6ffdd0892e1: Status 404 returned error can't find the container with id c59db2270f86c7316e6bdbca415691399c0c3b2a9899569eb84bb6ffdd0892e1 Jul 02 13:42:41.027453 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:41.027411 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7846" event={"ID":"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a","Type":"ContainerStarted","Data":"c59db2270f86c7316e6bdbca415691399c0c3b2a9899569eb84bb6ffdd0892e1"} Jul 02 13:42:41.028990 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:41.028956 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fkm9t" event={"ID":"cd777315-3f9e-4c1d-bbeb-d9587d0e62b3","Type":"ContainerStarted","Data":"2b5e5dd1189c04300816c50ed97016f6cf32f2dda83bc6e8caef181c0d8b0d91"} Jul 02 13:42:41.030516 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:41.030488 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kp57h" event={"ID":"cb257e85-b36f-4233-8e80-0fab80099be6","Type":"ContainerStarted","Data":"309a706ff0c64e0ff0aff3b236e2c51d4389b4d207c37e53299ba6261d2768dd"} Jul 02 13:42:41.030665 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:41.030651 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:42:41.056108 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:41.056056 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fkm9t" podStartSLOduration=65.463646111 podStartE2EDuration="1m11.056039631s" totalImagesPullingTime="5.59239352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:41.054881561 +0000 UTC m=+72.187773141" watchObservedRunningTime="2026-07-02 13:42:41.056039631 +0000 UTC m=+72.188931174" Jul 02 13:42:41.074532 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:41.074471 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kp57h" podStartSLOduration=65.581381743 podStartE2EDuration="1m11.074456088s" totalImagesPullingTime="5.493074345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:41.073770314 +0000 UTC m=+72.206661881" watchObservedRunningTime="2026-07-02 13:42:41.074456088 +0000 UTC m=+72.207347704" Jul 02 13:42:42.036842 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:42.036809 2573 generic.go:356] "Generic (PLEG): container finished" podID="3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a" containerID="c4cde391bced5b4359411ef7f075fd35e3be2c0a2ec6a4fab036bc8046d5f43c" exitCode=0 Jul 02 13:42:42.037393 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:42.036893 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7846" event={"ID":"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a","Type":"ContainerDied","Data":"c4cde391bced5b4359411ef7f075fd35e3be2c0a2ec6a4fab036bc8046d5f43c"} Jul 02 13:42:43.043670 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:43.043626 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7846" event={"ID":"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a","Type":"ContainerStarted","Data":"d2517b3b4836fe1c4c73eaefe620c91e369ab7a8884b2df3573c8280991ba77e"} Jul 02 13:42:43.044149 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:43.043754 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7846" event={"ID":"3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a","Type":"ContainerStarted","Data":"f2a54db7973ab8f27489cf17f28e389380af200e0418806eeea3c40fe2dcd0a2"} Jul 02 13:42:43.063972 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:43.063899 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l7846" podStartSLOduration=3.15625618 podStartE2EDuration="4.063882209s" totalImagesPullingTime="841.257867ms" totalInitContainerRuntime="66.368162ms" isStatefulPod=true podCreationTimestamp="2026-07-02 13:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:43.062620576 +0000 UTC m=+74.195512140" watchObservedRunningTime="2026-07-02 13:42:43.063882209 +0000 UTC m=+74.196773774" Jul 02 13:42:44.710877 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:44.710840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:44.711273 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:44.710887 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:44.711369 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:44.711348 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:44.713171 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:44.713149 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85ad1bc1-d5b1-423d-8d1d-562dcc86c04e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pq7rc\" (UID: \"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e\") " pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:45.006589 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:45.006506 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pq7rc" Jul 02 13:42:45.132746 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:45.132710 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pq7rc"] Jul 02 13:42:45.135549 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:42:45.135522 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ad1bc1_d5b1_423d_8d1d_562dcc86c04e.slice/crio-78b841ff01392e75db9e1bf57f76365e24e1ba6ddfd00faa2beac254ec5353bc WatchSource:0}: Error finding container 78b841ff01392e75db9e1bf57f76365e24e1ba6ddfd00faa2beac254ec5353bc: Status 404 returned error can't find the container with id 78b841ff01392e75db9e1bf57f76365e24e1ba6ddfd00faa2beac254ec5353bc Jul 02 13:42:46.057104 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:46.057027 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pq7rc" event={"ID":"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e","Type":"ContainerStarted","Data":"78b841ff01392e75db9e1bf57f76365e24e1ba6ddfd00faa2beac254ec5353bc"} Jul 02 13:42:48.258310 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:48.258275 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:49.069604 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:49.069565 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pq7rc" event={"ID":"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e","Type":"ContainerStarted","Data":"aba24c461248b84c5d712468d01d7c4d1d3195af38d72859083d239777d8a4a9"} Jul 02 13:42:50.075627 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:50.075590 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pq7rc" event={"ID":"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e","Type":"ContainerStarted","Data":"8343730a93379de7b3cf744564fde9ebd985674027531377c07ef62627068cc1"} Jul 02 13:42:50.959760 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:50.959720 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b7f449549-z6tw8" Jul 02 13:42:52.086762 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:52.086718 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pq7rc" event={"ID":"85ad1bc1-d5b1-423d-8d1d-562dcc86c04e","Type":"ContainerStarted","Data":"2cca00f537d7c77f1207aa02bdc06779b12f6dab41b3266b91593f5fdc5e8c64"} Jul 02 13:42:52.109129 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:52.109077 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pq7rc" podStartSLOduration=9.371714944 podStartE2EDuration="16.109061412s" totalImagesPullingTime="6.737346468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:42:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:42:52.108252844 +0000 UTC m=+83.241144410" watchObservedRunningTime="2026-07-02 13:42:52.109061412 +0000 UTC m=+83.241952979" Jul 02 13:42:53.279007 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.278965 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" podUID="5826ee61-33a5-4ecc-bbd0-c6703128c3e3" containerName="registry" containerID="cri-o://90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed" gracePeriod=30 Jul 02 13:42:53.529549 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.529485 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:53.683130 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.683101 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-trusted-ca\") pod \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " Jul 02 13:42:53.683314 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.683141 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-ca-trust-extracted\") pod \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " Jul 02 13:42:53.683314 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.683166 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-certificates\") pod \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " Jul 02 13:42:53.683314 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.683190 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz8fk\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-kube-api-access-wz8fk\") pod \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " Jul 02 13:42:53.683314 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.683219 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-image-registry-private-configuration\") pod \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " Jul 02 13:42:53.683314 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.683248 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-bound-sa-token\") pod \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " Jul 02 13:42:53.683314 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.683268 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-installation-pull-secrets\") pod \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " Jul 02 13:42:53.683314 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.683297 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls\") pod \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\" (UID: \"5826ee61-33a5-4ecc-bbd0-c6703128c3e3\") " Jul 02 13:42:53.683657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.683539 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5826ee61-33a5-4ecc-bbd0-c6703128c3e3" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:42:53.683657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.683580 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5826ee61-33a5-4ecc-bbd0-c6703128c3e3" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:42:53.685780 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.685752 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5826ee61-33a5-4ecc-bbd0-c6703128c3e3" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:42:53.685907 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.685772 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5826ee61-33a5-4ecc-bbd0-c6703128c3e3" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:42:53.686006 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.685980 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-kube-api-access-wz8fk" (OuterVolumeSpecName: "kube-api-access-wz8fk") pod "5826ee61-33a5-4ecc-bbd0-c6703128c3e3" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3"). InnerVolumeSpecName "kube-api-access-wz8fk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:42:53.686056 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.686006 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5826ee61-33a5-4ecc-bbd0-c6703128c3e3" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:42:53.686144 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.686124 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5826ee61-33a5-4ecc-bbd0-c6703128c3e3" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:42:53.691634 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.691611 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5826ee61-33a5-4ecc-bbd0-c6703128c3e3" (UID: "5826ee61-33a5-4ecc-bbd0-c6703128c3e3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:42:53.784791 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.784702 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-trusted-ca\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:42:53.784791 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.784744 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-ca-trust-extracted\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:42:53.784791 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.784754 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-certificates\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:42:53.784791 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.784763 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz8fk\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-kube-api-access-wz8fk\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:42:53.784791 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.784774 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-image-registry-private-configuration\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:42:53.784791 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.784783 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-bound-sa-token\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:42:53.784791 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.784791 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-installation-pull-secrets\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:42:53.784791 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:53.784799 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5826ee61-33a5-4ecc-bbd0-c6703128c3e3-registry-tls\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:42:54.095292 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:54.095198 2573 generic.go:356] "Generic (PLEG): container finished" podID="5826ee61-33a5-4ecc-bbd0-c6703128c3e3" containerID="90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed" exitCode=0 Jul 02 13:42:54.095292 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:54.095228 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" event={"ID":"5826ee61-33a5-4ecc-bbd0-c6703128c3e3","Type":"ContainerDied","Data":"90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed"} Jul 02 13:42:54.095292 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:54.095245 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" Jul 02 13:42:54.095292 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:54.095287 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cd9854cdf-ddckm" event={"ID":"5826ee61-33a5-4ecc-bbd0-c6703128c3e3","Type":"ContainerDied","Data":"9859b38364d262ba32e87089e1e0e7ff94879d9f8eda5ecf48a6078c728bd267"} Jul 02 13:42:54.095565 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:54.095315 2573 scope.go:117] "RemoveContainer" containerID="90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed" Jul 02 13:42:54.104024 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:54.104008 2573 scope.go:117] "RemoveContainer" containerID="90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed" Jul 02 13:42:54.104266 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:42:54.104247 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed\": container with ID starting with 90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed not found: ID does not exist" containerID="90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed" Jul 02 13:42:54.104307 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:54.104276 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed"} err="failed to get container status \"90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed\": rpc error: code = NotFound desc = could not find container \"90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed\": container with ID starting with 90df30c631355d28ae4d7284932df12284d5c3ba24d7ac30f472f259269abaed not found: ID does not exist" Jul 02 13:42:54.119723 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:54.119700 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cd9854cdf-ddckm"] Jul 02 13:42:54.128203 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:54.128185 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cd9854cdf-ddckm"] Jul 02 13:42:55.478119 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:42:55.478089 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5826ee61-33a5-4ecc-bbd0-c6703128c3e3" path="/var/lib/kubelet/pods/5826ee61-33a5-4ecc-bbd0-c6703128c3e3/volumes" Jul 02 13:43:12.039081 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:43:12.039047 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kp57h" Jul 02 13:46:24.471212 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.471179 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg"] Jul 02 13:46:24.471607 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.471460 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5826ee61-33a5-4ecc-bbd0-c6703128c3e3" containerName="registry" Jul 02 13:46:24.471607 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.471476 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5826ee61-33a5-4ecc-bbd0-c6703128c3e3" containerName="registry" Jul 02 13:46:24.471607 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.471536 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5826ee61-33a5-4ecc-bbd0-c6703128c3e3" containerName="registry" Jul 02 13:46:24.474711 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.474688 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:24.477252 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.477226 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 13:46:24.477252 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.477228 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 13:46:24.477423 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.477249 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qxlpd\"" Jul 02 13:46:24.482766 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.482744 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg"] Jul 02 13:46:24.538848 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.538811 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45631de8-31af-4f0b-a006-d1434b990ecf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg\" (UID: \"45631de8-31af-4f0b-a006-d1434b990ecf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:24.538848 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.538849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45631de8-31af-4f0b-a006-d1434b990ecf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg\" (UID: \"45631de8-31af-4f0b-a006-d1434b990ecf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:24.539075 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.538883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hn5n\" (UniqueName: \"kubernetes.io/projected/45631de8-31af-4f0b-a006-d1434b990ecf-kube-api-access-8hn5n\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg\" (UID: \"45631de8-31af-4f0b-a006-d1434b990ecf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:24.639281 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.639248 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45631de8-31af-4f0b-a006-d1434b990ecf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg\" (UID: \"45631de8-31af-4f0b-a006-d1434b990ecf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:24.639405 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.639288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45631de8-31af-4f0b-a006-d1434b990ecf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg\" (UID: \"45631de8-31af-4f0b-a006-d1434b990ecf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:24.639405 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.639321 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hn5n\" (UniqueName: \"kubernetes.io/projected/45631de8-31af-4f0b-a006-d1434b990ecf-kube-api-access-8hn5n\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg\" (UID: \"45631de8-31af-4f0b-a006-d1434b990ecf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:24.639651 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.639633 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45631de8-31af-4f0b-a006-d1434b990ecf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg\" (UID: \"45631de8-31af-4f0b-a006-d1434b990ecf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:24.639694 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.639679 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45631de8-31af-4f0b-a006-d1434b990ecf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg\" (UID: \"45631de8-31af-4f0b-a006-d1434b990ecf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:24.648115 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.648090 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hn5n\" (UniqueName: \"kubernetes.io/projected/45631de8-31af-4f0b-a006-d1434b990ecf-kube-api-access-8hn5n\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg\" (UID: \"45631de8-31af-4f0b-a006-d1434b990ecf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:24.784014 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.783965 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:24.932889 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:24.932867 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg"] Jul 02 13:46:24.935282 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:46:24.935256 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45631de8_31af_4f0b_a006_d1434b990ecf.slice/crio-c415db6a7bb4f7d9f63733135824571a73f4bb527aa023f973c288efcf5781eb WatchSource:0}: Error finding container c415db6a7bb4f7d9f63733135824571a73f4bb527aa023f973c288efcf5781eb: Status 404 returned error can't find the container with id c415db6a7bb4f7d9f63733135824571a73f4bb527aa023f973c288efcf5781eb Jul 02 13:46:25.831803 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:25.831769 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" event={"ID":"45631de8-31af-4f0b-a006-d1434b990ecf","Type":"ContainerStarted","Data":"c415db6a7bb4f7d9f63733135824571a73f4bb527aa023f973c288efcf5781eb"} Jul 02 13:46:29.390851 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:29.390819 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-acl-logging/0.log" Jul 02 13:46:29.393699 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:29.393673 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-acl-logging/0.log" Jul 02 13:46:29.394383 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:29.394366 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 13:46:34.870011 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:34.869973 2573 generic.go:356] "Generic (PLEG): container finished" podID="45631de8-31af-4f0b-a006-d1434b990ecf" containerID="121c66c811718bf79e65c6f54c133034e9f478a542772d28346f73133a4fc157" exitCode=0 Jul 02 13:46:34.870440 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:34.870055 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" event={"ID":"45631de8-31af-4f0b-a006-d1434b990ecf","Type":"ContainerDied","Data":"121c66c811718bf79e65c6f54c133034e9f478a542772d28346f73133a4fc157"} Jul 02 13:46:34.871080 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:34.871065 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 13:46:37.883381 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:37.883349 2573 generic.go:356] "Generic (PLEG): container finished" podID="45631de8-31af-4f0b-a006-d1434b990ecf" containerID="122cbe86fffda35c2670a709d7979390d041d409f3b93c3bbbdc9a3e7e12b565" exitCode=0 Jul 02 13:46:37.883729 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:37.883435 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" event={"ID":"45631de8-31af-4f0b-a006-d1434b990ecf","Type":"ContainerDied","Data":"122cbe86fffda35c2670a709d7979390d041d409f3b93c3bbbdc9a3e7e12b565"} Jul 02 13:46:44.911998 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:44.911963 2573 generic.go:356] "Generic (PLEG): container finished" podID="45631de8-31af-4f0b-a006-d1434b990ecf" containerID="7415eca4299b1297f0740c7a7a14296bef8592c761f8ce963150b2203e552329" exitCode=0 Jul 02 13:46:44.912399 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:44.912013 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" event={"ID":"45631de8-31af-4f0b-a006-d1434b990ecf","Type":"ContainerDied","Data":"7415eca4299b1297f0740c7a7a14296bef8592c761f8ce963150b2203e552329"} Jul 02 13:46:46.038374 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.038350 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:46.105437 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.105392 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45631de8-31af-4f0b-a006-d1434b990ecf-util\") pod \"45631de8-31af-4f0b-a006-d1434b990ecf\" (UID: \"45631de8-31af-4f0b-a006-d1434b990ecf\") " Jul 02 13:46:46.105604 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.105479 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45631de8-31af-4f0b-a006-d1434b990ecf-bundle\") pod \"45631de8-31af-4f0b-a006-d1434b990ecf\" (UID: \"45631de8-31af-4f0b-a006-d1434b990ecf\") " Jul 02 13:46:46.105604 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.105499 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hn5n\" (UniqueName: \"kubernetes.io/projected/45631de8-31af-4f0b-a006-d1434b990ecf-kube-api-access-8hn5n\") pod \"45631de8-31af-4f0b-a006-d1434b990ecf\" (UID: \"45631de8-31af-4f0b-a006-d1434b990ecf\") " Jul 02 13:46:46.106264 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.106234 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45631de8-31af-4f0b-a006-d1434b990ecf-bundle" (OuterVolumeSpecName: "bundle") pod "45631de8-31af-4f0b-a006-d1434b990ecf" (UID: "45631de8-31af-4f0b-a006-d1434b990ecf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:46:46.107668 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.107643 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45631de8-31af-4f0b-a006-d1434b990ecf-kube-api-access-8hn5n" (OuterVolumeSpecName: "kube-api-access-8hn5n") pod "45631de8-31af-4f0b-a006-d1434b990ecf" (UID: "45631de8-31af-4f0b-a006-d1434b990ecf"). InnerVolumeSpecName "kube-api-access-8hn5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:46:46.110026 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.110004 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45631de8-31af-4f0b-a006-d1434b990ecf-util" (OuterVolumeSpecName: "util") pod "45631de8-31af-4f0b-a006-d1434b990ecf" (UID: "45631de8-31af-4f0b-a006-d1434b990ecf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:46:46.206885 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.206789 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45631de8-31af-4f0b-a006-d1434b990ecf-bundle\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:46:46.206885 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.206830 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hn5n\" (UniqueName: \"kubernetes.io/projected/45631de8-31af-4f0b-a006-d1434b990ecf-kube-api-access-8hn5n\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:46:46.206885 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.206840 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45631de8-31af-4f0b-a006-d1434b990ecf-util\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:46:46.921129 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.921097 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" event={"ID":"45631de8-31af-4f0b-a006-d1434b990ecf","Type":"ContainerDied","Data":"c415db6a7bb4f7d9f63733135824571a73f4bb527aa023f973c288efcf5781eb"} Jul 02 13:46:46.921289 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.921147 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c415db6a7bb4f7d9f63733135824571a73f4bb527aa023f973c288efcf5781eb" Jul 02 13:46:46.921289 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:46.921104 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxdtbg" Jul 02 13:46:52.499254 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.499224 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6"] Jul 02 13:46:52.499624 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.499489 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45631de8-31af-4f0b-a006-d1434b990ecf" containerName="extract" Jul 02 13:46:52.499624 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.499499 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="45631de8-31af-4f0b-a006-d1434b990ecf" containerName="extract" Jul 02 13:46:52.499624 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.499508 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45631de8-31af-4f0b-a006-d1434b990ecf" containerName="util" Jul 02 13:46:52.499624 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.499514 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="45631de8-31af-4f0b-a006-d1434b990ecf" containerName="util" Jul 02 13:46:52.499624 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.499524 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45631de8-31af-4f0b-a006-d1434b990ecf" containerName="pull" Jul 02 13:46:52.499624 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.499529 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="45631de8-31af-4f0b-a006-d1434b990ecf" containerName="pull" Jul 02 13:46:52.499624 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.499571 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="45631de8-31af-4f0b-a006-d1434b990ecf" containerName="extract" Jul 02 13:46:52.501286 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.501271 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6" Jul 02 13:46:52.504482 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.504466 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 13:46:52.504559 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.504467 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:46:52.504559 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.504467 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vbjvp\"" Jul 02 13:46:52.518171 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.518145 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6"] Jul 02 13:46:52.555232 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.555204 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjd42\" (UniqueName: \"kubernetes.io/projected/1a1f21a4-ec3d-4c87-84d2-822f70c632ab-kube-api-access-cjd42\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bglw6\" (UID: \"1a1f21a4-ec3d-4c87-84d2-822f70c632ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6" Jul 02 13:46:52.555383 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.555238 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a1f21a4-ec3d-4c87-84d2-822f70c632ab-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bglw6\" (UID: \"1a1f21a4-ec3d-4c87-84d2-822f70c632ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6" Jul 02 13:46:52.655864 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.655833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjd42\" (UniqueName: \"kubernetes.io/projected/1a1f21a4-ec3d-4c87-84d2-822f70c632ab-kube-api-access-cjd42\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bglw6\" (UID: \"1a1f21a4-ec3d-4c87-84d2-822f70c632ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6" Jul 02 13:46:52.655864 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.655869 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a1f21a4-ec3d-4c87-84d2-822f70c632ab-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bglw6\" (UID: \"1a1f21a4-ec3d-4c87-84d2-822f70c632ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6" Jul 02 13:46:52.656324 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.656305 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a1f21a4-ec3d-4c87-84d2-822f70c632ab-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bglw6\" (UID: \"1a1f21a4-ec3d-4c87-84d2-822f70c632ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6" Jul 02 13:46:52.665547 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.665523 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjd42\" (UniqueName: \"kubernetes.io/projected/1a1f21a4-ec3d-4c87-84d2-822f70c632ab-kube-api-access-cjd42\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bglw6\" (UID: \"1a1f21a4-ec3d-4c87-84d2-822f70c632ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6" Jul 02 13:46:52.809418 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.809388 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6" Jul 02 13:46:52.942084 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:52.942056 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6"] Jul 02 13:46:52.946098 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:46:52.946053 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1f21a4_ec3d_4c87_84d2_822f70c632ab.slice/crio-ca866893431ff05d4684c6cce33e735c3e39ea0c008dba648c0f1d23931828f0 WatchSource:0}: Error finding container ca866893431ff05d4684c6cce33e735c3e39ea0c008dba648c0f1d23931828f0: Status 404 returned error can't find the container with id ca866893431ff05d4684c6cce33e735c3e39ea0c008dba648c0f1d23931828f0 Jul 02 13:46:53.947037 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:53.946999 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6" event={"ID":"1a1f21a4-ec3d-4c87-84d2-822f70c632ab","Type":"ContainerStarted","Data":"ca866893431ff05d4684c6cce33e735c3e39ea0c008dba648c0f1d23931828f0"} Jul 02 13:46:54.952640 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:54.952557 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6" event={"ID":"1a1f21a4-ec3d-4c87-84d2-822f70c632ab","Type":"ContainerStarted","Data":"9b95dca641cd122d988be7e4541e6be968429f41ddad0d1c85ecfa4534b7b57c"} Jul 02 13:46:54.974639 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:46:54.974595 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bglw6" podStartSLOduration=1.327361801 podStartE2EDuration="2.974580816s" totalImagesPullingTime="1.647219015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:46:54.972696023 +0000 UTC m=+326.105587588" watchObservedRunningTime="2026-07-02 13:46:54.974580816 +0000 UTC m=+326.107472380" Jul 02 13:47:01.051505 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.051466 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz"] Jul 02 13:47:01.053890 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.053873 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz" Jul 02 13:47:01.056381 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.056360 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6xx5t\"" Jul 02 13:47:01.056470 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.056405 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 13:47:01.057310 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.057294 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 13:47:01.062570 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.062544 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz"] Jul 02 13:47:01.122990 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.122950 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ee9b01d-5687-4aae-81b6-32ddf3f426bc-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2pkkz\" (UID: \"0ee9b01d-5687-4aae-81b6-32ddf3f426bc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz" Jul 02 13:47:01.123161 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.123023 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j9c7\" (UniqueName: \"kubernetes.io/projected/0ee9b01d-5687-4aae-81b6-32ddf3f426bc-kube-api-access-6j9c7\") pod \"cert-manager-cainjector-5d99449ffd-2pkkz\" (UID: \"0ee9b01d-5687-4aae-81b6-32ddf3f426bc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz" Jul 02 13:47:01.223799 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.223758 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j9c7\" (UniqueName: \"kubernetes.io/projected/0ee9b01d-5687-4aae-81b6-32ddf3f426bc-kube-api-access-6j9c7\") pod \"cert-manager-cainjector-5d99449ffd-2pkkz\" (UID: \"0ee9b01d-5687-4aae-81b6-32ddf3f426bc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz" Jul 02 13:47:01.223979 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.223827 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ee9b01d-5687-4aae-81b6-32ddf3f426bc-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2pkkz\" (UID: \"0ee9b01d-5687-4aae-81b6-32ddf3f426bc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz" Jul 02 13:47:01.232994 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.232967 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ee9b01d-5687-4aae-81b6-32ddf3f426bc-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2pkkz\" (UID: \"0ee9b01d-5687-4aae-81b6-32ddf3f426bc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz" Jul 02 13:47:01.233114 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.233098 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j9c7\" (UniqueName: \"kubernetes.io/projected/0ee9b01d-5687-4aae-81b6-32ddf3f426bc-kube-api-access-6j9c7\") pod \"cert-manager-cainjector-5d99449ffd-2pkkz\" (UID: \"0ee9b01d-5687-4aae-81b6-32ddf3f426bc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz" Jul 02 13:47:01.363792 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.363702 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz" Jul 02 13:47:01.497374 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.497302 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz"] Jul 02 13:47:01.499570 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:47:01.499543 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ee9b01d_5687_4aae_81b6_32ddf3f426bc.slice/crio-99d3491d17516828b28b5dc5da16b939d26c5d3fafda838f70ab379e4dbbd584 WatchSource:0}: Error finding container 99d3491d17516828b28b5dc5da16b939d26c5d3fafda838f70ab379e4dbbd584: Status 404 returned error can't find the container with id 99d3491d17516828b28b5dc5da16b939d26c5d3fafda838f70ab379e4dbbd584 Jul 02 13:47:01.981456 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:01.981421 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz" event={"ID":"0ee9b01d-5687-4aae-81b6-32ddf3f426bc","Type":"ContainerStarted","Data":"99d3491d17516828b28b5dc5da16b939d26c5d3fafda838f70ab379e4dbbd584"} Jul 02 13:47:05.999178 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:05.999142 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz" event={"ID":"0ee9b01d-5687-4aae-81b6-32ddf3f426bc","Type":"ContainerStarted","Data":"8b3c68b60b9cce64f6fa2a3cd6406f27087fa8f11955ff7665be62b35358c522"} Jul 02 13:47:06.014009 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:06.013956 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2pkkz" podStartSLOduration=1.355897807 podStartE2EDuration="5.013913493s" totalImagesPullingTime="3.658015686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:06.013073798 +0000 UTC m=+337.145965357" watchObservedRunningTime="2026-07-02 13:47:06.013913493 +0000 UTC m=+337.146805059" Jul 02 13:47:52.386386 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.386353 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9"] Jul 02 13:47:52.388786 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.388769 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.392694 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.392668 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 13:47:52.392828 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.392668 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 13:47:52.392828 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.392705 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 13:47:52.392828 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.392729 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 13:47:52.392828 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.392774 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6vkzj\"" Jul 02 13:47:52.404050 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.404027 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9"] Jul 02 13:47:52.416659 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.416636 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-manifests\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.416781 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.416676 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-webhook-cert\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.416781 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.416699 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg7qx\" (UniqueName: \"kubernetes.io/projected/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-kube-api-access-xg7qx\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.416781 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.416759 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-tmp\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.416890 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.416796 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.517246 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.517216 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-manifests\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.517437 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.517277 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-webhook-cert\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.517437 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.517325 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg7qx\" (UniqueName: \"kubernetes.io/projected/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-kube-api-access-xg7qx\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.517547 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.517469 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-tmp\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.517547 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.517533 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.517711 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.517674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-manifests\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.519948 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.519892 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-tmp\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.520052 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.519969 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-webhook-cert\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.520052 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.520041 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.526730 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.526706 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg7qx\" (UniqueName: \"kubernetes.io/projected/aad4c441-aba5-42e2-8aa6-b1fd2e2a8507-kube-api-access-xg7qx\") pod \"opendatahub-operator-controller-manager-5964c6974c-vlwt9\" (UID: \"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507\") " pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.699037 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.698947 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:52.831326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:52.831184 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9"] Jul 02 13:47:52.834310 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:47:52.834282 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad4c441_aba5_42e2_8aa6_b1fd2e2a8507.slice/crio-f931cd1bd7f916459fd67a7907dc8340de1c18f0ae71d12b78636d74777beba6 WatchSource:0}: Error finding container f931cd1bd7f916459fd67a7907dc8340de1c18f0ae71d12b78636d74777beba6: Status 404 returned error can't find the container with id f931cd1bd7f916459fd67a7907dc8340de1c18f0ae71d12b78636d74777beba6 Jul 02 13:47:53.179316 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:53.179281 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" event={"ID":"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507","Type":"ContainerStarted","Data":"f931cd1bd7f916459fd67a7907dc8340de1c18f0ae71d12b78636d74777beba6"} Jul 02 13:47:56.195646 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:56.195608 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" event={"ID":"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507","Type":"ContainerStarted","Data":"65b24422e572161d26d2fe26d5b7fb70d737949d4c7496be22eff596bced440f"} Jul 02 13:47:57.201004 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:57.200968 2573 generic.go:356] "Generic (PLEG): container finished" podID="aad4c441-aba5-42e2-8aa6-b1fd2e2a8507" containerID="65b24422e572161d26d2fe26d5b7fb70d737949d4c7496be22eff596bced440f" exitCode=0 Jul 02 13:47:57.201387 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:57.201054 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" event={"ID":"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507","Type":"ContainerDied","Data":"65b24422e572161d26d2fe26d5b7fb70d737949d4c7496be22eff596bced440f"} Jul 02 13:47:58.207111 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:58.207072 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" event={"ID":"aad4c441-aba5-42e2-8aa6-b1fd2e2a8507","Type":"ContainerStarted","Data":"619cec1b84cdf6491fd6c6cdae60f9b828090287dc5ced8836e74dfd83493b84"} Jul 02 13:47:58.207610 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:58.207200 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:47:58.229427 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:47:58.229375 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" podStartSLOduration=1.6409631120000001 podStartE2EDuration="6.229359596s" totalImagesPullingTime="3.531001617s" totalInitContainerRuntime="1.057394867s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:58.227768759 +0000 UTC m=+389.360660343" watchObservedRunningTime="2026-07-02 13:47:58.229359596 +0000 UTC m=+389.362251160" Jul 02 13:48:09.213604 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:09.213562 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5964c6974c-vlwt9" Jul 02 13:48:12.458613 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.458578 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg"] Jul 02 13:48:12.468899 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.468870 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" Jul 02 13:48:12.472158 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.472134 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 13:48:12.472359 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.472134 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 13:48:12.472359 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.472139 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xhzh6\"" Jul 02 13:48:12.480556 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.480537 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg"] Jul 02 13:48:12.587559 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.587521 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7937e1a5-4210-4fe9-b34d-a0fd19acac8e-tmp\") pod \"kube-auth-proxy-685667f9f9-4ckgg\" (UID: \"7937e1a5-4210-4fe9-b34d-a0fd19acac8e\") " pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" Jul 02 13:48:12.587706 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.587571 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwplv\" (UniqueName: \"kubernetes.io/projected/7937e1a5-4210-4fe9-b34d-a0fd19acac8e-kube-api-access-jwplv\") pod \"kube-auth-proxy-685667f9f9-4ckgg\" (UID: \"7937e1a5-4210-4fe9-b34d-a0fd19acac8e\") " pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" Jul 02 13:48:12.587706 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.587664 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7937e1a5-4210-4fe9-b34d-a0fd19acac8e-tls-certs\") pod \"kube-auth-proxy-685667f9f9-4ckgg\" (UID: \"7937e1a5-4210-4fe9-b34d-a0fd19acac8e\") " pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" Jul 02 13:48:12.664822 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.664787 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gvmbx"] Jul 02 13:48:12.667586 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.667568 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" Jul 02 13:48:12.670171 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.670150 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 02 13:48:12.670171 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.670162 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ssjlq\"" Jul 02 13:48:12.679552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.679529 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gvmbx"] Jul 02 13:48:12.688097 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.688076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7937e1a5-4210-4fe9-b34d-a0fd19acac8e-tmp\") pod \"kube-auth-proxy-685667f9f9-4ckgg\" (UID: \"7937e1a5-4210-4fe9-b34d-a0fd19acac8e\") " pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" Jul 02 13:48:12.688195 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.688106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwplv\" (UniqueName: \"kubernetes.io/projected/7937e1a5-4210-4fe9-b34d-a0fd19acac8e-kube-api-access-jwplv\") pod \"kube-auth-proxy-685667f9f9-4ckgg\" (UID: \"7937e1a5-4210-4fe9-b34d-a0fd19acac8e\") " pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" Jul 02 13:48:12.688195 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.688132 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7937e1a5-4210-4fe9-b34d-a0fd19acac8e-tls-certs\") pod \"kube-auth-proxy-685667f9f9-4ckgg\" (UID: \"7937e1a5-4210-4fe9-b34d-a0fd19acac8e\") " pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" Jul 02 13:48:12.690406 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.690381 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7937e1a5-4210-4fe9-b34d-a0fd19acac8e-tmp\") pod \"kube-auth-proxy-685667f9f9-4ckgg\" (UID: \"7937e1a5-4210-4fe9-b34d-a0fd19acac8e\") " pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" Jul 02 13:48:12.690499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.690457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7937e1a5-4210-4fe9-b34d-a0fd19acac8e-tls-certs\") pod \"kube-auth-proxy-685667f9f9-4ckgg\" (UID: \"7937e1a5-4210-4fe9-b34d-a0fd19acac8e\") " pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" Jul 02 13:48:12.705104 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.705083 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwplv\" (UniqueName: \"kubernetes.io/projected/7937e1a5-4210-4fe9-b34d-a0fd19acac8e-kube-api-access-jwplv\") pod \"kube-auth-proxy-685667f9f9-4ckgg\" (UID: \"7937e1a5-4210-4fe9-b34d-a0fd19acac8e\") " pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" Jul 02 13:48:12.778724 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.778685 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" Jul 02 13:48:12.789197 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.789152 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9tnx\" (UniqueName: \"kubernetes.io/projected/dba6fac0-5766-4c7a-969a-fd0af3e14c8d-kube-api-access-d9tnx\") pod \"odh-model-controller-7998c67dc4-gvmbx\" (UID: \"dba6fac0-5766-4c7a-969a-fd0af3e14c8d\") " pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" Jul 02 13:48:12.789304 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.789283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dba6fac0-5766-4c7a-969a-fd0af3e14c8d-cert\") pod \"odh-model-controller-7998c67dc4-gvmbx\" (UID: \"dba6fac0-5766-4c7a-969a-fd0af3e14c8d\") " pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" Jul 02 13:48:12.890667 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.890577 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9tnx\" (UniqueName: \"kubernetes.io/projected/dba6fac0-5766-4c7a-969a-fd0af3e14c8d-kube-api-access-d9tnx\") pod \"odh-model-controller-7998c67dc4-gvmbx\" (UID: \"dba6fac0-5766-4c7a-969a-fd0af3e14c8d\") " pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" Jul 02 13:48:12.891216 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.890867 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dba6fac0-5766-4c7a-969a-fd0af3e14c8d-cert\") pod \"odh-model-controller-7998c67dc4-gvmbx\" (UID: \"dba6fac0-5766-4c7a-969a-fd0af3e14c8d\") " pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" Jul 02 13:48:12.891216 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:48:12.890988 2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 02 13:48:12.891216 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:48:12.891078 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba6fac0-5766-4c7a-969a-fd0af3e14c8d-cert podName:dba6fac0-5766-4c7a-969a-fd0af3e14c8d nodeName:}" failed. No retries permitted until 2026-07-02 13:48:13.391053684 +0000 UTC m=+404.523945228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dba6fac0-5766-4c7a-969a-fd0af3e14c8d-cert") pod "odh-model-controller-7998c67dc4-gvmbx" (UID: "dba6fac0-5766-4c7a-969a-fd0af3e14c8d") : secret "odh-model-controller-webhook-cert" not found Jul 02 13:48:12.900037 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.900010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9tnx\" (UniqueName: \"kubernetes.io/projected/dba6fac0-5766-4c7a-969a-fd0af3e14c8d-kube-api-access-d9tnx\") pod \"odh-model-controller-7998c67dc4-gvmbx\" (UID: \"dba6fac0-5766-4c7a-969a-fd0af3e14c8d\") " pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" Jul 02 13:48:12.924619 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:12.924488 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg"] Jul 02 13:48:12.927343 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:48:12.927313 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7937e1a5_4210_4fe9_b34d_a0fd19acac8e.slice/crio-2158354b118685e49a4e6e8b86172f817c797de94e6c40e385158fb95bb977ba WatchSource:0}: Error finding container 2158354b118685e49a4e6e8b86172f817c797de94e6c40e385158fb95bb977ba: Status 404 returned error can't find the container with id 2158354b118685e49a4e6e8b86172f817c797de94e6c40e385158fb95bb977ba Jul 02 13:48:13.272322 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.272286 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" event={"ID":"7937e1a5-4210-4fe9-b34d-a0fd19acac8e","Type":"ContainerStarted","Data":"2158354b118685e49a4e6e8b86172f817c797de94e6c40e385158fb95bb977ba"} Jul 02 13:48:13.394631 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.394600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dba6fac0-5766-4c7a-969a-fd0af3e14c8d-cert\") pod \"odh-model-controller-7998c67dc4-gvmbx\" (UID: \"dba6fac0-5766-4c7a-969a-fd0af3e14c8d\") " pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" Jul 02 13:48:13.397065 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.397036 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dba6fac0-5766-4c7a-969a-fd0af3e14c8d-cert\") pod \"odh-model-controller-7998c67dc4-gvmbx\" (UID: \"dba6fac0-5766-4c7a-969a-fd0af3e14c8d\") " pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" Jul 02 13:48:13.577697 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.577605 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" Jul 02 13:48:13.595993 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.595961 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-v6zwm"] Jul 02 13:48:13.598365 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.598345 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" Jul 02 13:48:13.603725 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.603702 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 02 13:48:13.614334 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.614310 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-v6zwm"] Jul 02 13:48:13.696940 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.696883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2tq8\" (UniqueName: \"kubernetes.io/projected/e8bfea93-cf42-482d-a87a-99779369c3d9-kube-api-access-s2tq8\") pod \"model-serving-api-54d89bd5fc-v6zwm\" (UID: \"e8bfea93-cf42-482d-a87a-99779369c3d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" Jul 02 13:48:13.697081 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.697040 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8bfea93-cf42-482d-a87a-99779369c3d9-tls-certs\") pod \"model-serving-api-54d89bd5fc-v6zwm\" (UID: \"e8bfea93-cf42-482d-a87a-99779369c3d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" Jul 02 13:48:13.731770 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.731709 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gvmbx"] Jul 02 13:48:13.734471 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:48:13.734441 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba6fac0_5766_4c7a_969a_fd0af3e14c8d.slice/crio-587f880e849ace39685868a12e2260a94ba05dfbfdf79938bc662cac1ef71f06 WatchSource:0}: Error finding container 587f880e849ace39685868a12e2260a94ba05dfbfdf79938bc662cac1ef71f06: Status 404 returned error can't find the container with id 587f880e849ace39685868a12e2260a94ba05dfbfdf79938bc662cac1ef71f06 Jul 02 13:48:13.798006 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.797952 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8bfea93-cf42-482d-a87a-99779369c3d9-tls-certs\") pod \"model-serving-api-54d89bd5fc-v6zwm\" (UID: \"e8bfea93-cf42-482d-a87a-99779369c3d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" Jul 02 13:48:13.798168 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.798049 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2tq8\" (UniqueName: \"kubernetes.io/projected/e8bfea93-cf42-482d-a87a-99779369c3d9-kube-api-access-s2tq8\") pod \"model-serving-api-54d89bd5fc-v6zwm\" (UID: \"e8bfea93-cf42-482d-a87a-99779369c3d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" Jul 02 13:48:13.800756 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.800732 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8bfea93-cf42-482d-a87a-99779369c3d9-tls-certs\") pod \"model-serving-api-54d89bd5fc-v6zwm\" (UID: \"e8bfea93-cf42-482d-a87a-99779369c3d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" Jul 02 13:48:13.813219 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.813196 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2tq8\" (UniqueName: \"kubernetes.io/projected/e8bfea93-cf42-482d-a87a-99779369c3d9-kube-api-access-s2tq8\") pod \"model-serving-api-54d89bd5fc-v6zwm\" (UID: \"e8bfea93-cf42-482d-a87a-99779369c3d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" Jul 02 13:48:13.912487 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.912408 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" Jul 02 13:48:13.925274 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.925110 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn"] Jul 02 13:48:13.929155 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.929122 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:13.933050 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.933023 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 13:48:13.933363 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.933342 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 13:48:13.933499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.933482 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 13:48:13.933788 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.933768 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 13:48:13.934419 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.934398 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4j4mh\"" Jul 02 13:48:13.941751 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.941720 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn"] Jul 02 13:48:14.000040 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.999100 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.000040 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.999146 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d194f66-c6df-4ba6-b964-d80254322e88-local-certs\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.000040 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.999173 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-cacerts\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.000040 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.999245 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d194f66-c6df-4ba6-b964-d80254322e88-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.000040 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.999285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.000040 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.999341 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42gxv\" (UniqueName: \"kubernetes.io/projected/5d194f66-c6df-4ba6-b964-d80254322e88-kube-api-access-42gxv\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.000040 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:13.999374 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d194f66-c6df-4ba6-b964-d80254322e88-istio-token\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.093053 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.093027 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-v6zwm"] Jul 02 13:48:14.095769 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:48:14.095737 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8bfea93_cf42_482d_a87a_99779369c3d9.slice/crio-3c372f85cc2a1c184bf42b520aaba0bd3a64079a0f66f57ecb965b6087a6d43b WatchSource:0}: Error finding container 3c372f85cc2a1c184bf42b520aaba0bd3a64079a0f66f57ecb965b6087a6d43b: Status 404 returned error can't find the container with id 3c372f85cc2a1c184bf42b520aaba0bd3a64079a0f66f57ecb965b6087a6d43b Jul 02 13:48:14.101532 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.101449 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gxv\" (UniqueName: \"kubernetes.io/projected/5d194f66-c6df-4ba6-b964-d80254322e88-kube-api-access-42gxv\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.101532 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.101496 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d194f66-c6df-4ba6-b964-d80254322e88-istio-token\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.101532 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.101530 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.101824 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.101558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d194f66-c6df-4ba6-b964-d80254322e88-local-certs\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.101824 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.101582 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-cacerts\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.101824 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.101668 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d194f66-c6df-4ba6-b964-d80254322e88-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.101824 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.101708 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.102745 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.102700 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d194f66-c6df-4ba6-b964-d80254322e88-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.104610 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.104584 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d194f66-c6df-4ba6-b964-d80254322e88-local-certs\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.104788 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.104770 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-cacerts\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.104854 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.104817 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.105165 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.105150 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.109417 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.109399 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d194f66-c6df-4ba6-b964-d80254322e88-istio-token\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.109754 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.109735 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42gxv\" (UniqueName: \"kubernetes.io/projected/5d194f66-c6df-4ba6-b964-d80254322e88-kube-api-access-42gxv\") pod \"istiod-openshift-gateway-7574459656-xwhwn\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.248546 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.248459 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:14.279586 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.279510 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" event={"ID":"e8bfea93-cf42-482d-a87a-99779369c3d9","Type":"ContainerStarted","Data":"3c372f85cc2a1c184bf42b520aaba0bd3a64079a0f66f57ecb965b6087a6d43b"} Jul 02 13:48:14.281036 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.281009 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" event={"ID":"dba6fac0-5766-4c7a-969a-fd0af3e14c8d","Type":"ContainerStarted","Data":"587f880e849ace39685868a12e2260a94ba05dfbfdf79938bc662cac1ef71f06"} Jul 02 13:48:14.403052 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:14.403026 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn"] Jul 02 13:48:14.404759 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:48:14.404732 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d194f66_c6df_4ba6_b964_d80254322e88.slice/crio-4047390a748d34ec11260df1a3c2be59a2c8866d6cc03faa8f196d302669dd50 WatchSource:0}: Error finding container 4047390a748d34ec11260df1a3c2be59a2c8866d6cc03faa8f196d302669dd50: Status 404 returned error can't find the container with id 4047390a748d34ec11260df1a3c2be59a2c8866d6cc03faa8f196d302669dd50 Jul 02 13:48:15.289265 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:15.289190 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" event={"ID":"5d194f66-c6df-4ba6-b964-d80254322e88","Type":"ContainerStarted","Data":"4047390a748d34ec11260df1a3c2be59a2c8866d6cc03faa8f196d302669dd50"} Jul 02 13:48:19.316379 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:19.316337 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" event={"ID":"dba6fac0-5766-4c7a-969a-fd0af3e14c8d","Type":"ContainerStarted","Data":"045f0cfb46aa3503e8d1e717ac2b61a05f840df7b2210e6430f464ad15f92d74"} Jul 02 13:48:19.316851 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:19.316550 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" Jul 02 13:48:19.318419 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:19.318391 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" event={"ID":"e8bfea93-cf42-482d-a87a-99779369c3d9","Type":"ContainerStarted","Data":"0fa7ad28ba9a95fc38c7d08f154e53c824d3d6da033093574ae36f302d76a3b4"} Jul 02 13:48:19.318527 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:19.318443 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" Jul 02 13:48:19.320161 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:19.320126 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" event={"ID":"7937e1a5-4210-4fe9-b34d-a0fd19acac8e","Type":"ContainerStarted","Data":"94e481720b359ffa05271998ad9830e1ce61dea7c6ad3ad40eb64b669558f73e"} Jul 02 13:48:19.336448 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:19.336384 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" podStartSLOduration=2.678401686 podStartE2EDuration="7.33636291s" totalImagesPullingTime="4.657961224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:48:19.334644567 +0000 UTC m=+410.467536143" watchObservedRunningTime="2026-07-02 13:48:19.33636291 +0000 UTC m=+410.469254475" Jul 02 13:48:19.353704 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:19.353652 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" podStartSLOduration=2.074071408 podStartE2EDuration="6.353635267s" totalImagesPullingTime="4.279563859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:48:19.352010664 +0000 UTC m=+410.484902232" watchObservedRunningTime="2026-07-02 13:48:19.353635267 +0000 UTC m=+410.486526832" Jul 02 13:48:19.370230 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:19.370073 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-685667f9f9-4ckgg" podStartSLOduration=1.9183841400000001 podStartE2EDuration="7.370050171s" totalImagesPullingTime="5.451666031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:48:19.369239892 +0000 UTC m=+410.502131458" watchObservedRunningTime="2026-07-02 13:48:19.370050171 +0000 UTC m=+410.502941738" Jul 02 13:48:19.452107 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:19.452059 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 13:48:19.452197 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:19.452150 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 13:48:20.331767 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:20.331720 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" event={"ID":"5d194f66-c6df-4ba6-b964-d80254322e88","Type":"ContainerStarted","Data":"27a204727cb15fef4645c578e528aebb7a9c5ecdb3b59678e372f7e72a7aab2d"} Jul 02 13:48:20.332225 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:20.332149 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:20.334775 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:20.334636 2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xwhwn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 13:48:20.334775 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:20.334688 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" podUID="5d194f66-c6df-4ba6-b964-d80254322e88" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 13:48:21.337049 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:21.337020 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:21.385853 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:21.385799 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" podStartSLOduration=3.340998557 podStartE2EDuration="8.385766689s" totalImagesPullingTime="5.044768132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:48:20.358953167 +0000 UTC m=+411.491844732" watchObservedRunningTime="2026-07-02 13:48:21.385766689 +0000 UTC m=+412.518658254" Jul 02 13:48:24.492514 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.492484 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd"] Jul 02 13:48:24.496054 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.496028 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" Jul 02 13:48:24.498656 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.498632 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 02 13:48:24.498756 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.498668 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-c2pkc\"" Jul 02 13:48:24.502073 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.502050 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc"] Jul 02 13:48:24.509308 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.509287 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" Jul 02 13:48:24.510784 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.510763 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd"] Jul 02 13:48:24.512417 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.512398 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4c5sz\"" Jul 02 13:48:24.512557 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.512506 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 02 13:48:24.518651 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.518632 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc"] Jul 02 13:48:24.595961 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.595908 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b46c28c6-4740-4d76-816b-80790338d545-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2vxxc\" (UID: \"b46c28c6-4740-4d76-816b-80790338d545\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" Jul 02 13:48:24.595961 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.595957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqghv\" (UniqueName: \"kubernetes.io/projected/b46c28c6-4740-4d76-816b-80790338d545-kube-api-access-cqghv\") pod \"llmisvc-controller-manager-777c6bd7d5-2vxxc\" (UID: \"b46c28c6-4740-4d76-816b-80790338d545\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" Jul 02 13:48:24.596179 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.596067 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj774\" (UniqueName: \"kubernetes.io/projected/25c05d4c-5ff3-4b9b-90ab-a669d841def2-kube-api-access-nj774\") pod \"kserve-controller-manager-d6f4b65b8-5nbtd\" (UID: \"25c05d4c-5ff3-4b9b-90ab-a669d841def2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" Jul 02 13:48:24.596179 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.596104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25c05d4c-5ff3-4b9b-90ab-a669d841def2-cert\") pod \"kserve-controller-manager-d6f4b65b8-5nbtd\" (UID: \"25c05d4c-5ff3-4b9b-90ab-a669d841def2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" Jul 02 13:48:24.697401 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.697367 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25c05d4c-5ff3-4b9b-90ab-a669d841def2-cert\") pod \"kserve-controller-manager-d6f4b65b8-5nbtd\" (UID: \"25c05d4c-5ff3-4b9b-90ab-a669d841def2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" Jul 02 13:48:24.697613 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.697444 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b46c28c6-4740-4d76-816b-80790338d545-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2vxxc\" (UID: \"b46c28c6-4740-4d76-816b-80790338d545\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" Jul 02 13:48:24.697613 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.697467 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqghv\" (UniqueName: \"kubernetes.io/projected/b46c28c6-4740-4d76-816b-80790338d545-kube-api-access-cqghv\") pod \"llmisvc-controller-manager-777c6bd7d5-2vxxc\" (UID: \"b46c28c6-4740-4d76-816b-80790338d545\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" Jul 02 13:48:24.697613 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.697545 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj774\" (UniqueName: \"kubernetes.io/projected/25c05d4c-5ff3-4b9b-90ab-a669d841def2-kube-api-access-nj774\") pod \"kserve-controller-manager-d6f4b65b8-5nbtd\" (UID: \"25c05d4c-5ff3-4b9b-90ab-a669d841def2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" Jul 02 13:48:24.697613 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:48:24.697558 2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 02 13:48:24.697788 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:48:24.697677 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46c28c6-4740-4d76-816b-80790338d545-cert podName:b46c28c6-4740-4d76-816b-80790338d545 nodeName:}" failed. No retries permitted until 2026-07-02 13:48:25.197653445 +0000 UTC m=+416.330544991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b46c28c6-4740-4d76-816b-80790338d545-cert") pod "llmisvc-controller-manager-777c6bd7d5-2vxxc" (UID: "b46c28c6-4740-4d76-816b-80790338d545") : secret "llmisvc-webhook-server-cert" not found Jul 02 13:48:24.700177 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.700155 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25c05d4c-5ff3-4b9b-90ab-a669d841def2-cert\") pod \"kserve-controller-manager-d6f4b65b8-5nbtd\" (UID: \"25c05d4c-5ff3-4b9b-90ab-a669d841def2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" Jul 02 13:48:24.714740 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.714701 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj774\" (UniqueName: \"kubernetes.io/projected/25c05d4c-5ff3-4b9b-90ab-a669d841def2-kube-api-access-nj774\") pod \"kserve-controller-manager-d6f4b65b8-5nbtd\" (UID: \"25c05d4c-5ff3-4b9b-90ab-a669d841def2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" Jul 02 13:48:24.728156 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.728132 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqghv\" (UniqueName: \"kubernetes.io/projected/b46c28c6-4740-4d76-816b-80790338d545-kube-api-access-cqghv\") pod \"llmisvc-controller-manager-777c6bd7d5-2vxxc\" (UID: \"b46c28c6-4740-4d76-816b-80790338d545\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" Jul 02 13:48:24.808959 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.808912 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" Jul 02 13:48:24.986122 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:24.986097 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd"] Jul 02 13:48:24.987374 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:48:24.987348 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c05d4c_5ff3_4b9b_90ab_a669d841def2.slice/crio-93348eb1c9e4f76310069d22c5ec1e7efc008e716fa118f38194e7f94a1a83db WatchSource:0}: Error finding container 93348eb1c9e4f76310069d22c5ec1e7efc008e716fa118f38194e7f94a1a83db: Status 404 returned error can't find the container with id 93348eb1c9e4f76310069d22c5ec1e7efc008e716fa118f38194e7f94a1a83db Jul 02 13:48:25.203112 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:25.203021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b46c28c6-4740-4d76-816b-80790338d545-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2vxxc\" (UID: \"b46c28c6-4740-4d76-816b-80790338d545\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" Jul 02 13:48:25.205416 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:25.205386 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b46c28c6-4740-4d76-816b-80790338d545-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2vxxc\" (UID: \"b46c28c6-4740-4d76-816b-80790338d545\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" Jul 02 13:48:25.355343 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:25.355308 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" event={"ID":"25c05d4c-5ff3-4b9b-90ab-a669d841def2","Type":"ContainerStarted","Data":"93348eb1c9e4f76310069d22c5ec1e7efc008e716fa118f38194e7f94a1a83db"} Jul 02 13:48:25.425689 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:25.425646 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" Jul 02 13:48:25.557657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:25.557625 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc"] Jul 02 13:48:25.559820 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:48:25.559799 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb46c28c6_4740_4d76_816b_80790338d545.slice/crio-805b54b9e31eca8b8421ffcc0bd34e93da080caf99889a7939b024d7ac0edadb WatchSource:0}: Error finding container 805b54b9e31eca8b8421ffcc0bd34e93da080caf99889a7939b024d7ac0edadb: Status 404 returned error can't find the container with id 805b54b9e31eca8b8421ffcc0bd34e93da080caf99889a7939b024d7ac0edadb Jul 02 13:48:26.362386 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:26.362353 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" event={"ID":"b46c28c6-4740-4d76-816b-80790338d545","Type":"ContainerStarted","Data":"805b54b9e31eca8b8421ffcc0bd34e93da080caf99889a7939b024d7ac0edadb"} Jul 02 13:48:27.212439 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:27.212402 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn"] Jul 02 13:48:27.212879 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:27.212627 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" podUID="5d194f66-c6df-4ba6-b964-d80254322e88" containerName="discovery" containerID="cri-o://27a204727cb15fef4645c578e528aebb7a9c5ecdb3b59678e372f7e72a7aab2d" gracePeriod=30 Jul 02 13:48:27.336907 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:27.336876 2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xwhwn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.26:8080/ready\": dial tcp 10.133.0.26:8080: connect: connection refused" start-of-body= Jul 02 13:48:27.337090 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:27.336970 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" podUID="5d194f66-c6df-4ba6-b964-d80254322e88" containerName="discovery" probeResult="failure" output="Get \"http://10.133.0.26:8080/ready\": dial tcp 10.133.0.26:8080: connect: connection refused" Jul 02 13:48:27.372194 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:27.372130 2573 generic.go:356] "Generic (PLEG): container finished" podID="5d194f66-c6df-4ba6-b964-d80254322e88" containerID="27a204727cb15fef4645c578e528aebb7a9c5ecdb3b59678e372f7e72a7aab2d" exitCode=0 Jul 02 13:48:27.372374 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:27.372241 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" event={"ID":"5d194f66-c6df-4ba6-b964-d80254322e88","Type":"ContainerDied","Data":"27a204727cb15fef4645c578e528aebb7a9c5ecdb3b59678e372f7e72a7aab2d"} Jul 02 13:48:28.021780 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.021754 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:28.128077 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.128048 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42gxv\" (UniqueName: \"kubernetes.io/projected/5d194f66-c6df-4ba6-b964-d80254322e88-kube-api-access-42gxv\") pod \"5d194f66-c6df-4ba6-b964-d80254322e88\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " Jul 02 13:48:28.128218 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.128104 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-cacerts\") pod \"5d194f66-c6df-4ba6-b964-d80254322e88\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " Jul 02 13:48:28.128335 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.128261 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-istio-kubeconfig\") pod \"5d194f66-c6df-4ba6-b964-d80254322e88\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " Jul 02 13:48:28.128396 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.128333 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-istio-csr-dns-cert\") pod \"5d194f66-c6df-4ba6-b964-d80254322e88\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " Jul 02 13:48:28.128396 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.128376 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d194f66-c6df-4ba6-b964-d80254322e88-istio-csr-ca-configmap\") pod \"5d194f66-c6df-4ba6-b964-d80254322e88\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " Jul 02 13:48:28.128496 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.128402 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d194f66-c6df-4ba6-b964-d80254322e88-istio-token\") pod \"5d194f66-c6df-4ba6-b964-d80254322e88\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " Jul 02 13:48:28.128496 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.128428 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d194f66-c6df-4ba6-b964-d80254322e88-local-certs\") pod \"5d194f66-c6df-4ba6-b964-d80254322e88\" (UID: \"5d194f66-c6df-4ba6-b964-d80254322e88\") " Jul 02 13:48:28.128817 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.128790 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d194f66-c6df-4ba6-b964-d80254322e88-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5d194f66-c6df-4ba6-b964-d80254322e88" (UID: "5d194f66-c6df-4ba6-b964-d80254322e88"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:48:28.131391 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.131365 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-cacerts" (OuterVolumeSpecName: "cacerts") pod "5d194f66-c6df-4ba6-b964-d80254322e88" (UID: "5d194f66-c6df-4ba6-b964-d80254322e88"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:48:28.132326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.132298 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d194f66-c6df-4ba6-b964-d80254322e88-local-certs" (OuterVolumeSpecName: "local-certs") pod "5d194f66-c6df-4ba6-b964-d80254322e88" (UID: "5d194f66-c6df-4ba6-b964-d80254322e88"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:48:28.132679 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.132643 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d194f66-c6df-4ba6-b964-d80254322e88-kube-api-access-42gxv" (OuterVolumeSpecName: "kube-api-access-42gxv") pod "5d194f66-c6df-4ba6-b964-d80254322e88" (UID: "5d194f66-c6df-4ba6-b964-d80254322e88"). InnerVolumeSpecName "kube-api-access-42gxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:48:28.132762 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.132740 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5d194f66-c6df-4ba6-b964-d80254322e88" (UID: "5d194f66-c6df-4ba6-b964-d80254322e88"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:48:28.133135 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.133107 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d194f66-c6df-4ba6-b964-d80254322e88-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d194f66-c6df-4ba6-b964-d80254322e88" (UID: "5d194f66-c6df-4ba6-b964-d80254322e88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:48:28.133258 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.133226 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5d194f66-c6df-4ba6-b964-d80254322e88" (UID: "5d194f66-c6df-4ba6-b964-d80254322e88"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:48:28.229241 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.229206 2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-istio-kubeconfig\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:48:28.229241 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.229234 2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-istio-csr-dns-cert\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:48:28.229241 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.229244 2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d194f66-c6df-4ba6-b964-d80254322e88-istio-csr-ca-configmap\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:48:28.229704 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.229252 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d194f66-c6df-4ba6-b964-d80254322e88-istio-token\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:48:28.229704 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.229262 2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d194f66-c6df-4ba6-b964-d80254322e88-local-certs\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:48:28.229704 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.229270 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42gxv\" (UniqueName: \"kubernetes.io/projected/5d194f66-c6df-4ba6-b964-d80254322e88-kube-api-access-42gxv\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:48:28.229704 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.229278 2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d194f66-c6df-4ba6-b964-d80254322e88-cacerts\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:48:28.380664 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.380607 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" event={"ID":"25c05d4c-5ff3-4b9b-90ab-a669d841def2","Type":"ContainerStarted","Data":"0a7d687f102aedbb1ea5645e09050e9eba8df07aef06f698c480e86b0d50096d"} Jul 02 13:48:28.380872 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.380842 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" Jul 02 13:48:28.382296 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.382272 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" event={"ID":"5d194f66-c6df-4ba6-b964-d80254322e88","Type":"ContainerDied","Data":"4047390a748d34ec11260df1a3c2be59a2c8866d6cc03faa8f196d302669dd50"} Jul 02 13:48:28.382389 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.382304 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn" Jul 02 13:48:28.382389 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.382328 2573 scope.go:117] "RemoveContainer" containerID="27a204727cb15fef4645c578e528aebb7a9c5ecdb3b59678e372f7e72a7aab2d" Jul 02 13:48:28.406605 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.406552 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" podStartSLOduration=1.340350404 podStartE2EDuration="4.40653772s" totalImagesPullingTime="3.066187316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:48:28.40552693 +0000 UTC m=+419.538418519" watchObservedRunningTime="2026-07-02 13:48:28.40653772 +0000 UTC m=+419.539429286" Jul 02 13:48:28.427404 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.427376 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn"] Jul 02 13:48:28.431343 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:28.431310 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xwhwn"] Jul 02 13:48:29.388293 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:29.388252 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" event={"ID":"b46c28c6-4740-4d76-816b-80790338d545","Type":"ContainerStarted","Data":"d6f013e019995267ad1a605d4c2447c3458560b05dd2a5b27501c846c2ee291f"} Jul 02 13:48:29.388770 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:29.388353 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" Jul 02 13:48:29.414515 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:29.414468 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" podStartSLOduration=2.074053378 podStartE2EDuration="5.414453816s" totalImagesPullingTime="3.340400438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:48:29.412560995 +0000 UTC m=+420.545452560" watchObservedRunningTime="2026-07-02 13:48:29.414453816 +0000 UTC m=+420.547345407" Jul 02 13:48:29.479260 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:29.479230 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d194f66-c6df-4ba6-b964-d80254322e88" path="/var/lib/kubelet/pods/5d194f66-c6df-4ba6-b964-d80254322e88/volumes" Jul 02 13:48:30.334651 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:30.334618 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-gvmbx" Jul 02 13:48:30.336395 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:30.336376 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-v6zwm" Jul 02 13:48:59.394406 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:48:59.394330 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5nbtd" Jul 02 13:49:00.395792 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:00.395763 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2vxxc" Jul 02 13:49:13.639909 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.639871 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mgkns"] Jul 02 13:49:13.640347 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.640284 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d194f66-c6df-4ba6-b964-d80254322e88" containerName="discovery" Jul 02 13:49:13.640347 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.640300 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d194f66-c6df-4ba6-b964-d80254322e88" containerName="discovery" Jul 02 13:49:13.640435 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.640386 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d194f66-c6df-4ba6-b964-d80254322e88" containerName="discovery" Jul 02 13:49:13.645349 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.645324 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mgkns" Jul 02 13:49:13.648880 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.648858 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 13:49:13.649647 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.649624 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gvmhd\"" Jul 02 13:49:13.649748 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.649633 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 13:49:13.661725 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.661699 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mgkns"] Jul 02 13:49:13.710054 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.710026 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcmkf\" (UniqueName: \"kubernetes.io/projected/b20f9c0c-d782-4714-9300-29aa3503655e-kube-api-access-jcmkf\") pod \"kuadrant-operator-catalog-mgkns\" (UID: \"b20f9c0c-d782-4714-9300-29aa3503655e\") " pod="kuadrant-system/kuadrant-operator-catalog-mgkns" Jul 02 13:49:13.811305 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.811274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcmkf\" (UniqueName: \"kubernetes.io/projected/b20f9c0c-d782-4714-9300-29aa3503655e-kube-api-access-jcmkf\") pod \"kuadrant-operator-catalog-mgkns\" (UID: \"b20f9c0c-d782-4714-9300-29aa3503655e\") " pod="kuadrant-system/kuadrant-operator-catalog-mgkns" Jul 02 13:49:13.822971 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.822949 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcmkf\" (UniqueName: \"kubernetes.io/projected/b20f9c0c-d782-4714-9300-29aa3503655e-kube-api-access-jcmkf\") pod \"kuadrant-operator-catalog-mgkns\" (UID: \"b20f9c0c-d782-4714-9300-29aa3503655e\") " pod="kuadrant-system/kuadrant-operator-catalog-mgkns" Jul 02 13:49:13.952082 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.951987 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mgkns"] Jul 02 13:49:13.952301 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:13.952285 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mgkns" Jul 02 13:49:14.107722 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:14.107625 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mgkns"] Jul 02 13:49:14.110370 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:49:14.110348 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20f9c0c_d782_4714_9300_29aa3503655e.slice/crio-941b4d4f3d2673ffc612769d9fc1b6fe3755843da49418f12fcf83306be2caca WatchSource:0}: Error finding container 941b4d4f3d2673ffc612769d9fc1b6fe3755843da49418f12fcf83306be2caca: Status 404 returned error can't find the container with id 941b4d4f3d2673ffc612769d9fc1b6fe3755843da49418f12fcf83306be2caca Jul 02 13:49:14.211543 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:14.211467 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6rtfn"] Jul 02 13:49:14.214325 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:14.214306 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6rtfn"] Jul 02 13:49:14.214438 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:14.214382 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6rtfn" Jul 02 13:49:14.314978 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:14.314948 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh7zs\" (UniqueName: \"kubernetes.io/projected/c88364ae-2c49-4371-9099-3ba52b5989e2-kube-api-access-sh7zs\") pod \"kuadrant-operator-catalog-6rtfn\" (UID: \"c88364ae-2c49-4371-9099-3ba52b5989e2\") " pod="kuadrant-system/kuadrant-operator-catalog-6rtfn" Jul 02 13:49:14.415552 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:14.415502 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh7zs\" (UniqueName: \"kubernetes.io/projected/c88364ae-2c49-4371-9099-3ba52b5989e2-kube-api-access-sh7zs\") pod \"kuadrant-operator-catalog-6rtfn\" (UID: \"c88364ae-2c49-4371-9099-3ba52b5989e2\") " pod="kuadrant-system/kuadrant-operator-catalog-6rtfn" Jul 02 13:49:14.424326 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:14.424302 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh7zs\" (UniqueName: \"kubernetes.io/projected/c88364ae-2c49-4371-9099-3ba52b5989e2-kube-api-access-sh7zs\") pod \"kuadrant-operator-catalog-6rtfn\" (UID: \"c88364ae-2c49-4371-9099-3ba52b5989e2\") " pod="kuadrant-system/kuadrant-operator-catalog-6rtfn" Jul 02 13:49:14.524087 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:14.524053 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6rtfn" Jul 02 13:49:14.592988 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:14.592952 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mgkns" event={"ID":"b20f9c0c-d782-4714-9300-29aa3503655e","Type":"ContainerStarted","Data":"941b4d4f3d2673ffc612769d9fc1b6fe3755843da49418f12fcf83306be2caca"} Jul 02 13:49:14.658884 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:14.658853 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6rtfn"] Jul 02 13:49:14.662139 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:49:14.662115 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc88364ae_2c49_4371_9099_3ba52b5989e2.slice/crio-2c0bcf82b8c27bdd13dcf1094af397255dbb157486769a4d01eaf4084cdfdc1d WatchSource:0}: Error finding container 2c0bcf82b8c27bdd13dcf1094af397255dbb157486769a4d01eaf4084cdfdc1d: Status 404 returned error can't find the container with id 2c0bcf82b8c27bdd13dcf1094af397255dbb157486769a4d01eaf4084cdfdc1d Jul 02 13:49:15.601164 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:15.601127 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6rtfn" event={"ID":"c88364ae-2c49-4371-9099-3ba52b5989e2","Type":"ContainerStarted","Data":"2c0bcf82b8c27bdd13dcf1094af397255dbb157486769a4d01eaf4084cdfdc1d"} Jul 02 13:49:16.607253 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:16.607154 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6rtfn" event={"ID":"c88364ae-2c49-4371-9099-3ba52b5989e2","Type":"ContainerStarted","Data":"11928ef5582f39a5ce5614baf3b355eea864b76c1fef026d8cc9d307ba961d0b"} Jul 02 13:49:16.608556 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:16.608534 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mgkns" event={"ID":"b20f9c0c-d782-4714-9300-29aa3503655e","Type":"ContainerStarted","Data":"dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3"} Jul 02 13:49:16.608659 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:16.608623 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mgkns" podUID="b20f9c0c-d782-4714-9300-29aa3503655e" containerName="registry-server" containerID="cri-o://dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3" gracePeriod=2 Jul 02 13:49:16.625292 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:16.625150 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6rtfn" podStartSLOduration=0.941022508 podStartE2EDuration="2.625132986s" totalImagesPullingTime="1.684110478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:49:16.624775673 +0000 UTC m=+467.757667238" watchObservedRunningTime="2026-07-02 13:49:16.625132986 +0000 UTC m=+467.758024552" Jul 02 13:49:16.643760 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:16.643718 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mgkns" podStartSLOduration=1.403971338 podStartE2EDuration="3.643704608s" totalImagesPullingTime="2.23973327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:49:16.643480448 +0000 UTC m=+467.776372012" watchObservedRunningTime="2026-07-02 13:49:16.643704608 +0000 UTC m=+467.776596172" Jul 02 13:49:16.861123 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:16.861065 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mgkns" Jul 02 13:49:16.939990 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:16.939960 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcmkf\" (UniqueName: \"kubernetes.io/projected/b20f9c0c-d782-4714-9300-29aa3503655e-kube-api-access-jcmkf\") pod \"b20f9c0c-d782-4714-9300-29aa3503655e\" (UID: \"b20f9c0c-d782-4714-9300-29aa3503655e\") " Jul 02 13:49:16.942043 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:16.942013 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b20f9c0c-d782-4714-9300-29aa3503655e-kube-api-access-jcmkf" (OuterVolumeSpecName: "kube-api-access-jcmkf") pod "b20f9c0c-d782-4714-9300-29aa3503655e" (UID: "b20f9c0c-d782-4714-9300-29aa3503655e"). InnerVolumeSpecName "kube-api-access-jcmkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:49:17.040558 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:17.040524 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcmkf\" (UniqueName: \"kubernetes.io/projected/b20f9c0c-d782-4714-9300-29aa3503655e-kube-api-access-jcmkf\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:17.613975 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:17.613943 2573 generic.go:356] "Generic (PLEG): container finished" podID="b20f9c0c-d782-4714-9300-29aa3503655e" containerID="dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3" exitCode=0 Jul 02 13:49:17.613975 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:17.613974 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mgkns" Jul 02 13:49:17.614474 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:17.614007 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mgkns" event={"ID":"b20f9c0c-d782-4714-9300-29aa3503655e","Type":"ContainerDied","Data":"dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3"} Jul 02 13:49:17.614474 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:17.614051 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mgkns" event={"ID":"b20f9c0c-d782-4714-9300-29aa3503655e","Type":"ContainerDied","Data":"941b4d4f3d2673ffc612769d9fc1b6fe3755843da49418f12fcf83306be2caca"} Jul 02 13:49:17.614474 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:17.614080 2573 scope.go:117] "RemoveContainer" containerID="dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3" Jul 02 13:49:17.622814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:17.622788 2573 scope.go:117] "RemoveContainer" containerID="dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3" Jul 02 13:49:17.623089 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:49:17.623068 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3\": container with ID starting with dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3 not found: ID does not exist" containerID="dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3" Jul 02 13:49:17.623141 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:17.623097 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3"} err="failed to get container status \"dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3\": rpc error: code = NotFound desc = could not find container \"dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3\": container with ID starting with dddb9a90d5b011288ed10cdbe3dc5cada85f659d9dc88fa0948e9549de14fdf3 not found: ID does not exist" Jul 02 13:49:17.630600 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:17.630576 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mgkns"] Jul 02 13:49:17.636758 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:17.636736 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mgkns"] Jul 02 13:49:19.477939 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:19.477902 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b20f9c0c-d782-4714-9300-29aa3503655e" path="/var/lib/kubelet/pods/b20f9c0c-d782-4714-9300-29aa3503655e/volumes" Jul 02 13:49:24.524838 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:24.524805 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6rtfn" Jul 02 13:49:24.525271 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:24.524894 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6rtfn" Jul 02 13:49:24.547194 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:24.547170 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6rtfn" Jul 02 13:49:24.665216 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:24.665189 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6rtfn" Jul 02 13:49:26.076208 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.076175 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj"] Jul 02 13:49:26.076577 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.076487 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b20f9c0c-d782-4714-9300-29aa3503655e" containerName="registry-server" Jul 02 13:49:26.076577 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.076498 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b20f9c0c-d782-4714-9300-29aa3503655e" containerName="registry-server" Jul 02 13:49:26.076577 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.076561 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b20f9c0c-d782-4714-9300-29aa3503655e" containerName="registry-server" Jul 02 13:49:26.079681 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.079664 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:26.083476 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.083456 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-h7v2c\"" Jul 02 13:49:26.099975 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.099952 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj"] Jul 02 13:49:26.223674 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.223637 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klxtm\" (UniqueName: \"kubernetes.io/projected/782b6ca4-cfba-417b-b4db-c97ccacdee5e-kube-api-access-klxtm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj\" (UID: \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:26.223866 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.223690 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/782b6ca4-cfba-417b-b4db-c97ccacdee5e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj\" (UID: \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:26.223866 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.223758 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/782b6ca4-cfba-417b-b4db-c97ccacdee5e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj\" (UID: \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:26.325108 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.325068 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klxtm\" (UniqueName: \"kubernetes.io/projected/782b6ca4-cfba-417b-b4db-c97ccacdee5e-kube-api-access-klxtm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj\" (UID: \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:26.325358 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.325115 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/782b6ca4-cfba-417b-b4db-c97ccacdee5e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj\" (UID: \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:26.325358 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.325144 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/782b6ca4-cfba-417b-b4db-c97ccacdee5e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj\" (UID: \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:26.325476 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.325453 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/782b6ca4-cfba-417b-b4db-c97ccacdee5e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj\" (UID: \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:26.325514 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.325478 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/782b6ca4-cfba-417b-b4db-c97ccacdee5e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj\" (UID: \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:26.336557 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.336504 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klxtm\" (UniqueName: \"kubernetes.io/projected/782b6ca4-cfba-417b-b4db-c97ccacdee5e-kube-api-access-klxtm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj\" (UID: \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:26.388545 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.388508 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:26.538082 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.538047 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj"] Jul 02 13:49:26.541882 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:49:26.541857 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782b6ca4_cfba_417b_b4db_c97ccacdee5e.slice/crio-217ef0558aa40ec9afbd80091ea8ff2e6b97a81c22f92eea528ef7442c056d80 WatchSource:0}: Error finding container 217ef0558aa40ec9afbd80091ea8ff2e6b97a81c22f92eea528ef7442c056d80: Status 404 returned error can't find the container with id 217ef0558aa40ec9afbd80091ea8ff2e6b97a81c22f92eea528ef7442c056d80 Jul 02 13:49:26.653960 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.653932 2573 generic.go:356] "Generic (PLEG): container finished" podID="782b6ca4-cfba-417b-b4db-c97ccacdee5e" containerID="0c0c4064bd6936836c1be9d432654a112413794b79671e48b0316f60859f030d" exitCode=0 Jul 02 13:49:26.654078 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.653959 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" event={"ID":"782b6ca4-cfba-417b-b4db-c97ccacdee5e","Type":"ContainerDied","Data":"0c0c4064bd6936836c1be9d432654a112413794b79671e48b0316f60859f030d"} Jul 02 13:49:26.654078 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.654004 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" event={"ID":"782b6ca4-cfba-417b-b4db-c97ccacdee5e","Type":"ContainerStarted","Data":"217ef0558aa40ec9afbd80091ea8ff2e6b97a81c22f92eea528ef7442c056d80"} Jul 02 13:49:26.668506 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.668483 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh"] Jul 02 13:49:26.671935 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.671905 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:26.696377 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.696356 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh"] Jul 02 13:49:26.829307 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.829267 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf1910f6-ce78-4e7d-9419-e38ff32332a8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh\" (UID: \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:26.829499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.829317 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf1910f6-ce78-4e7d-9419-e38ff32332a8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh\" (UID: \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:26.829499 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.829406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7ltd\" (UniqueName: \"kubernetes.io/projected/cf1910f6-ce78-4e7d-9419-e38ff32332a8-kube-api-access-c7ltd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh\" (UID: \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:26.930898 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.930812 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf1910f6-ce78-4e7d-9419-e38ff32332a8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh\" (UID: \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:26.930898 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.930849 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf1910f6-ce78-4e7d-9419-e38ff32332a8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh\" (UID: \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:26.930898 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.930888 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7ltd\" (UniqueName: \"kubernetes.io/projected/cf1910f6-ce78-4e7d-9419-e38ff32332a8-kube-api-access-c7ltd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh\" (UID: \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:26.931200 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.931176 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf1910f6-ce78-4e7d-9419-e38ff32332a8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh\" (UID: \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:26.931262 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.931245 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf1910f6-ce78-4e7d-9419-e38ff32332a8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh\" (UID: \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:26.940277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.940258 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7ltd\" (UniqueName: \"kubernetes.io/projected/cf1910f6-ce78-4e7d-9419-e38ff32332a8-kube-api-access-c7ltd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh\" (UID: \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:26.992856 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:26.992824 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:27.135731 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.135698 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh"] Jul 02 13:49:27.141410 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:49:27.141380 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1910f6_ce78_4e7d_9419_e38ff32332a8.slice/crio-85b925f85e6add7f585aeae4cba0fbb53bdffaa37a55571e07304ce7bf01da6a WatchSource:0}: Error finding container 85b925f85e6add7f585aeae4cba0fbb53bdffaa37a55571e07304ce7bf01da6a: Status 404 returned error can't find the container with id 85b925f85e6add7f585aeae4cba0fbb53bdffaa37a55571e07304ce7bf01da6a Jul 02 13:49:27.241878 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.241847 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv"] Jul 02 13:49:27.245462 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.245445 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:27.265983 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.265960 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv"] Jul 02 13:49:27.334290 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.334260 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv\" (UID: \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:27.334431 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.334302 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bwrh\" (UniqueName: \"kubernetes.io/projected/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-kube-api-access-6bwrh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv\" (UID: \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:27.334431 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.334379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv\" (UID: \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:27.435658 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.435618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv\" (UID: \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:27.435658 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.435655 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwrh\" (UniqueName: \"kubernetes.io/projected/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-kube-api-access-6bwrh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv\" (UID: \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:27.435892 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.435692 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv\" (UID: \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:27.436017 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.435996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv\" (UID: \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:27.436083 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.436066 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv\" (UID: \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:27.451237 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.451172 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bwrh\" (UniqueName: \"kubernetes.io/projected/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-kube-api-access-6bwrh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv\" (UID: \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:27.601618 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.601597 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:27.662543 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.662511 2573 generic.go:356] "Generic (PLEG): container finished" podID="782b6ca4-cfba-417b-b4db-c97ccacdee5e" containerID="e96c7f45066308423388f0c068a78832a17a487ae7c0f8abad54d3bd1810448c" exitCode=0 Jul 02 13:49:27.662691 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.662593 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" event={"ID":"782b6ca4-cfba-417b-b4db-c97ccacdee5e","Type":"ContainerDied","Data":"e96c7f45066308423388f0c068a78832a17a487ae7c0f8abad54d3bd1810448c"} Jul 02 13:49:27.664233 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.664204 2573 generic.go:356] "Generic (PLEG): container finished" podID="cf1910f6-ce78-4e7d-9419-e38ff32332a8" containerID="3daf646ff216a642f722a5b0260f6b5eeaab862edd4ea175495f7ce83b62ac36" exitCode=0 Jul 02 13:49:27.664356 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.664234 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" event={"ID":"cf1910f6-ce78-4e7d-9419-e38ff32332a8","Type":"ContainerDied","Data":"3daf646ff216a642f722a5b0260f6b5eeaab862edd4ea175495f7ce83b62ac36"} Jul 02 13:49:27.664356 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.664291 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" event={"ID":"cf1910f6-ce78-4e7d-9419-e38ff32332a8","Type":"ContainerStarted","Data":"85b925f85e6add7f585aeae4cba0fbb53bdffaa37a55571e07304ce7bf01da6a"} Jul 02 13:49:27.753693 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.753667 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv"] Jul 02 13:49:27.755058 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:49:27.755033 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf2b19a_a06c_471b_b0ad_8ebc8f6624f2.slice/crio-8a2f8f892b6d793a7cb4bb3a33bbd6d02a9e4a966e9e222e6179fa2552337a70 WatchSource:0}: Error finding container 8a2f8f892b6d793a7cb4bb3a33bbd6d02a9e4a966e9e222e6179fa2552337a70: Status 404 returned error can't find the container with id 8a2f8f892b6d793a7cb4bb3a33bbd6d02a9e4a966e9e222e6179fa2552337a70 Jul 02 13:49:27.835703 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.835073 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k"] Jul 02 13:49:27.841440 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.841411 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:27.851311 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.851282 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k"] Jul 02 13:49:27.940332 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.940304 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k\" (UID: \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:27.940496 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.940370 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrmpd\" (UniqueName: \"kubernetes.io/projected/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-kube-api-access-xrmpd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k\" (UID: \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:27.940496 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:27.940436 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k\" (UID: \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:28.041306 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.041273 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k\" (UID: \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:28.041488 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.041318 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k\" (UID: \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:28.041488 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.041360 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrmpd\" (UniqueName: \"kubernetes.io/projected/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-kube-api-access-xrmpd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k\" (UID: \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:28.041726 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.041703 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k\" (UID: \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:28.041726 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.041718 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k\" (UID: \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:28.051532 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.051508 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrmpd\" (UniqueName: \"kubernetes.io/projected/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-kube-api-access-xrmpd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k\" (UID: \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:28.225026 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.224991 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:28.380825 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.380802 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k"] Jul 02 13:49:28.382356 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:49:28.382329 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af8dae5_3203_4ecd_a3ae_fef022db0d8d.slice/crio-b2e3b9b9512a5f42bb8c292941537521568e18f8fe4d4f09b2672bbb491d0b17 WatchSource:0}: Error finding container b2e3b9b9512a5f42bb8c292941537521568e18f8fe4d4f09b2672bbb491d0b17: Status 404 returned error can't find the container with id b2e3b9b9512a5f42bb8c292941537521568e18f8fe4d4f09b2672bbb491d0b17 Jul 02 13:49:28.670635 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.670606 2573 generic.go:356] "Generic (PLEG): container finished" podID="cf1910f6-ce78-4e7d-9419-e38ff32332a8" containerID="9868a97d665e35f01a4dc6c7e46618b3869abd283dbcafcd05f18a7e07e07685" exitCode=0 Jul 02 13:49:28.670816 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.670690 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" event={"ID":"cf1910f6-ce78-4e7d-9419-e38ff32332a8","Type":"ContainerDied","Data":"9868a97d665e35f01a4dc6c7e46618b3869abd283dbcafcd05f18a7e07e07685"} Jul 02 13:49:28.672285 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.672265 2573 generic.go:356] "Generic (PLEG): container finished" podID="0af8dae5-3203-4ecd-a3ae-fef022db0d8d" containerID="b430be605d5540e5a7c5a2822d92b8cf4cbcc31e8f62d47455abf4109ac758ef" exitCode=0 Jul 02 13:49:28.672358 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.672313 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" event={"ID":"0af8dae5-3203-4ecd-a3ae-fef022db0d8d","Type":"ContainerDied","Data":"b430be605d5540e5a7c5a2822d92b8cf4cbcc31e8f62d47455abf4109ac758ef"} Jul 02 13:49:28.672410 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.672360 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" event={"ID":"0af8dae5-3203-4ecd-a3ae-fef022db0d8d","Type":"ContainerStarted","Data":"b2e3b9b9512a5f42bb8c292941537521568e18f8fe4d4f09b2672bbb491d0b17"} Jul 02 13:49:28.673958 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.673913 2573 generic.go:356] "Generic (PLEG): container finished" podID="5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" containerID="35ff9917f48a5b79848d78b39868366a77a4f6d47dc25b55d58f22e109805350" exitCode=0 Jul 02 13:49:28.674046 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.674000 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" event={"ID":"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2","Type":"ContainerDied","Data":"35ff9917f48a5b79848d78b39868366a77a4f6d47dc25b55d58f22e109805350"} Jul 02 13:49:28.674106 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.674056 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" event={"ID":"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2","Type":"ContainerStarted","Data":"8a2f8f892b6d793a7cb4bb3a33bbd6d02a9e4a966e9e222e6179fa2552337a70"} Jul 02 13:49:28.676233 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.676212 2573 generic.go:356] "Generic (PLEG): container finished" podID="782b6ca4-cfba-417b-b4db-c97ccacdee5e" containerID="fef28749ee3e4ca9666b1c8a6f3178f70e15d0c8f342de63f9d058da1b4623b3" exitCode=0 Jul 02 13:49:28.676303 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:28.676248 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" event={"ID":"782b6ca4-cfba-417b-b4db-c97ccacdee5e","Type":"ContainerDied","Data":"fef28749ee3e4ca9666b1c8a6f3178f70e15d0c8f342de63f9d058da1b4623b3"} Jul 02 13:49:29.682989 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:29.682956 2573 generic.go:356] "Generic (PLEG): container finished" podID="cf1910f6-ce78-4e7d-9419-e38ff32332a8" containerID="accf24b30c4cd8a4a7a3fc746b4560ac725fd223f16f4ff2e4b4be7b455c8f52" exitCode=0 Jul 02 13:49:29.683353 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:29.683031 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" event={"ID":"cf1910f6-ce78-4e7d-9419-e38ff32332a8","Type":"ContainerDied","Data":"accf24b30c4cd8a4a7a3fc746b4560ac725fd223f16f4ff2e4b4be7b455c8f52"} Jul 02 13:49:29.684774 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:29.684754 2573 generic.go:356] "Generic (PLEG): container finished" podID="0af8dae5-3203-4ecd-a3ae-fef022db0d8d" containerID="e0fed68b7ea860ccb28e1a3ed65d29309c280dfcf07baa37b6097e86576e38ae" exitCode=0 Jul 02 13:49:29.684851 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:29.684823 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" event={"ID":"0af8dae5-3203-4ecd-a3ae-fef022db0d8d","Type":"ContainerDied","Data":"e0fed68b7ea860ccb28e1a3ed65d29309c280dfcf07baa37b6097e86576e38ae"} Jul 02 13:49:29.814523 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:29.814497 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:29.965168 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:29.965137 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klxtm\" (UniqueName: \"kubernetes.io/projected/782b6ca4-cfba-417b-b4db-c97ccacdee5e-kube-api-access-klxtm\") pod \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\" (UID: \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\") " Jul 02 13:49:29.965324 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:29.965200 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/782b6ca4-cfba-417b-b4db-c97ccacdee5e-bundle\") pod \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\" (UID: \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\") " Jul 02 13:49:29.965324 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:29.965268 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/782b6ca4-cfba-417b-b4db-c97ccacdee5e-util\") pod \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\" (UID: \"782b6ca4-cfba-417b-b4db-c97ccacdee5e\") " Jul 02 13:49:29.965786 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:29.965754 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/782b6ca4-cfba-417b-b4db-c97ccacdee5e-bundle" (OuterVolumeSpecName: "bundle") pod "782b6ca4-cfba-417b-b4db-c97ccacdee5e" (UID: "782b6ca4-cfba-417b-b4db-c97ccacdee5e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:49:29.967216 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:29.967191 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/782b6ca4-cfba-417b-b4db-c97ccacdee5e-kube-api-access-klxtm" (OuterVolumeSpecName: "kube-api-access-klxtm") pod "782b6ca4-cfba-417b-b4db-c97ccacdee5e" (UID: "782b6ca4-cfba-417b-b4db-c97ccacdee5e"). InnerVolumeSpecName "kube-api-access-klxtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:49:29.971497 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:29.971476 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/782b6ca4-cfba-417b-b4db-c97ccacdee5e-util" (OuterVolumeSpecName: "util") pod "782b6ca4-cfba-417b-b4db-c97ccacdee5e" (UID: "782b6ca4-cfba-417b-b4db-c97ccacdee5e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:49:30.066142 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.066116 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/782b6ca4-cfba-417b-b4db-c97ccacdee5e-util\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:30.066142 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.066140 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klxtm\" (UniqueName: \"kubernetes.io/projected/782b6ca4-cfba-417b-b4db-c97ccacdee5e-kube-api-access-klxtm\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:30.066142 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.066149 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/782b6ca4-cfba-417b-b4db-c97ccacdee5e-bundle\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:30.691417 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.691315 2573 generic.go:356] "Generic (PLEG): container finished" podID="0af8dae5-3203-4ecd-a3ae-fef022db0d8d" containerID="09a560683b028ee7085cb12c7dfd5d549af3603ac3f8001001aa89400b92eb5b" exitCode=0 Jul 02 13:49:30.691771 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.691418 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" event={"ID":"0af8dae5-3203-4ecd-a3ae-fef022db0d8d","Type":"ContainerDied","Data":"09a560683b028ee7085cb12c7dfd5d549af3603ac3f8001001aa89400b92eb5b"} Jul 02 13:49:30.693117 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.693092 2573 generic.go:356] "Generic (PLEG): container finished" podID="5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" containerID="2577c1e6040bf57338ea4b8d0e15ef5bf529dedc2730be409d62b58fce27061a" exitCode=0 Jul 02 13:49:30.693226 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.693163 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" event={"ID":"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2","Type":"ContainerDied","Data":"2577c1e6040bf57338ea4b8d0e15ef5bf529dedc2730be409d62b58fce27061a"} Jul 02 13:49:30.695182 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.695164 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" Jul 02 13:49:30.695253 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.695171 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj" event={"ID":"782b6ca4-cfba-417b-b4db-c97ccacdee5e","Type":"ContainerDied","Data":"217ef0558aa40ec9afbd80091ea8ff2e6b97a81c22f92eea528ef7442c056d80"} Jul 02 13:49:30.695253 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.695220 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="217ef0558aa40ec9afbd80091ea8ff2e6b97a81c22f92eea528ef7442c056d80" Jul 02 13:49:30.826061 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.826037 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:30.974224 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.974138 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7ltd\" (UniqueName: \"kubernetes.io/projected/cf1910f6-ce78-4e7d-9419-e38ff32332a8-kube-api-access-c7ltd\") pod \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\" (UID: \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\") " Jul 02 13:49:30.974224 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.974196 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf1910f6-ce78-4e7d-9419-e38ff32332a8-bundle\") pod \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\" (UID: \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\") " Jul 02 13:49:30.974445 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.974226 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf1910f6-ce78-4e7d-9419-e38ff32332a8-util\") pod \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\" (UID: \"cf1910f6-ce78-4e7d-9419-e38ff32332a8\") " Jul 02 13:49:30.974689 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.974653 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf1910f6-ce78-4e7d-9419-e38ff32332a8-bundle" (OuterVolumeSpecName: "bundle") pod "cf1910f6-ce78-4e7d-9419-e38ff32332a8" (UID: "cf1910f6-ce78-4e7d-9419-e38ff32332a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:49:30.976406 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.976381 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1910f6-ce78-4e7d-9419-e38ff32332a8-kube-api-access-c7ltd" (OuterVolumeSpecName: "kube-api-access-c7ltd") pod "cf1910f6-ce78-4e7d-9419-e38ff32332a8" (UID: "cf1910f6-ce78-4e7d-9419-e38ff32332a8"). InnerVolumeSpecName "kube-api-access-c7ltd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:49:30.979631 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:30.979611 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf1910f6-ce78-4e7d-9419-e38ff32332a8-util" (OuterVolumeSpecName: "util") pod "cf1910f6-ce78-4e7d-9419-e38ff32332a8" (UID: "cf1910f6-ce78-4e7d-9419-e38ff32332a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:49:31.075658 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.075623 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7ltd\" (UniqueName: \"kubernetes.io/projected/cf1910f6-ce78-4e7d-9419-e38ff32332a8-kube-api-access-c7ltd\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:31.075658 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.075651 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf1910f6-ce78-4e7d-9419-e38ff32332a8-bundle\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:31.075658 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.075660 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf1910f6-ce78-4e7d-9419-e38ff32332a8-util\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:31.702436 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.702344 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" Jul 02 13:49:31.702436 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.702369 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh" event={"ID":"cf1910f6-ce78-4e7d-9419-e38ff32332a8","Type":"ContainerDied","Data":"85b925f85e6add7f585aeae4cba0fbb53bdffaa37a55571e07304ce7bf01da6a"} Jul 02 13:49:31.702436 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.702414 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85b925f85e6add7f585aeae4cba0fbb53bdffaa37a55571e07304ce7bf01da6a" Jul 02 13:49:31.704702 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.704673 2573 generic.go:356] "Generic (PLEG): container finished" podID="5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" containerID="7d3b191b76099fdcd4f7e5ba35ebf30925aec0b8daeccce3a84070f4030fc68f" exitCode=0 Jul 02 13:49:31.704829 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.704801 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" event={"ID":"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2","Type":"ContainerDied","Data":"7d3b191b76099fdcd4f7e5ba35ebf30925aec0b8daeccce3a84070f4030fc68f"} Jul 02 13:49:31.837421 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.837394 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:31.881962 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.881909 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-bundle\") pod \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\" (UID: \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\") " Jul 02 13:49:31.882204 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.881991 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-util\") pod \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\" (UID: \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\") " Jul 02 13:49:31.882204 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.882051 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrmpd\" (UniqueName: \"kubernetes.io/projected/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-kube-api-access-xrmpd\") pod \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\" (UID: \"0af8dae5-3203-4ecd-a3ae-fef022db0d8d\") " Jul 02 13:49:31.882540 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.882513 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-bundle" (OuterVolumeSpecName: "bundle") pod "0af8dae5-3203-4ecd-a3ae-fef022db0d8d" (UID: "0af8dae5-3203-4ecd-a3ae-fef022db0d8d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:49:31.884222 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.884194 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-kube-api-access-xrmpd" (OuterVolumeSpecName: "kube-api-access-xrmpd") pod "0af8dae5-3203-4ecd-a3ae-fef022db0d8d" (UID: "0af8dae5-3203-4ecd-a3ae-fef022db0d8d"). InnerVolumeSpecName "kube-api-access-xrmpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:49:31.889970 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.889942 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-util" (OuterVolumeSpecName: "util") pod "0af8dae5-3203-4ecd-a3ae-fef022db0d8d" (UID: "0af8dae5-3203-4ecd-a3ae-fef022db0d8d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:49:31.982702 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.982617 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrmpd\" (UniqueName: \"kubernetes.io/projected/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-kube-api-access-xrmpd\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:31.982702 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.982647 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-bundle\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:31.982702 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:31.982656 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0af8dae5-3203-4ecd-a3ae-fef022db0d8d-util\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:32.713601 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:32.713571 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" Jul 02 13:49:32.713601 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:32.713583 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k" event={"ID":"0af8dae5-3203-4ecd-a3ae-fef022db0d8d","Type":"ContainerDied","Data":"b2e3b9b9512a5f42bb8c292941537521568e18f8fe4d4f09b2672bbb491d0b17"} Jul 02 13:49:32.714025 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:32.713627 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2e3b9b9512a5f42bb8c292941537521568e18f8fe4d4f09b2672bbb491d0b17" Jul 02 13:49:32.844628 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:32.844604 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:32.889681 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:32.889649 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bwrh\" (UniqueName: \"kubernetes.io/projected/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-kube-api-access-6bwrh\") pod \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\" (UID: \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\") " Jul 02 13:49:32.891657 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:32.891629 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-kube-api-access-6bwrh" (OuterVolumeSpecName: "kube-api-access-6bwrh") pod "5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" (UID: "5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2"). InnerVolumeSpecName "kube-api-access-6bwrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:49:32.990144 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:32.990066 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-util\") pod \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\" (UID: \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\") " Jul 02 13:49:32.990277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:32.990149 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-bundle\") pod \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\" (UID: \"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2\") " Jul 02 13:49:32.990277 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:32.990247 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bwrh\" (UniqueName: \"kubernetes.io/projected/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-kube-api-access-6bwrh\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:32.990553 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:32.990528 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-bundle" (OuterVolumeSpecName: "bundle") pod "5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" (UID: "5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:49:32.995430 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:32.995386 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-util" (OuterVolumeSpecName: "util") pod "5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" (UID: "5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:49:33.090551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:33.090519 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-bundle\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:33.090551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:33.090545 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2-util\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:49:33.720272 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:33.720246 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" Jul 02 13:49:33.720272 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:33.720245 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv" event={"ID":"5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2","Type":"ContainerDied","Data":"8a2f8f892b6d793a7cb4bb3a33bbd6d02a9e4a966e9e222e6179fa2552337a70"} Jul 02 13:49:33.720663 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:33.720293 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a2f8f892b6d793a7cb4bb3a33bbd6d02a9e4a966e9e222e6179fa2552337a70" Jul 02 13:49:44.860978 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.860948 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf"] Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861251 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0af8dae5-3203-4ecd-a3ae-fef022db0d8d" containerName="pull" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861260 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0af8dae5-3203-4ecd-a3ae-fef022db0d8d" containerName="pull" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861267 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" containerName="extract" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861275 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" containerName="extract" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861283 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="782b6ca4-cfba-417b-b4db-c97ccacdee5e" containerName="extract" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861288 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="782b6ca4-cfba-417b-b4db-c97ccacdee5e" containerName="extract" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861295 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" containerName="pull" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861300 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" containerName="pull" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861309 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0af8dae5-3203-4ecd-a3ae-fef022db0d8d" containerName="util" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861314 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0af8dae5-3203-4ecd-a3ae-fef022db0d8d" containerName="util" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861322 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1910f6-ce78-4e7d-9419-e38ff32332a8" containerName="pull" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861327 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1910f6-ce78-4e7d-9419-e38ff32332a8" containerName="pull" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861332 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="782b6ca4-cfba-417b-b4db-c97ccacdee5e" containerName="pull" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861338 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="782b6ca4-cfba-417b-b4db-c97ccacdee5e" containerName="pull" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861342 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1910f6-ce78-4e7d-9419-e38ff32332a8" containerName="extract" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861347 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1910f6-ce78-4e7d-9419-e38ff32332a8" containerName="extract" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861356 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1910f6-ce78-4e7d-9419-e38ff32332a8" containerName="util" Jul 02 13:49:44.861351 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861361 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1910f6-ce78-4e7d-9419-e38ff32332a8" containerName="util" Jul 02 13:49:44.861869 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861366 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" containerName="util" Jul 02 13:49:44.861869 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861370 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" containerName="util" Jul 02 13:49:44.861869 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861376 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0af8dae5-3203-4ecd-a3ae-fef022db0d8d" containerName="extract" Jul 02 13:49:44.861869 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861381 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0af8dae5-3203-4ecd-a3ae-fef022db0d8d" containerName="extract" Jul 02 13:49:44.861869 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861387 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="782b6ca4-cfba-417b-b4db-c97ccacdee5e" containerName="util" Jul 02 13:49:44.861869 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861392 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="782b6ca4-cfba-417b-b4db-c97ccacdee5e" containerName="util" Jul 02 13:49:44.861869 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861440 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1910f6-ce78-4e7d-9419-e38ff32332a8" containerName="extract" Jul 02 13:49:44.861869 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861448 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="782b6ca4-cfba-417b-b4db-c97ccacdee5e" containerName="extract" Jul 02 13:49:44.861869 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861456 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2" containerName="extract" Jul 02 13:49:44.861869 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.861462 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0af8dae5-3203-4ecd-a3ae-fef022db0d8d" containerName="extract" Jul 02 13:49:44.864611 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.864596 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf" Jul 02 13:49:44.866993 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.866976 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fqqrn\"" Jul 02 13:49:44.870676 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.870649 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwxgn\" (UniqueName: \"kubernetes.io/projected/54cb44ff-807d-415b-bd6b-da7678d5ac6e-kube-api-access-gwxgn\") pod \"authorino-operator-75cc8d5cb7-7b2nf\" (UID: \"54cb44ff-807d-415b-bd6b-da7678d5ac6e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf" Jul 02 13:49:44.880558 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.880532 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf"] Jul 02 13:49:44.971651 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.971614 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwxgn\" (UniqueName: \"kubernetes.io/projected/54cb44ff-807d-415b-bd6b-da7678d5ac6e-kube-api-access-gwxgn\") pod \"authorino-operator-75cc8d5cb7-7b2nf\" (UID: \"54cb44ff-807d-415b-bd6b-da7678d5ac6e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf" Jul 02 13:49:44.983783 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:44.983748 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwxgn\" (UniqueName: \"kubernetes.io/projected/54cb44ff-807d-415b-bd6b-da7678d5ac6e-kube-api-access-gwxgn\") pod \"authorino-operator-75cc8d5cb7-7b2nf\" (UID: \"54cb44ff-807d-415b-bd6b-da7678d5ac6e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf" Jul 02 13:49:45.174115 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:45.174031 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf" Jul 02 13:49:45.318958 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:45.318931 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf"] Jul 02 13:49:45.320807 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:49:45.320772 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54cb44ff_807d_415b_bd6b_da7678d5ac6e.slice/crio-02aa18e66bb2d2ad944279ef542d829d59bf2dd2eb93dfa0d7b97da3bbcb5696 WatchSource:0}: Error finding container 02aa18e66bb2d2ad944279ef542d829d59bf2dd2eb93dfa0d7b97da3bbcb5696: Status 404 returned error can't find the container with id 02aa18e66bb2d2ad944279ef542d829d59bf2dd2eb93dfa0d7b97da3bbcb5696 Jul 02 13:49:45.777217 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:45.777185 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf" event={"ID":"54cb44ff-807d-415b-bd6b-da7678d5ac6e","Type":"ContainerStarted","Data":"02aa18e66bb2d2ad944279ef542d829d59bf2dd2eb93dfa0d7b97da3bbcb5696"} Jul 02 13:49:48.795053 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:48.795016 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf" event={"ID":"54cb44ff-807d-415b-bd6b-da7678d5ac6e","Type":"ContainerStarted","Data":"b0fa218df3e442ed94334d1bff3611f7d983f571aa8e167684bfa445664e6e95"} Jul 02 13:49:48.795504 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:48.795080 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf" Jul 02 13:49:48.814779 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:48.814728 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf" podStartSLOduration=2.260339663 podStartE2EDuration="4.814713918s" totalImagesPullingTime="2.554374255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:49:48.812992291 +0000 UTC m=+499.945883877" watchObservedRunningTime="2026-07-02 13:49:48.814713918 +0000 UTC m=+499.947605493" Jul 02 13:49:51.255942 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.255891 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6"] Jul 02 13:49:51.263534 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.263513 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:49:51.265913 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.265889 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nhwf2\"" Jul 02 13:49:51.276235 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.276206 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6"] Jul 02 13:49:51.324549 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.324524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5017c4bd-1a33-4238-98b5-04890d705393-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" (UID: \"5017c4bd-1a33-4238-98b5-04890d705393\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:49:51.324677 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.324555 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g5c9\" (UniqueName: \"kubernetes.io/projected/5017c4bd-1a33-4238-98b5-04890d705393-kube-api-access-2g5c9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" (UID: \"5017c4bd-1a33-4238-98b5-04890d705393\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:49:51.425028 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.424989 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5017c4bd-1a33-4238-98b5-04890d705393-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" (UID: \"5017c4bd-1a33-4238-98b5-04890d705393\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:49:51.425249 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.425036 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g5c9\" (UniqueName: \"kubernetes.io/projected/5017c4bd-1a33-4238-98b5-04890d705393-kube-api-access-2g5c9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" (UID: \"5017c4bd-1a33-4238-98b5-04890d705393\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:49:51.425396 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.425375 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5017c4bd-1a33-4238-98b5-04890d705393-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" (UID: \"5017c4bd-1a33-4238-98b5-04890d705393\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:49:51.435408 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.435384 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g5c9\" (UniqueName: \"kubernetes.io/projected/5017c4bd-1a33-4238-98b5-04890d705393-kube-api-access-2g5c9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" (UID: \"5017c4bd-1a33-4238-98b5-04890d705393\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:49:51.572949 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.572898 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:49:51.709943 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.709906 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6"] Jul 02 13:49:51.711525 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:49:51.711494 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5017c4bd_1a33_4238_98b5_04890d705393.slice/crio-9e2235b99d5125e8450d057684eaee4a7377f0f185a29d82253816d490cf5b08 WatchSource:0}: Error finding container 9e2235b99d5125e8450d057684eaee4a7377f0f185a29d82253816d490cf5b08: Status 404 returned error can't find the container with id 9e2235b99d5125e8450d057684eaee4a7377f0f185a29d82253816d490cf5b08 Jul 02 13:49:51.809872 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:51.809842 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" event={"ID":"5017c4bd-1a33-4238-98b5-04890d705393","Type":"ContainerStarted","Data":"9e2235b99d5125e8450d057684eaee4a7377f0f185a29d82253816d490cf5b08"} Jul 02 13:49:54.398526 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:54.398461 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6"] Jul 02 13:49:54.401938 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:54.401899 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6" Jul 02 13:49:54.405062 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:54.405038 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vv6vx\"" Jul 02 13:49:54.405785 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:54.405591 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 02 13:49:54.421570 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:54.421524 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6"] Jul 02 13:49:54.454055 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:54.454022 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqdl5\" (UniqueName: \"kubernetes.io/projected/3adbde24-84e8-4dd6-8f28-703e5bafebfc-kube-api-access-vqdl5\") pod \"dns-operator-controller-manager-864dd78c4c-4qbz6\" (UID: \"3adbde24-84e8-4dd6-8f28-703e5bafebfc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6" Jul 02 13:49:54.555433 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:54.555380 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdl5\" (UniqueName: \"kubernetes.io/projected/3adbde24-84e8-4dd6-8f28-703e5bafebfc-kube-api-access-vqdl5\") pod \"dns-operator-controller-manager-864dd78c4c-4qbz6\" (UID: \"3adbde24-84e8-4dd6-8f28-703e5bafebfc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6" Jul 02 13:49:54.570416 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:54.570385 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqdl5\" (UniqueName: \"kubernetes.io/projected/3adbde24-84e8-4dd6-8f28-703e5bafebfc-kube-api-access-vqdl5\") pod \"dns-operator-controller-manager-864dd78c4c-4qbz6\" (UID: \"3adbde24-84e8-4dd6-8f28-703e5bafebfc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6" Jul 02 13:49:54.716981 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:54.716878 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6" Jul 02 13:49:54.880358 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:54.880321 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6"] Jul 02 13:49:54.887608 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:49:54.887584 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adbde24_84e8_4dd6_8f28_703e5bafebfc.slice/crio-0d97ddfa182cac6b274eba0b38575aa0dd71cb34d9cffdd3145817a81d6f0491 WatchSource:0}: Error finding container 0d97ddfa182cac6b274eba0b38575aa0dd71cb34d9cffdd3145817a81d6f0491: Status 404 returned error can't find the container with id 0d97ddfa182cac6b274eba0b38575aa0dd71cb34d9cffdd3145817a81d6f0491 Jul 02 13:49:55.833876 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:55.833796 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6" event={"ID":"3adbde24-84e8-4dd6-8f28-703e5bafebfc","Type":"ContainerStarted","Data":"0d97ddfa182cac6b274eba0b38575aa0dd71cb34d9cffdd3145817a81d6f0491"} Jul 02 13:49:57.715243 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:57.715205 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x"] Jul 02 13:49:57.719430 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:57.719404 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:49:57.729013 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:57.728993 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-n2dfd\"" Jul 02 13:49:57.750943 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:57.750883 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x"] Jul 02 13:49:57.782636 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:57.782595 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv6zd\" (UniqueName: \"kubernetes.io/projected/5d393012-6526-4858-b92f-d5a7ee033a3f-kube-api-access-sv6zd\") pod \"limitador-operator-controller-manager-859d7b78bd-vck4x\" (UID: \"5d393012-6526-4858-b92f-d5a7ee033a3f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:49:57.883652 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:57.883620 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6zd\" (UniqueName: \"kubernetes.io/projected/5d393012-6526-4858-b92f-d5a7ee033a3f-kube-api-access-sv6zd\") pod \"limitador-operator-controller-manager-859d7b78bd-vck4x\" (UID: \"5d393012-6526-4858-b92f-d5a7ee033a3f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:49:57.897886 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:57.897857 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv6zd\" (UniqueName: \"kubernetes.io/projected/5d393012-6526-4858-b92f-d5a7ee033a3f-kube-api-access-sv6zd\") pod \"limitador-operator-controller-manager-859d7b78bd-vck4x\" (UID: \"5d393012-6526-4858-b92f-d5a7ee033a3f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:49:58.032674 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:58.032639 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:49:58.317779 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:58.317760 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x"] Jul 02 13:49:58.320492 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:49:58.320460 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d393012_6526_4858_b92f_d5a7ee033a3f.slice/crio-2966a61b2fab1bdcea44528fea4981519c4378b91219042d7830ba711da44e40 WatchSource:0}: Error finding container 2966a61b2fab1bdcea44528fea4981519c4378b91219042d7830ba711da44e40: Status 404 returned error can't find the container with id 2966a61b2fab1bdcea44528fea4981519c4378b91219042d7830ba711da44e40 Jul 02 13:49:58.850622 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:58.850590 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" event={"ID":"5017c4bd-1a33-4238-98b5-04890d705393","Type":"ContainerStarted","Data":"db947b76358c6ac5645c7dd426c3852c3daebf39dcca5687f5d6345c41a160d3"} Jul 02 13:49:58.851104 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:58.850747 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:49:58.852230 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:58.852208 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6" event={"ID":"3adbde24-84e8-4dd6-8f28-703e5bafebfc","Type":"ContainerStarted","Data":"7960a2178f37b3f7321fc751eebc324a46ff3f28f5ff76f619b0035db687b023"} Jul 02 13:49:58.852369 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:58.852264 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6" Jul 02 13:49:58.853546 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:58.853516 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" event={"ID":"5d393012-6526-4858-b92f-d5a7ee033a3f","Type":"ContainerStarted","Data":"2966a61b2fab1bdcea44528fea4981519c4378b91219042d7830ba711da44e40"} Jul 02 13:49:58.894576 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:58.894518 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" podStartSLOduration=1.383775874 podStartE2EDuration="7.894503554s" totalImagesPullingTime="6.51072768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:49:58.892483206 +0000 UTC m=+510.025374771" watchObservedRunningTime="2026-07-02 13:49:58.894503554 +0000 UTC m=+510.027395118" Jul 02 13:49:58.961016 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:58.960958 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6" podStartSLOduration=2.85777783 podStartE2EDuration="4.960917811s" totalImagesPullingTime="2.103139981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:49:58.949898263 +0000 UTC m=+510.082789827" watchObservedRunningTime="2026-07-02 13:49:58.960917811 +0000 UTC m=+510.093809375" Jul 02 13:49:59.802432 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:49:59.802396 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7b2nf" Jul 02 13:50:01.872127 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:01.872091 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" event={"ID":"5d393012-6526-4858-b92f-d5a7ee033a3f","Type":"ContainerStarted","Data":"a4ba6ded8e9cb34d746220f83d58c1ee93d99867d21e1d95234c6e190c4cad3d"} Jul 02 13:50:01.872576 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:01.872174 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:09.862477 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:09.862445 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:09.862877 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:09.862513 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4qbz6" Jul 02 13:50:09.894293 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:09.894241 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" podStartSLOduration=10.40497887 podStartE2EDuration="12.894225649s" totalImagesPullingTime="2.489246779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:49:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:50:01.897528876 +0000 UTC m=+513.030420441" watchObservedRunningTime="2026-07-02 13:50:09.894225649 +0000 UTC m=+521.027117229" Jul 02 13:50:11.925866 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.925835 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6"] Jul 02 13:50:11.926298 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.926025 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" podUID="5017c4bd-1a33-4238-98b5-04890d705393" containerName="manager" containerID="cri-o://db947b76358c6ac5645c7dd426c3852c3daebf39dcca5687f5d6345c41a160d3" gracePeriod=2 Jul 02 13:50:11.941564 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.941527 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6"] Jul 02 13:50:11.952800 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:11.952757 2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5017c4bd-1a33-4238-98b5-04890d705393\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-vltm6\": pods \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:11.965786 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.965760 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x"] Jul 02 13:50:11.966029 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.965982 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" containerName="manager" containerID="cri-o://a4ba6ded8e9cb34d746220f83d58c1ee93d99867d21e1d95234c6e190c4cad3d" gracePeriod=2 Jul 02 13:50:11.967991 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.967971 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:11.989066 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.989042 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x"] Jul 02 13:50:11.996153 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.996128 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94"] Jul 02 13:50:11.996577 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.996557 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5017c4bd-1a33-4238-98b5-04890d705393" containerName="manager" Jul 02 13:50:11.996577 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.996578 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5017c4bd-1a33-4238-98b5-04890d705393" containerName="manager" Jul 02 13:50:11.996695 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.996589 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" containerName="manager" Jul 02 13:50:11.996695 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.996594 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" containerName="manager" Jul 02 13:50:11.996695 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.996664 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5017c4bd-1a33-4238-98b5-04890d705393" containerName="manager" Jul 02 13:50:11.996695 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.996673 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" containerName="manager" Jul 02 13:50:11.999538 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:11.999523 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" Jul 02 13:50:12.006841 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.006806 2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5d393012-6526-4858-b92f-d5a7ee033a3f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-vck4x\": pods \"limitador-operator-controller-manager-859d7b78bd-vck4x\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:12.008965 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.008938 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5017c4bd-1a33-4238-98b5-04890d705393" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:12.025656 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.025631 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94"] Jul 02 13:50:12.027620 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.027595 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws"] Jul 02 13:50:12.030817 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.030800 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws" Jul 02 13:50:12.047048 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.047022 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws"] Jul 02 13:50:12.052586 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.052554 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5017c4bd-1a33-4238-98b5-04890d705393" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:12.054701 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.054680 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vck4x\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:12.064726 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.064701 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vck4x\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:12.098410 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.098375 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5017c4bd-1a33-4238-98b5-04890d705393" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:12.112513 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.112482 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqn7b\" (UniqueName: \"kubernetes.io/projected/3228689a-2449-4bc0-8a6f-9c923c98a80a-kube-api-access-dqn7b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q9p94\" (UID: \"3228689a-2449-4bc0-8a6f-9c923c98a80a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" Jul 02 13:50:12.112668 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.112521 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tslq\" (UniqueName: \"kubernetes.io/projected/c2b68561-471a-4944-9e67-22d33dbd04a7-kube-api-access-2tslq\") pod \"limitador-operator-controller-manager-859d7b78bd-m6xws\" (UID: \"c2b68561-471a-4944-9e67-22d33dbd04a7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws" Jul 02 13:50:12.112668 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.112545 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3228689a-2449-4bc0-8a6f-9c923c98a80a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q9p94\" (UID: \"3228689a-2449-4bc0-8a6f-9c923c98a80a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" Jul 02 13:50:12.213611 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.213582 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqn7b\" (UniqueName: \"kubernetes.io/projected/3228689a-2449-4bc0-8a6f-9c923c98a80a-kube-api-access-dqn7b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q9p94\" (UID: \"3228689a-2449-4bc0-8a6f-9c923c98a80a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" Jul 02 13:50:12.213706 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.213634 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tslq\" (UniqueName: \"kubernetes.io/projected/c2b68561-471a-4944-9e67-22d33dbd04a7-kube-api-access-2tslq\") pod \"limitador-operator-controller-manager-859d7b78bd-m6xws\" (UID: \"c2b68561-471a-4944-9e67-22d33dbd04a7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws" Jul 02 13:50:12.213706 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.213677 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3228689a-2449-4bc0-8a6f-9c923c98a80a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q9p94\" (UID: \"3228689a-2449-4bc0-8a6f-9c923c98a80a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" Jul 02 13:50:12.214107 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.214071 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3228689a-2449-4bc0-8a6f-9c923c98a80a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q9p94\" (UID: \"3228689a-2449-4bc0-8a6f-9c923c98a80a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" Jul 02 13:50:12.220801 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.220779 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:12.223594 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.223570 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:12.223692 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.223609 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vck4x\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:12.233111 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.233081 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5017c4bd-1a33-4238-98b5-04890d705393" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:12.234992 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.234974 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tslq\" (UniqueName: \"kubernetes.io/projected/c2b68561-471a-4944-9e67-22d33dbd04a7-kube-api-access-2tslq\") pod \"limitador-operator-controller-manager-859d7b78bd-m6xws\" (UID: \"c2b68561-471a-4944-9e67-22d33dbd04a7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws" Jul 02 13:50:12.235204 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.235187 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqn7b\" (UniqueName: \"kubernetes.io/projected/3228689a-2449-4bc0-8a6f-9c923c98a80a-kube-api-access-dqn7b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q9p94\" (UID: \"3228689a-2449-4bc0-8a6f-9c923c98a80a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" Jul 02 13:50:12.237881 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.237862 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vck4x\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:12.241056 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.241036 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5017c4bd-1a33-4238-98b5-04890d705393" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:12.314462 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.314432 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv6zd\" (UniqueName: \"kubernetes.io/projected/5d393012-6526-4858-b92f-d5a7ee033a3f-kube-api-access-sv6zd\") pod \"5d393012-6526-4858-b92f-d5a7ee033a3f\" (UID: \"5d393012-6526-4858-b92f-d5a7ee033a3f\") " Jul 02 13:50:12.314624 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.314480 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2g5c9\" (UniqueName: \"kubernetes.io/projected/5017c4bd-1a33-4238-98b5-04890d705393-kube-api-access-2g5c9\") pod \"5017c4bd-1a33-4238-98b5-04890d705393\" (UID: \"5017c4bd-1a33-4238-98b5-04890d705393\") " Jul 02 13:50:12.314690 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.314654 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5017c4bd-1a33-4238-98b5-04890d705393-extensions-socket-volume\") pod \"5017c4bd-1a33-4238-98b5-04890d705393\" (UID: \"5017c4bd-1a33-4238-98b5-04890d705393\") " Jul 02 13:50:12.315130 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.315104 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5017c4bd-1a33-4238-98b5-04890d705393-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5017c4bd-1a33-4238-98b5-04890d705393" (UID: "5017c4bd-1a33-4238-98b5-04890d705393"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:50:12.316392 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.316369 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d393012-6526-4858-b92f-d5a7ee033a3f-kube-api-access-sv6zd" (OuterVolumeSpecName: "kube-api-access-sv6zd") pod "5d393012-6526-4858-b92f-d5a7ee033a3f" (UID: "5d393012-6526-4858-b92f-d5a7ee033a3f"). InnerVolumeSpecName "kube-api-access-sv6zd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:50:12.316485 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.316468 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5017c4bd-1a33-4238-98b5-04890d705393-kube-api-access-2g5c9" (OuterVolumeSpecName: "kube-api-access-2g5c9") pod "5017c4bd-1a33-4238-98b5-04890d705393" (UID: "5017c4bd-1a33-4238-98b5-04890d705393"). InnerVolumeSpecName "kube-api-access-2g5c9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:50:12.343802 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.343767 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" Jul 02 13:50:12.351869 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.351852 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws" Jul 02 13:50:12.417119 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.417039 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5017c4bd-1a33-4238-98b5-04890d705393-extensions-socket-volume\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:50:12.417119 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.417077 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv6zd\" (UniqueName: \"kubernetes.io/projected/5d393012-6526-4858-b92f-d5a7ee033a3f-kube-api-access-sv6zd\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:50:12.417119 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.417092 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2g5c9\" (UniqueName: \"kubernetes.io/projected/5017c4bd-1a33-4238-98b5-04890d705393-kube-api-access-2g5c9\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:50:12.500484 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.500460 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94"] Jul 02 13:50:12.503670 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:50:12.503643 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3228689a_2449_4bc0_8a6f_9c923c98a80a.slice/crio-b124d5966a21c5d02f14fb53b0b3a754bcb6bbefe492ebfde9deb7cd3e5464f9 WatchSource:0}: Error finding container b124d5966a21c5d02f14fb53b0b3a754bcb6bbefe492ebfde9deb7cd3e5464f9: Status 404 returned error can't find the container with id b124d5966a21c5d02f14fb53b0b3a754bcb6bbefe492ebfde9deb7cd3e5464f9 Jul 02 13:50:12.531393 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.531371 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws"] Jul 02 13:50:12.545027 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:50:12.544999 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b68561_471a_4944_9e67_22d33dbd04a7.slice/crio-6b887a7497644138f0ad15e39b8172d03c3d0a1cfa59011f4ae98b71aff24400 WatchSource:0}: Error finding container 6b887a7497644138f0ad15e39b8172d03c3d0a1cfa59011f4ae98b71aff24400: Status 404 returned error can't find the container with id 6b887a7497644138f0ad15e39b8172d03c3d0a1cfa59011f4ae98b71aff24400 Jul 02 13:50:12.930437 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.930400 2573 generic.go:356] "Generic (PLEG): container finished" podID="5017c4bd-1a33-4238-98b5-04890d705393" containerID="db947b76358c6ac5645c7dd426c3852c3daebf39dcca5687f5d6345c41a160d3" exitCode=0 Jul 02 13:50:12.930904 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.930464 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:12.930904 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.930519 2573 scope.go:117] "RemoveContainer" containerID="db947b76358c6ac5645c7dd426c3852c3daebf39dcca5687f5d6345c41a160d3" Jul 02 13:50:12.932092 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.932044 2573 generic.go:356] "Generic (PLEG): container finished" podID="5d393012-6526-4858-b92f-d5a7ee033a3f" containerID="a4ba6ded8e9cb34d746220f83d58c1ee93d99867d21e1d95234c6e190c4cad3d" exitCode=0 Jul 02 13:50:12.932167 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.932088 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:12.933875 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.933836 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5017c4bd-1a33-4238-98b5-04890d705393" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:12.934414 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.934389 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" event={"ID":"3228689a-2449-4bc0-8a6f-9c923c98a80a","Type":"ContainerStarted","Data":"9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145"} Jul 02 13:50:12.934527 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.934438 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" event={"ID":"3228689a-2449-4bc0-8a6f-9c923c98a80a","Type":"ContainerStarted","Data":"b124d5966a21c5d02f14fb53b0b3a754bcb6bbefe492ebfde9deb7cd3e5464f9"} Jul 02 13:50:12.934527 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.934469 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" Jul 02 13:50:12.936263 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.936235 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws" event={"ID":"c2b68561-471a-4944-9e67-22d33dbd04a7","Type":"ContainerStarted","Data":"2e3eb68da7a8a2673105b7e6ac3583f34f342f10fa1e8b54fdacad8c1d1a78bc"} Jul 02 13:50:12.936364 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.936284 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws" event={"ID":"c2b68561-471a-4944-9e67-22d33dbd04a7","Type":"ContainerStarted","Data":"6b887a7497644138f0ad15e39b8172d03c3d0a1cfa59011f4ae98b71aff24400"} Jul 02 13:50:12.936489 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.936474 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws" Jul 02 13:50:12.938602 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.938577 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vck4x\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:12.942062 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.942039 2573 scope.go:117] "RemoveContainer" containerID="db947b76358c6ac5645c7dd426c3852c3daebf39dcca5687f5d6345c41a160d3" Jul 02 13:50:12.942300 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.942283 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db947b76358c6ac5645c7dd426c3852c3daebf39dcca5687f5d6345c41a160d3\": container with ID starting with db947b76358c6ac5645c7dd426c3852c3daebf39dcca5687f5d6345c41a160d3 not found: ID does not exist" containerID="db947b76358c6ac5645c7dd426c3852c3daebf39dcca5687f5d6345c41a160d3" Jul 02 13:50:12.942347 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.942308 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db947b76358c6ac5645c7dd426c3852c3daebf39dcca5687f5d6345c41a160d3"} err="failed to get container status \"db947b76358c6ac5645c7dd426c3852c3daebf39dcca5687f5d6345c41a160d3\": rpc error: code = NotFound desc = could not find container \"db947b76358c6ac5645c7dd426c3852c3daebf39dcca5687f5d6345c41a160d3\": container with ID starting with db947b76358c6ac5645c7dd426c3852c3daebf39dcca5687f5d6345c41a160d3 not found: ID does not exist" Jul 02 13:50:12.942347 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.942323 2573 scope.go:117] "RemoveContainer" containerID="a4ba6ded8e9cb34d746220f83d58c1ee93d99867d21e1d95234c6e190c4cad3d" Jul 02 13:50:12.956400 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.956384 2573 scope.go:117] "RemoveContainer" containerID="a4ba6ded8e9cb34d746220f83d58c1ee93d99867d21e1d95234c6e190c4cad3d" Jul 02 13:50:12.956685 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.956658 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ba6ded8e9cb34d746220f83d58c1ee93d99867d21e1d95234c6e190c4cad3d\": container with ID starting with a4ba6ded8e9cb34d746220f83d58c1ee93d99867d21e1d95234c6e190c4cad3d not found: ID does not exist" containerID="a4ba6ded8e9cb34d746220f83d58c1ee93d99867d21e1d95234c6e190c4cad3d" Jul 02 13:50:12.956768 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.956683 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ba6ded8e9cb34d746220f83d58c1ee93d99867d21e1d95234c6e190c4cad3d"} err="failed to get container status \"a4ba6ded8e9cb34d746220f83d58c1ee93d99867d21e1d95234c6e190c4cad3d\": rpc error: code = NotFound desc = could not find container \"a4ba6ded8e9cb34d746220f83d58c1ee93d99867d21e1d95234c6e190c4cad3d\": container with ID starting with a4ba6ded8e9cb34d746220f83d58c1ee93d99867d21e1d95234c6e190c4cad3d not found: ID does not exist" Jul 02 13:50:12.972725 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.972684 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" podStartSLOduration=1.9726713230000001 podStartE2EDuration="1.972671323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:50:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:50:12.970655066 +0000 UTC m=+524.103546621" watchObservedRunningTime="2026-07-02 13:50:12.972671323 +0000 UTC m=+524.105562887" Jul 02 13:50:12.998863 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:12.998823 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws" podStartSLOduration=1.9988126739999998 podStartE2EDuration="1.998812674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:50:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:50:12.997279989 +0000 UTC m=+524.130171553" watchObservedRunningTime="2026-07-02 13:50:12.998812674 +0000 UTC m=+524.131704239" Jul 02 13:50:13.000017 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:12.999993 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5017c4bd-1a33-4238-98b5-04890d705393" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:13.002107 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:13.002086 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vck4x\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:13.004519 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:13.004501 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5017c4bd-1a33-4238-98b5-04890d705393" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:13.006432 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:13.006412 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vck4x\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:13.140010 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.139974 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6"] Jul 02 13:50:13.144798 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.144779 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" Jul 02 13:50:13.147225 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:13.147196 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vltm6\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5017c4bd-1a33-4238-98b5-04890d705393" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vltm6" Jul 02 13:50:13.159879 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.159854 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6"] Jul 02 13:50:13.177600 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:13.177553 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vck4x\" is forbidden: User \"system:node:ip-10-0-131-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-54.ec2.internal' and this object" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vck4x" Jul 02 13:50:13.224142 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.224050 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f69c93af-80dd-477e-882a-7156d8bcf036-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pfjg6\" (UID: \"f69c93af-80dd-477e-882a-7156d8bcf036\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" Jul 02 13:50:13.224319 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.224151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlj9j\" (UniqueName: \"kubernetes.io/projected/f69c93af-80dd-477e-882a-7156d8bcf036-kube-api-access-jlj9j\") pod \"kuadrant-operator-controller-manager-86878c769f-pfjg6\" (UID: \"f69c93af-80dd-477e-882a-7156d8bcf036\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" Jul 02 13:50:13.324860 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.324831 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f69c93af-80dd-477e-882a-7156d8bcf036-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pfjg6\" (UID: \"f69c93af-80dd-477e-882a-7156d8bcf036\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" Jul 02 13:50:13.325090 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.324890 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlj9j\" (UniqueName: \"kubernetes.io/projected/f69c93af-80dd-477e-882a-7156d8bcf036-kube-api-access-jlj9j\") pod \"kuadrant-operator-controller-manager-86878c769f-pfjg6\" (UID: \"f69c93af-80dd-477e-882a-7156d8bcf036\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" Jul 02 13:50:13.325225 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.325204 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f69c93af-80dd-477e-882a-7156d8bcf036-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pfjg6\" (UID: \"f69c93af-80dd-477e-882a-7156d8bcf036\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" Jul 02 13:50:13.335121 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.335097 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlj9j\" (UniqueName: \"kubernetes.io/projected/f69c93af-80dd-477e-882a-7156d8bcf036-kube-api-access-jlj9j\") pod \"kuadrant-operator-controller-manager-86878c769f-pfjg6\" (UID: \"f69c93af-80dd-477e-882a-7156d8bcf036\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" Jul 02 13:50:13.455239 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.455200 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" Jul 02 13:50:13.486130 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.486056 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5017c4bd-1a33-4238-98b5-04890d705393" path="/var/lib/kubelet/pods/5017c4bd-1a33-4238-98b5-04890d705393/volumes" Jul 02 13:50:13.486372 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.486358 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d393012-6526-4858-b92f-d5a7ee033a3f" path="/var/lib/kubelet/pods/5d393012-6526-4858-b92f-d5a7ee033a3f/volumes" Jul 02 13:50:13.628259 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.628236 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6"] Jul 02 13:50:13.630421 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:50:13.630392 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69c93af_80dd_477e_882a_7156d8bcf036.slice/crio-bc5c383c75470b3307621e8894deb1741ee6c77d0dc7c385957b35accae0b32c WatchSource:0}: Error finding container bc5c383c75470b3307621e8894deb1741ee6c77d0dc7c385957b35accae0b32c: Status 404 returned error can't find the container with id bc5c383c75470b3307621e8894deb1741ee6c77d0dc7c385957b35accae0b32c Jul 02 13:50:13.943629 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.943589 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" event={"ID":"f69c93af-80dd-477e-882a-7156d8bcf036","Type":"ContainerStarted","Data":"8b2240a54fdb0521babbfb7132a31beb7412bffb62a28613af663147d3aa88cf"} Jul 02 13:50:13.944093 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.943652 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" event={"ID":"f69c93af-80dd-477e-882a-7156d8bcf036","Type":"ContainerStarted","Data":"bc5c383c75470b3307621e8894deb1741ee6c77d0dc7c385957b35accae0b32c"} Jul 02 13:50:13.944093 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.943702 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" Jul 02 13:50:13.969176 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:13.969134 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" podStartSLOduration=0.969120561 podStartE2EDuration="969.120561ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:50:13.965944457 +0000 UTC m=+525.098836018" watchObservedRunningTime="2026-07-02 13:50:13.969120561 +0000 UTC m=+525.102012126" Jul 02 13:50:23.948193 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:23.948123 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" Jul 02 13:50:23.948653 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:23.948636 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m6xws" Jul 02 13:50:24.954354 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:24.954324 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pfjg6" Jul 02 13:50:25.014822 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:25.014786 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94"] Jul 02 13:50:25.015069 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:25.015041 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" podUID="3228689a-2449-4bc0-8a6f-9c923c98a80a" containerName="manager" containerID="cri-o://9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145" gracePeriod=10 Jul 02 13:50:25.272117 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:25.272091 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" Jul 02 13:50:25.425861 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:25.425815 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3228689a-2449-4bc0-8a6f-9c923c98a80a-extensions-socket-volume\") pod \"3228689a-2449-4bc0-8a6f-9c923c98a80a\" (UID: \"3228689a-2449-4bc0-8a6f-9c923c98a80a\") " Jul 02 13:50:25.426128 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:25.425902 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqn7b\" (UniqueName: \"kubernetes.io/projected/3228689a-2449-4bc0-8a6f-9c923c98a80a-kube-api-access-dqn7b\") pod \"3228689a-2449-4bc0-8a6f-9c923c98a80a\" (UID: \"3228689a-2449-4bc0-8a6f-9c923c98a80a\") " Jul 02 13:50:25.426241 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:25.426219 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3228689a-2449-4bc0-8a6f-9c923c98a80a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3228689a-2449-4bc0-8a6f-9c923c98a80a" (UID: "3228689a-2449-4bc0-8a6f-9c923c98a80a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:50:25.427959 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:25.427915 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3228689a-2449-4bc0-8a6f-9c923c98a80a-kube-api-access-dqn7b" (OuterVolumeSpecName: "kube-api-access-dqn7b") pod "3228689a-2449-4bc0-8a6f-9c923c98a80a" (UID: "3228689a-2449-4bc0-8a6f-9c923c98a80a"). InnerVolumeSpecName "kube-api-access-dqn7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:50:25.526846 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:25.526814 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqn7b\" (UniqueName: \"kubernetes.io/projected/3228689a-2449-4bc0-8a6f-9c923c98a80a-kube-api-access-dqn7b\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:50:25.526846 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:25.526841 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3228689a-2449-4bc0-8a6f-9c923c98a80a-extensions-socket-volume\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:50:26.008969 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:26.008916 2573 generic.go:356] "Generic (PLEG): container finished" podID="3228689a-2449-4bc0-8a6f-9c923c98a80a" containerID="9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145" exitCode=0 Jul 02 13:50:26.009355 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:26.008984 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" Jul 02 13:50:26.009355 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:26.008992 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" event={"ID":"3228689a-2449-4bc0-8a6f-9c923c98a80a","Type":"ContainerDied","Data":"9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145"} Jul 02 13:50:26.009355 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:26.009045 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94" event={"ID":"3228689a-2449-4bc0-8a6f-9c923c98a80a","Type":"ContainerDied","Data":"b124d5966a21c5d02f14fb53b0b3a754bcb6bbefe492ebfde9deb7cd3e5464f9"} Jul 02 13:50:26.009355 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:26.009067 2573 scope.go:117] "RemoveContainer" containerID="9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145" Jul 02 13:50:26.017749 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:26.017579 2573 scope.go:117] "RemoveContainer" containerID="9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145" Jul 02 13:50:26.017870 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:26.017850 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145\": container with ID starting with 9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145 not found: ID does not exist" containerID="9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145" Jul 02 13:50:26.017944 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:26.017880 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145"} err="failed to get container status \"9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145\": rpc error: code = NotFound desc = could not find container \"9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145\": container with ID starting with 9ec64eb9e26c0caee93563dc94262138f95e8d406cca2514e5c0b361decaa145 not found: ID does not exist" Jul 02 13:50:26.028534 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:26.028509 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94"] Jul 02 13:50:26.035377 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:26.035356 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q9p94"] Jul 02 13:50:27.478658 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:27.478615 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3228689a-2449-4bc0-8a6f-9c923c98a80a" path="/var/lib/kubelet/pods/3228689a-2449-4bc0-8a6f-9c923c98a80a/volumes" Jul 02 13:50:44.021678 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.021640 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wnpnm"] Jul 02 13:50:44.022195 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.021999 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3228689a-2449-4bc0-8a6f-9c923c98a80a" containerName="manager" Jul 02 13:50:44.022195 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.022011 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3228689a-2449-4bc0-8a6f-9c923c98a80a" containerName="manager" Jul 02 13:50:44.022195 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.022073 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3228689a-2449-4bc0-8a6f-9c923c98a80a" containerName="manager" Jul 02 13:50:44.026036 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.026010 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" Jul 02 13:50:44.028313 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.028292 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 13:50:44.028418 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.028355 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-h7v2c\"" Jul 02 13:50:44.033570 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.033183 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wnpnm"] Jul 02 13:50:44.063094 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.063059 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wnpnm"] Jul 02 13:50:44.069061 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.069036 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f1011da-c3e6-456b-8744-3e2a000d6e21-config-file\") pod \"limitador-limitador-54d6d988d5-wnpnm\" (UID: \"5f1011da-c3e6-456b-8744-3e2a000d6e21\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" Jul 02 13:50:44.069183 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.069105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mscnz\" (UniqueName: \"kubernetes.io/projected/5f1011da-c3e6-456b-8744-3e2a000d6e21-kube-api-access-mscnz\") pod \"limitador-limitador-54d6d988d5-wnpnm\" (UID: \"5f1011da-c3e6-456b-8744-3e2a000d6e21\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" Jul 02 13:50:44.169607 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.169575 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f1011da-c3e6-456b-8744-3e2a000d6e21-config-file\") pod \"limitador-limitador-54d6d988d5-wnpnm\" (UID: \"5f1011da-c3e6-456b-8744-3e2a000d6e21\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" Jul 02 13:50:44.169769 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.169641 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscnz\" (UniqueName: \"kubernetes.io/projected/5f1011da-c3e6-456b-8744-3e2a000d6e21-kube-api-access-mscnz\") pod \"limitador-limitador-54d6d988d5-wnpnm\" (UID: \"5f1011da-c3e6-456b-8744-3e2a000d6e21\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" Jul 02 13:50:44.170219 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.170201 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f1011da-c3e6-456b-8744-3e2a000d6e21-config-file\") pod \"limitador-limitador-54d6d988d5-wnpnm\" (UID: \"5f1011da-c3e6-456b-8744-3e2a000d6e21\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" Jul 02 13:50:44.177851 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.177821 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mscnz\" (UniqueName: \"kubernetes.io/projected/5f1011da-c3e6-456b-8744-3e2a000d6e21-kube-api-access-mscnz\") pod \"limitador-limitador-54d6d988d5-wnpnm\" (UID: \"5f1011da-c3e6-456b-8744-3e2a000d6e21\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" Jul 02 13:50:44.338061 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.337973 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" Jul 02 13:50:44.471902 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.471876 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wnpnm"] Jul 02 13:50:44.473871 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:50:44.473841 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1011da_c3e6_456b_8744_3e2a000d6e21.slice/crio-13c4e73b173aff3e813fe9caa90282edbe8616939d24734b65c1301df1eac73e WatchSource:0}: Error finding container 13c4e73b173aff3e813fe9caa90282edbe8616939d24734b65c1301df1eac73e: Status 404 returned error can't find the container with id 13c4e73b173aff3e813fe9caa90282edbe8616939d24734b65c1301df1eac73e Jul 02 13:50:44.489766 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.489738 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-c2kxw"] Jul 02 13:50:44.492587 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.492567 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c2kxw" Jul 02 13:50:44.494913 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.494892 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j96wk\"" Jul 02 13:50:44.502472 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.502449 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-c2kxw"] Jul 02 13:50:44.572726 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.572699 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh2p8\" (UniqueName: \"kubernetes.io/projected/34714fa7-e926-4e2f-8418-9b054482dca4-kube-api-access-bh2p8\") pod \"authorino-58cd955675-c2kxw\" (UID: \"34714fa7-e926-4e2f-8418-9b054482dca4\") " pod="kuadrant-system/authorino-58cd955675-c2kxw" Jul 02 13:50:44.673658 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.673584 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh2p8\" (UniqueName: \"kubernetes.io/projected/34714fa7-e926-4e2f-8418-9b054482dca4-kube-api-access-bh2p8\") pod \"authorino-58cd955675-c2kxw\" (UID: \"34714fa7-e926-4e2f-8418-9b054482dca4\") " pod="kuadrant-system/authorino-58cd955675-c2kxw" Jul 02 13:50:44.681820 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.681800 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh2p8\" (UniqueName: \"kubernetes.io/projected/34714fa7-e926-4e2f-8418-9b054482dca4-kube-api-access-bh2p8\") pod \"authorino-58cd955675-c2kxw\" (UID: \"34714fa7-e926-4e2f-8418-9b054482dca4\") " pod="kuadrant-system/authorino-58cd955675-c2kxw" Jul 02 13:50:44.803402 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.803361 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c2kxw" Jul 02 13:50:44.932998 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:44.932971 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-c2kxw"] Jul 02 13:50:44.934776 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:50:44.934750 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34714fa7_e926_4e2f_8418_9b054482dca4.slice/crio-76d1d289552760ed771d267e7585aa06c72f326113546a6f6712523cfbd02f63 WatchSource:0}: Error finding container 76d1d289552760ed771d267e7585aa06c72f326113546a6f6712523cfbd02f63: Status 404 returned error can't find the container with id 76d1d289552760ed771d267e7585aa06c72f326113546a6f6712523cfbd02f63 Jul 02 13:50:45.117829 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:45.117695 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" event={"ID":"5f1011da-c3e6-456b-8744-3e2a000d6e21","Type":"ContainerStarted","Data":"13c4e73b173aff3e813fe9caa90282edbe8616939d24734b65c1301df1eac73e"} Jul 02 13:50:45.119582 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:45.119546 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c2kxw" event={"ID":"34714fa7-e926-4e2f-8418-9b054482dca4","Type":"ContainerStarted","Data":"76d1d289552760ed771d267e7585aa06c72f326113546a6f6712523cfbd02f63"} Jul 02 13:50:48.144057 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:48.144018 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" event={"ID":"5f1011da-c3e6-456b-8744-3e2a000d6e21","Type":"ContainerStarted","Data":"6d35ed3650497fdcc74d32e22884b25239335d38ebc5999c4ad8a010b624d640"} Jul 02 13:50:48.144547 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:48.144396 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" Jul 02 13:50:48.161376 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:48.161326 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" podStartSLOduration=1.465347451 podStartE2EDuration="4.161310998s" totalImagesPullingTime="2.695963547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:50:48.159457563 +0000 UTC m=+559.292349128" watchObservedRunningTime="2026-07-02 13:50:48.161310998 +0000 UTC m=+559.294202562" Jul 02 13:50:49.149089 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:49.149050 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-c2kxw"] Jul 02 13:50:50.158240 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:50.158199 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c2kxw" event={"ID":"34714fa7-e926-4e2f-8418-9b054482dca4","Type":"ContainerStarted","Data":"b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c"} Jul 02 13:50:50.158607 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:50.158275 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-c2kxw" podUID="34714fa7-e926-4e2f-8418-9b054482dca4" containerName="authorino" containerID="cri-o://b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c" gracePeriod=30 Jul 02 13:50:50.174475 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:50.174429 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-c2kxw" podStartSLOduration=1.471715167 podStartE2EDuration="6.174413405s" totalImagesPullingTime="4.702698238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:50:50.172103524 +0000 UTC m=+561.305038477" watchObservedRunningTime="2026-07-02 13:50:50.174413405 +0000 UTC m=+561.307304970" Jul 02 13:50:50.412742 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:50.412679 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c2kxw" Jul 02 13:50:50.528660 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:50.528629 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh2p8\" (UniqueName: \"kubernetes.io/projected/34714fa7-e926-4e2f-8418-9b054482dca4-kube-api-access-bh2p8\") pod \"34714fa7-e926-4e2f-8418-9b054482dca4\" (UID: \"34714fa7-e926-4e2f-8418-9b054482dca4\") " Jul 02 13:50:50.530796 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:50.530767 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34714fa7-e926-4e2f-8418-9b054482dca4-kube-api-access-bh2p8" (OuterVolumeSpecName: "kube-api-access-bh2p8") pod "34714fa7-e926-4e2f-8418-9b054482dca4" (UID: "34714fa7-e926-4e2f-8418-9b054482dca4"). InnerVolumeSpecName "kube-api-access-bh2p8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:50:50.629443 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:50.629413 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh2p8\" (UniqueName: \"kubernetes.io/projected/34714fa7-e926-4e2f-8418-9b054482dca4-kube-api-access-bh2p8\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:50:51.164144 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:51.164111 2573 generic.go:356] "Generic (PLEG): container finished" podID="34714fa7-e926-4e2f-8418-9b054482dca4" containerID="b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c" exitCode=0 Jul 02 13:50:51.164551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:51.164152 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c2kxw" Jul 02 13:50:51.164551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:51.164203 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c2kxw" event={"ID":"34714fa7-e926-4e2f-8418-9b054482dca4","Type":"ContainerDied","Data":"b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c"} Jul 02 13:50:51.164551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:51.164241 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c2kxw" event={"ID":"34714fa7-e926-4e2f-8418-9b054482dca4","Type":"ContainerDied","Data":"76d1d289552760ed771d267e7585aa06c72f326113546a6f6712523cfbd02f63"} Jul 02 13:50:51.164551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:51.164257 2573 scope.go:117] "RemoveContainer" containerID="b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c" Jul 02 13:50:51.172864 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:51.172849 2573 scope.go:117] "RemoveContainer" containerID="b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c" Jul 02 13:50:51.173128 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:50:51.173110 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c\": container with ID starting with b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c not found: ID does not exist" containerID="b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c" Jul 02 13:50:51.173180 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:51.173135 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c"} err="failed to get container status \"b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c\": rpc error: code = NotFound desc = could not find container \"b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c\": container with ID starting with b48b3b1146bcd3a028e29e5d4c7dcacaa4d10698b8a9a1f4085bc7adba34e94c not found: ID does not exist" Jul 02 13:50:51.185024 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:51.185002 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-c2kxw"] Jul 02 13:50:51.188428 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:51.188409 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-c2kxw"] Jul 02 13:50:51.479003 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:51.478907 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34714fa7-e926-4e2f-8418-9b054482dca4" path="/var/lib/kubelet/pods/34714fa7-e926-4e2f-8418-9b054482dca4/volumes" Jul 02 13:50:59.152999 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:50:59.152971 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wnpnm" Jul 02 13:51:18.812431 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:18.812393 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql"] Jul 02 13:51:18.812887 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:18.812733 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34714fa7-e926-4e2f-8418-9b054482dca4" containerName="authorino" Jul 02 13:51:18.812887 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:18.812743 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="34714fa7-e926-4e2f-8418-9b054482dca4" containerName="authorino" Jul 02 13:51:18.812887 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:18.812806 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="34714fa7-e926-4e2f-8418-9b054482dca4" containerName="authorino" Jul 02 13:51:18.816291 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:18.816270 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:18.819795 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:18.819775 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 13:51:18.820444 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:18.820431 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 13:51:18.820536 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:18.820454 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qxlpd\"" Jul 02 13:51:18.829254 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:18.829232 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql"] Jul 02 13:51:18.979728 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:18.979689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql\" (UID: \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:18.979907 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:18.979735 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql\" (UID: \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:18.979907 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:18.979801 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snj8s\" (UniqueName: \"kubernetes.io/projected/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-kube-api-access-snj8s\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql\" (UID: \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:19.081146 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:19.081056 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snj8s\" (UniqueName: \"kubernetes.io/projected/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-kube-api-access-snj8s\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql\" (UID: \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:19.081315 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:19.081153 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql\" (UID: \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:19.081315 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:19.081191 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql\" (UID: \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:19.081557 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:19.081528 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql\" (UID: \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:19.081639 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:19.081577 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql\" (UID: \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:19.089567 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:19.089543 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snj8s\" (UniqueName: \"kubernetes.io/projected/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-kube-api-access-snj8s\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql\" (UID: \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:19.125135 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:19.125105 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:19.268879 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:19.268840 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql"] Jul 02 13:51:19.272098 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:51:19.272066 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887d3f7d_5c81_4d0e_b25b_edf076e6bd99.slice/crio-a8e9a8f0e75b5fadfc8f680addedcd0109d570df5658dcd6b45846952f6a4ae4 WatchSource:0}: Error finding container a8e9a8f0e75b5fadfc8f680addedcd0109d570df5658dcd6b45846952f6a4ae4: Status 404 returned error can't find the container with id a8e9a8f0e75b5fadfc8f680addedcd0109d570df5658dcd6b45846952f6a4ae4 Jul 02 13:51:19.306070 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:19.306039 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" event={"ID":"887d3f7d-5c81-4d0e-b25b-edf076e6bd99","Type":"ContainerStarted","Data":"a8e9a8f0e75b5fadfc8f680addedcd0109d570df5658dcd6b45846952f6a4ae4"} Jul 02 13:51:20.312687 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:20.312651 2573 generic.go:356] "Generic (PLEG): container finished" podID="887d3f7d-5c81-4d0e-b25b-edf076e6bd99" containerID="63a748f8f1ee7cb2bf6e57cc3403cb46a47ddc7f7fb15eb76dbc4f1c17bb5521" exitCode=0 Jul 02 13:51:20.313072 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:20.312773 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" event={"ID":"887d3f7d-5c81-4d0e-b25b-edf076e6bd99","Type":"ContainerDied","Data":"63a748f8f1ee7cb2bf6e57cc3403cb46a47ddc7f7fb15eb76dbc4f1c17bb5521"} Jul 02 13:51:22.325772 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:22.325736 2573 generic.go:356] "Generic (PLEG): container finished" podID="887d3f7d-5c81-4d0e-b25b-edf076e6bd99" containerID="69bf02bd7a0188512226668e3800e6d8bbaa16f7a62a4780b7a679b51ed58a7e" exitCode=0 Jul 02 13:51:22.326240 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:22.325789 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" event={"ID":"887d3f7d-5c81-4d0e-b25b-edf076e6bd99","Type":"ContainerDied","Data":"69bf02bd7a0188512226668e3800e6d8bbaa16f7a62a4780b7a679b51ed58a7e"} Jul 02 13:51:23.333505 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:23.333469 2573 generic.go:356] "Generic (PLEG): container finished" podID="887d3f7d-5c81-4d0e-b25b-edf076e6bd99" containerID="8a0ed1da7e2ab5c9f5a7458e29826c88e26ee6572bf4fc29f23c6641b57fb0d4" exitCode=0 Jul 02 13:51:23.333985 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:23.333517 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" event={"ID":"887d3f7d-5c81-4d0e-b25b-edf076e6bd99","Type":"ContainerDied","Data":"8a0ed1da7e2ab5c9f5a7458e29826c88e26ee6572bf4fc29f23c6641b57fb0d4"} Jul 02 13:51:24.468088 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:24.468061 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:24.625809 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:24.625721 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-util\") pod \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\" (UID: \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\") " Jul 02 13:51:24.625809 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:24.625796 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-bundle\") pod \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\" (UID: \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\") " Jul 02 13:51:24.626076 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:24.625819 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snj8s\" (UniqueName: \"kubernetes.io/projected/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-kube-api-access-snj8s\") pod \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\" (UID: \"887d3f7d-5c81-4d0e-b25b-edf076e6bd99\") " Jul 02 13:51:24.626335 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:24.626310 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-bundle" (OuterVolumeSpecName: "bundle") pod "887d3f7d-5c81-4d0e-b25b-edf076e6bd99" (UID: "887d3f7d-5c81-4d0e-b25b-edf076e6bd99"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:51:24.628012 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:24.627986 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-kube-api-access-snj8s" (OuterVolumeSpecName: "kube-api-access-snj8s") pod "887d3f7d-5c81-4d0e-b25b-edf076e6bd99" (UID: "887d3f7d-5c81-4d0e-b25b-edf076e6bd99"). InnerVolumeSpecName "kube-api-access-snj8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:51:24.631463 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:24.631441 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-util" (OuterVolumeSpecName: "util") pod "887d3f7d-5c81-4d0e-b25b-edf076e6bd99" (UID: "887d3f7d-5c81-4d0e-b25b-edf076e6bd99"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:51:24.726460 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:24.726421 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-util\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:51:24.726460 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:24.726452 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-bundle\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:51:24.726460 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:24.726461 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snj8s\" (UniqueName: \"kubernetes.io/projected/887d3f7d-5c81-4d0e-b25b-edf076e6bd99-kube-api-access-snj8s\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:51:25.346461 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:25.346436 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" Jul 02 13:51:25.346635 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:25.346426 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8wrmql" event={"ID":"887d3f7d-5c81-4d0e-b25b-edf076e6bd99","Type":"ContainerDied","Data":"a8e9a8f0e75b5fadfc8f680addedcd0109d570df5658dcd6b45846952f6a4ae4"} Jul 02 13:51:25.346635 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:25.346560 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8e9a8f0e75b5fadfc8f680addedcd0109d570df5658dcd6b45846952f6a4ae4" Jul 02 13:51:29.424059 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:29.424031 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-acl-logging/0.log" Jul 02 13:51:29.425818 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:51:29.425792 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-acl-logging/0.log" Jul 02 13:52:18.746987 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.746952 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87kck"] Jul 02 13:52:18.747444 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.747320 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="887d3f7d-5c81-4d0e-b25b-edf076e6bd99" containerName="pull" Jul 02 13:52:18.747444 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.747333 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="887d3f7d-5c81-4d0e-b25b-edf076e6bd99" containerName="pull" Jul 02 13:52:18.747444 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.747347 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="887d3f7d-5c81-4d0e-b25b-edf076e6bd99" containerName="util" Jul 02 13:52:18.747444 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.747352 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="887d3f7d-5c81-4d0e-b25b-edf076e6bd99" containerName="util" Jul 02 13:52:18.747444 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.747359 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="887d3f7d-5c81-4d0e-b25b-edf076e6bd99" containerName="extract" Jul 02 13:52:18.747444 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.747365 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="887d3f7d-5c81-4d0e-b25b-edf076e6bd99" containerName="extract" Jul 02 13:52:18.747444 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.747424 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="887d3f7d-5c81-4d0e-b25b-edf076e6bd99" containerName="extract" Jul 02 13:52:18.749656 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.749640 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-87kck" Jul 02 13:52:18.752613 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.752590 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j96wk\"" Jul 02 13:52:18.760152 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.760132 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87kck"] Jul 02 13:52:18.876215 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.876182 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn799\" (UniqueName: \"kubernetes.io/projected/ec8ade32-955d-4c63-945c-167bb6d88f28-kube-api-access-pn799\") pod \"authorino-5d4b67c446-87kck\" (UID: \"ec8ade32-955d-4c63-945c-167bb6d88f28\") " pod="kuadrant-system/authorino-5d4b67c446-87kck" Jul 02 13:52:18.977172 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.977135 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn799\" (UniqueName: \"kubernetes.io/projected/ec8ade32-955d-4c63-945c-167bb6d88f28-kube-api-access-pn799\") pod \"authorino-5d4b67c446-87kck\" (UID: \"ec8ade32-955d-4c63-945c-167bb6d88f28\") " pod="kuadrant-system/authorino-5d4b67c446-87kck" Jul 02 13:52:18.988337 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.988311 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn799\" (UniqueName: \"kubernetes.io/projected/ec8ade32-955d-4c63-945c-167bb6d88f28-kube-api-access-pn799\") pod \"authorino-5d4b67c446-87kck\" (UID: \"ec8ade32-955d-4c63-945c-167bb6d88f28\") " pod="kuadrant-system/authorino-5d4b67c446-87kck" Jul 02 13:52:18.995462 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.995433 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87kck"] Jul 02 13:52:18.995651 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:18.995632 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-87kck" Jul 02 13:52:19.021421 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.021392 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-696d4d44f8-47jv5"] Jul 02 13:52:19.024167 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.024146 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696d4d44f8-47jv5" Jul 02 13:52:19.034327 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.034301 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-696d4d44f8-47jv5"] Jul 02 13:52:19.083748 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.083719 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-696d4d44f8-47jv5"] Jul 02 13:52:19.084106 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:52:19.084055 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dbzfz], unattached volumes=[], failed to process volumes=[kube-api-access-dbzfz]: context canceled" pod="kuadrant-system/authorino-696d4d44f8-47jv5" podUID="431b262b-1597-4810-974b-64078b5f215e" Jul 02 13:52:19.117679 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.117646 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79bb849dd6-hw9sm"] Jul 02 13:52:19.120125 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.120105 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79bb849dd6-hw9sm" Jul 02 13:52:19.122835 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.122813 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 02 13:52:19.130466 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.130446 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79bb849dd6-hw9sm"] Jul 02 13:52:19.143798 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.143771 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87kck"] Jul 02 13:52:19.145894 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:52:19.145872 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec8ade32_955d_4c63_945c_167bb6d88f28.slice/crio-9400bbbffc8f431b04bbe6e95a6d57dc60e05cdcc8ba67e4d9a375065a838a86 WatchSource:0}: Error finding container 9400bbbffc8f431b04bbe6e95a6d57dc60e05cdcc8ba67e4d9a375065a838a86: Status 404 returned error can't find the container with id 9400bbbffc8f431b04bbe6e95a6d57dc60e05cdcc8ba67e4d9a375065a838a86 Jul 02 13:52:19.147733 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.147718 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 13:52:19.179415 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.179377 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbzfz\" (UniqueName: \"kubernetes.io/projected/431b262b-1597-4810-974b-64078b5f215e-kube-api-access-dbzfz\") pod \"authorino-696d4d44f8-47jv5\" (UID: \"431b262b-1597-4810-974b-64078b5f215e\") " pod="kuadrant-system/authorino-696d4d44f8-47jv5" Jul 02 13:52:19.280586 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.280554 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht7br\" (UniqueName: \"kubernetes.io/projected/0627ef14-96bf-4927-9661-cb60a1ba7136-kube-api-access-ht7br\") pod \"authorino-79bb849dd6-hw9sm\" (UID: \"0627ef14-96bf-4927-9661-cb60a1ba7136\") " pod="kuadrant-system/authorino-79bb849dd6-hw9sm" Jul 02 13:52:19.280773 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.280653 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0627ef14-96bf-4927-9661-cb60a1ba7136-tls-cert\") pod \"authorino-79bb849dd6-hw9sm\" (UID: \"0627ef14-96bf-4927-9661-cb60a1ba7136\") " pod="kuadrant-system/authorino-79bb849dd6-hw9sm" Jul 02 13:52:19.280773 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.280688 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbzfz\" (UniqueName: \"kubernetes.io/projected/431b262b-1597-4810-974b-64078b5f215e-kube-api-access-dbzfz\") pod \"authorino-696d4d44f8-47jv5\" (UID: \"431b262b-1597-4810-974b-64078b5f215e\") " pod="kuadrant-system/authorino-696d4d44f8-47jv5" Jul 02 13:52:19.302445 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.302413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbzfz\" (UniqueName: \"kubernetes.io/projected/431b262b-1597-4810-974b-64078b5f215e-kube-api-access-dbzfz\") pod \"authorino-696d4d44f8-47jv5\" (UID: \"431b262b-1597-4810-974b-64078b5f215e\") " pod="kuadrant-system/authorino-696d4d44f8-47jv5" Jul 02 13:52:19.381874 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.381835 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0627ef14-96bf-4927-9661-cb60a1ba7136-tls-cert\") pod \"authorino-79bb849dd6-hw9sm\" (UID: \"0627ef14-96bf-4927-9661-cb60a1ba7136\") " pod="kuadrant-system/authorino-79bb849dd6-hw9sm" Jul 02 13:52:19.382076 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.381889 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht7br\" (UniqueName: \"kubernetes.io/projected/0627ef14-96bf-4927-9661-cb60a1ba7136-kube-api-access-ht7br\") pod \"authorino-79bb849dd6-hw9sm\" (UID: \"0627ef14-96bf-4927-9661-cb60a1ba7136\") " pod="kuadrant-system/authorino-79bb849dd6-hw9sm" Jul 02 13:52:19.384378 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.384357 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0627ef14-96bf-4927-9661-cb60a1ba7136-tls-cert\") pod \"authorino-79bb849dd6-hw9sm\" (UID: \"0627ef14-96bf-4927-9661-cb60a1ba7136\") " pod="kuadrant-system/authorino-79bb849dd6-hw9sm" Jul 02 13:52:19.391506 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.391481 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht7br\" (UniqueName: \"kubernetes.io/projected/0627ef14-96bf-4927-9661-cb60a1ba7136-kube-api-access-ht7br\") pod \"authorino-79bb849dd6-hw9sm\" (UID: \"0627ef14-96bf-4927-9661-cb60a1ba7136\") " pod="kuadrant-system/authorino-79bb849dd6-hw9sm" Jul 02 13:52:19.430271 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.430231 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79bb849dd6-hw9sm" Jul 02 13:52:19.564112 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.564088 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79bb849dd6-hw9sm"] Jul 02 13:52:19.566246 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:52:19.566209 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0627ef14_96bf_4927_9661_cb60a1ba7136.slice/crio-9e88caab238b0683d485ca59da9ea944ba1101e9f347b75d982a37ed147e2b3b WatchSource:0}: Error finding container 9e88caab238b0683d485ca59da9ea944ba1101e9f347b75d982a37ed147e2b3b: Status 404 returned error can't find the container with id 9e88caab238b0683d485ca59da9ea944ba1101e9f347b75d982a37ed147e2b3b Jul 02 13:52:19.626804 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.626771 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-87kck" event={"ID":"ec8ade32-955d-4c63-945c-167bb6d88f28","Type":"ContainerStarted","Data":"9400bbbffc8f431b04bbe6e95a6d57dc60e05cdcc8ba67e4d9a375065a838a86"} Jul 02 13:52:19.631244 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.631206 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79bb849dd6-hw9sm" event={"ID":"0627ef14-96bf-4927-9661-cb60a1ba7136","Type":"ContainerStarted","Data":"9e88caab238b0683d485ca59da9ea944ba1101e9f347b75d982a37ed147e2b3b"} Jul 02 13:52:19.631244 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.631240 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696d4d44f8-47jv5" Jul 02 13:52:19.638913 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.638886 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696d4d44f8-47jv5" Jul 02 13:52:19.784705 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.784666 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbzfz\" (UniqueName: \"kubernetes.io/projected/431b262b-1597-4810-974b-64078b5f215e-kube-api-access-dbzfz\") pod \"431b262b-1597-4810-974b-64078b5f215e\" (UID: \"431b262b-1597-4810-974b-64078b5f215e\") " Jul 02 13:52:19.787081 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.787044 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431b262b-1597-4810-974b-64078b5f215e-kube-api-access-dbzfz" (OuterVolumeSpecName: "kube-api-access-dbzfz") pod "431b262b-1597-4810-974b-64078b5f215e" (UID: "431b262b-1597-4810-974b-64078b5f215e"). InnerVolumeSpecName "kube-api-access-dbzfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:52:19.885755 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:19.885721 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbzfz\" (UniqueName: \"kubernetes.io/projected/431b262b-1597-4810-974b-64078b5f215e-kube-api-access-dbzfz\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:52:20.638473 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:20.638436 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-87kck" event={"ID":"ec8ade32-955d-4c63-945c-167bb6d88f28","Type":"ContainerStarted","Data":"6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab"} Jul 02 13:52:20.638473 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:20.638468 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-87kck" podUID="ec8ade32-955d-4c63-945c-167bb6d88f28" containerName="authorino" containerID="cri-o://6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab" gracePeriod=30 Jul 02 13:52:20.640060 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:20.640031 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79bb849dd6-hw9sm" event={"ID":"0627ef14-96bf-4927-9661-cb60a1ba7136","Type":"ContainerStarted","Data":"340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b"} Jul 02 13:52:20.640167 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:20.640069 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696d4d44f8-47jv5" Jul 02 13:52:20.657492 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:20.657453 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-87kck" podStartSLOduration=2.137320167 podStartE2EDuration="2.657438394s" totalImagesPullingTime="520.118227ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:52:20.655796688 +0000 UTC m=+651.788688254" watchObservedRunningTime="2026-07-02 13:52:20.657438394 +0000 UTC m=+651.790329959" Jul 02 13:52:20.678530 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:20.678486 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79bb849dd6-hw9sm" podStartSLOduration=1.379655058 podStartE2EDuration="1.678471466s" totalImagesPullingTime="298.816408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:52:20.677778324 +0000 UTC m=+651.810669889" watchObservedRunningTime="2026-07-02 13:52:20.678471466 +0000 UTC m=+651.811363030" Jul 02 13:52:20.738270 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:20.738239 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-696d4d44f8-47jv5"] Jul 02 13:52:20.744741 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:20.744703 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-696d4d44f8-47jv5"] Jul 02 13:52:20.897789 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:20.897724 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-87kck" Jul 02 13:52:20.994890 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:20.994860 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn799\" (UniqueName: \"kubernetes.io/projected/ec8ade32-955d-4c63-945c-167bb6d88f28-kube-api-access-pn799\") pod \"ec8ade32-955d-4c63-945c-167bb6d88f28\" (UID: \"ec8ade32-955d-4c63-945c-167bb6d88f28\") " Jul 02 13:52:20.996837 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:20.996812 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec8ade32-955d-4c63-945c-167bb6d88f28-kube-api-access-pn799" (OuterVolumeSpecName: "kube-api-access-pn799") pod "ec8ade32-955d-4c63-945c-167bb6d88f28" (UID: "ec8ade32-955d-4c63-945c-167bb6d88f28"). InnerVolumeSpecName "kube-api-access-pn799". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:52:21.096357 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:21.096324 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn799\" (UniqueName: \"kubernetes.io/projected/ec8ade32-955d-4c63-945c-167bb6d88f28-kube-api-access-pn799\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:52:21.479974 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:21.479941 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="431b262b-1597-4810-974b-64078b5f215e" path="/var/lib/kubelet/pods/431b262b-1597-4810-974b-64078b5f215e/volumes" Jul 02 13:52:21.646665 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:21.646633 2573 generic.go:356] "Generic (PLEG): container finished" podID="ec8ade32-955d-4c63-945c-167bb6d88f28" containerID="6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab" exitCode=0 Jul 02 13:52:21.646819 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:21.646676 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-87kck" Jul 02 13:52:21.646819 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:21.646724 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-87kck" event={"ID":"ec8ade32-955d-4c63-945c-167bb6d88f28","Type":"ContainerDied","Data":"6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab"} Jul 02 13:52:21.646819 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:21.646766 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-87kck" event={"ID":"ec8ade32-955d-4c63-945c-167bb6d88f28","Type":"ContainerDied","Data":"9400bbbffc8f431b04bbe6e95a6d57dc60e05cdcc8ba67e4d9a375065a838a86"} Jul 02 13:52:21.646819 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:21.646784 2573 scope.go:117] "RemoveContainer" containerID="6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab" Jul 02 13:52:21.655156 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:21.655140 2573 scope.go:117] "RemoveContainer" containerID="6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab" Jul 02 13:52:21.655404 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:52:21.655387 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab\": container with ID starting with 6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab not found: ID does not exist" containerID="6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab" Jul 02 13:52:21.655451 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:21.655422 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab"} err="failed to get container status \"6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab\": rpc error: code = NotFound desc = could not find container \"6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab\": container with ID starting with 6cd18ec4c936410a1b12f770bc7e819fb883c5c22c2d79cadfad32a804de26ab not found: ID does not exist" Jul 02 13:52:21.664443 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:21.664417 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87kck"] Jul 02 13:52:21.672939 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:21.669764 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87kck"] Jul 02 13:52:23.479811 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:52:23.479778 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec8ade32-955d-4c63-945c-167bb6d88f28" path="/var/lib/kubelet/pods/ec8ade32-955d-4c63-945c-167bb6d88f28/volumes" Jul 02 13:53:01.790832 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:01.790795 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wnpnm"] Jul 02 13:53:50.120124 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.120088 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76668689c6-lfdbt"] Jul 02 13:53:50.120608 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.120417 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec8ade32-955d-4c63-945c-167bb6d88f28" containerName="authorino" Jul 02 13:53:50.120608 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.120428 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec8ade32-955d-4c63-945c-167bb6d88f28" containerName="authorino" Jul 02 13:53:50.120608 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.120499 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec8ade32-955d-4c63-945c-167bb6d88f28" containerName="authorino" Jul 02 13:53:50.123511 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.123494 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:53:50.125894 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.125869 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 02 13:53:50.130258 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.130214 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76668689c6-lfdbt"] Jul 02 13:53:50.234646 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.234610 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-tls-cert\") pod \"authorino-76668689c6-lfdbt\" (UID: \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\") " pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:53:50.234646 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.234647 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlxsd\" (UniqueName: \"kubernetes.io/projected/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-kube-api-access-nlxsd\") pod \"authorino-76668689c6-lfdbt\" (UID: \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\") " pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:53:50.234845 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.234690 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-oidc-ca\") pod \"authorino-76668689c6-lfdbt\" (UID: \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\") " pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:53:50.335150 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.335120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-oidc-ca\") pod \"authorino-76668689c6-lfdbt\" (UID: \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\") " pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:53:50.335308 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.335194 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-tls-cert\") pod \"authorino-76668689c6-lfdbt\" (UID: \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\") " pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:53:50.335308 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.335223 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlxsd\" (UniqueName: \"kubernetes.io/projected/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-kube-api-access-nlxsd\") pod \"authorino-76668689c6-lfdbt\" (UID: \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\") " pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:53:50.335834 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.335810 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-oidc-ca\") pod \"authorino-76668689c6-lfdbt\" (UID: \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\") " pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:53:50.337728 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.337706 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-tls-cert\") pod \"authorino-76668689c6-lfdbt\" (UID: \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\") " pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:53:50.342791 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.342769 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlxsd\" (UniqueName: \"kubernetes.io/projected/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-kube-api-access-nlxsd\") pod \"authorino-76668689c6-lfdbt\" (UID: \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\") " pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:53:50.433758 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.433666 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:53:50.570109 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:50.570083 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76668689c6-lfdbt"] Jul 02 13:53:50.572351 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:53:50.572325 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b58d2a2_baa2_42c2_84a2_bfbda42ccb27.slice/crio-8b1ca0c037d6c8be8adcba12f49b4d0955ca6616fb2a4a873a61ced34974ffea WatchSource:0}: Error finding container 8b1ca0c037d6c8be8adcba12f49b4d0955ca6616fb2a4a873a61ced34974ffea: Status 404 returned error can't find the container with id 8b1ca0c037d6c8be8adcba12f49b4d0955ca6616fb2a4a873a61ced34974ffea Jul 02 13:53:51.115328 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:51.115288 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76668689c6-lfdbt" event={"ID":"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27","Type":"ContainerStarted","Data":"b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9"} Jul 02 13:53:51.115494 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:51.115340 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76668689c6-lfdbt" event={"ID":"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27","Type":"ContainerStarted","Data":"8b1ca0c037d6c8be8adcba12f49b4d0955ca6616fb2a4a873a61ced34974ffea"} Jul 02 13:53:51.135416 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:51.135367 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76668689c6-lfdbt" podStartSLOduration=0.696757767 podStartE2EDuration="1.13534949s" totalImagesPullingTime="438.591723ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:53:51.132522946 +0000 UTC m=+742.265414513" watchObservedRunningTime="2026-07-02 13:53:51.13534949 +0000 UTC m=+742.268241056" Jul 02 13:53:51.161529 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:51.161493 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79bb849dd6-hw9sm"] Jul 02 13:53:51.161771 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:51.161742 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-79bb849dd6-hw9sm" podUID="0627ef14-96bf-4927-9661-cb60a1ba7136" containerName="authorino" containerID="cri-o://340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b" gracePeriod=30 Jul 02 13:53:51.415052 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:51.415026 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79bb849dd6-hw9sm" Jul 02 13:53:51.446609 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:51.446579 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht7br\" (UniqueName: \"kubernetes.io/projected/0627ef14-96bf-4927-9661-cb60a1ba7136-kube-api-access-ht7br\") pod \"0627ef14-96bf-4927-9661-cb60a1ba7136\" (UID: \"0627ef14-96bf-4927-9661-cb60a1ba7136\") " Jul 02 13:53:51.446776 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:51.446630 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0627ef14-96bf-4927-9661-cb60a1ba7136-tls-cert\") pod \"0627ef14-96bf-4927-9661-cb60a1ba7136\" (UID: \"0627ef14-96bf-4927-9661-cb60a1ba7136\") " Jul 02 13:53:51.448723 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:51.448685 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0627ef14-96bf-4927-9661-cb60a1ba7136-kube-api-access-ht7br" (OuterVolumeSpecName: "kube-api-access-ht7br") pod "0627ef14-96bf-4927-9661-cb60a1ba7136" (UID: "0627ef14-96bf-4927-9661-cb60a1ba7136"). InnerVolumeSpecName "kube-api-access-ht7br". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:53:51.456703 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:51.456674 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0627ef14-96bf-4927-9661-cb60a1ba7136-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0627ef14-96bf-4927-9661-cb60a1ba7136" (UID: "0627ef14-96bf-4927-9661-cb60a1ba7136"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:53:51.548144 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:51.548068 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht7br\" (UniqueName: \"kubernetes.io/projected/0627ef14-96bf-4927-9661-cb60a1ba7136-kube-api-access-ht7br\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:53:51.548144 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:51.548093 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0627ef14-96bf-4927-9661-cb60a1ba7136-tls-cert\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:53:52.121871 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:52.121841 2573 generic.go:356] "Generic (PLEG): container finished" podID="0627ef14-96bf-4927-9661-cb60a1ba7136" containerID="340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b" exitCode=0 Jul 02 13:53:52.122078 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:52.121884 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79bb849dd6-hw9sm" Jul 02 13:53:52.122078 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:52.121959 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79bb849dd6-hw9sm" event={"ID":"0627ef14-96bf-4927-9661-cb60a1ba7136","Type":"ContainerDied","Data":"340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b"} Jul 02 13:53:52.122078 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:52.122001 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79bb849dd6-hw9sm" event={"ID":"0627ef14-96bf-4927-9661-cb60a1ba7136","Type":"ContainerDied","Data":"9e88caab238b0683d485ca59da9ea944ba1101e9f347b75d982a37ed147e2b3b"} Jul 02 13:53:52.122078 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:52.122017 2573 scope.go:117] "RemoveContainer" containerID="340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b" Jul 02 13:53:52.130769 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:52.130752 2573 scope.go:117] "RemoveContainer" containerID="340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b" Jul 02 13:53:52.131050 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:53:52.131033 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b\": container with ID starting with 340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b not found: ID does not exist" containerID="340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b" Jul 02 13:53:52.131093 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:52.131059 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b"} err="failed to get container status \"340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b\": rpc error: code = NotFound desc = could not find container \"340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b\": container with ID starting with 340f4c4bdee450f50797022e20b718a17aabcd6f602f4529979488b2ff2d291b not found: ID does not exist" Jul 02 13:53:52.140114 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:52.140090 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79bb849dd6-hw9sm"] Jul 02 13:53:52.145266 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:52.145246 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-79bb849dd6-hw9sm"] Jul 02 13:53:53.479461 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:53:53.479421 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0627ef14-96bf-4927-9661-cb60a1ba7136" path="/var/lib/kubelet/pods/0627ef14-96bf-4927-9661-cb60a1ba7136/volumes" Jul 02 13:54:04.101742 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:04.101700 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wnpnm"] Jul 02 13:54:09.076722 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.076687 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk"] Jul 02 13:54:09.077310 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.077272 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0627ef14-96bf-4927-9661-cb60a1ba7136" containerName="authorino" Jul 02 13:54:09.077310 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.077300 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0627ef14-96bf-4927-9661-cb60a1ba7136" containerName="authorino" Jul 02 13:54:09.077465 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.077398 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0627ef14-96bf-4927-9661-cb60a1ba7136" containerName="authorino" Jul 02 13:54:09.081130 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.081110 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.087982 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.084102 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 13:54:09.087982 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.084154 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z7nwb\"" Jul 02 13:54:09.087982 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.084578 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 02 13:54:09.087982 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.085295 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 13:54:09.090990 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.090968 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk"] Jul 02 13:54:09.199827 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.199792 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zckh\" (UniqueName: \"kubernetes.io/projected/08fc7f22-95ff-485f-9262-782c58372b6e-kube-api-access-6zckh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.200043 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.199848 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08fc7f22-95ff-485f-9262-782c58372b6e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.200043 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.199865 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08fc7f22-95ff-485f-9262-782c58372b6e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.200043 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.199944 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08fc7f22-95ff-485f-9262-782c58372b6e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.200043 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.199980 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08fc7f22-95ff-485f-9262-782c58372b6e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.200043 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.200021 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08fc7f22-95ff-485f-9262-782c58372b6e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.301198 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.301161 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08fc7f22-95ff-485f-9262-782c58372b6e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.301360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.301218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08fc7f22-95ff-485f-9262-782c58372b6e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.301360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.301270 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zckh\" (UniqueName: \"kubernetes.io/projected/08fc7f22-95ff-485f-9262-782c58372b6e-kube-api-access-6zckh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.301360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.301323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08fc7f22-95ff-485f-9262-782c58372b6e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.301360 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.301343 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08fc7f22-95ff-485f-9262-782c58372b6e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.301533 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.301364 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08fc7f22-95ff-485f-9262-782c58372b6e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.301715 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.301686 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08fc7f22-95ff-485f-9262-782c58372b6e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.301715 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.301700 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08fc7f22-95ff-485f-9262-782c58372b6e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.301862 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.301750 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08fc7f22-95ff-485f-9262-782c58372b6e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.303595 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.303577 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08fc7f22-95ff-485f-9262-782c58372b6e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.303788 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.303773 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08fc7f22-95ff-485f-9262-782c58372b6e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.309289 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.309268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zckh\" (UniqueName: \"kubernetes.io/projected/08fc7f22-95ff-485f-9262-782c58372b6e-kube-api-access-6zckh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jzlmk\" (UID: \"08fc7f22-95ff-485f-9262-782c58372b6e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.400323 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.400236 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:09.537435 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.537413 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk"] Jul 02 13:54:09.539432 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:54:09.539394 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08fc7f22_95ff_485f_9262_782c58372b6e.slice/crio-7746499556a9656ae799fe16e54a4b0b149917328c5e74e6529cf69122910c51 WatchSource:0}: Error finding container 7746499556a9656ae799fe16e54a4b0b149917328c5e74e6529cf69122910c51: Status 404 returned error can't find the container with id 7746499556a9656ae799fe16e54a4b0b149917328c5e74e6529cf69122910c51 Jul 02 13:54:09.989854 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:09.989815 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wnpnm"] Jul 02 13:54:10.225018 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:10.224964 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" event={"ID":"08fc7f22-95ff-485f-9262-782c58372b6e","Type":"ContainerStarted","Data":"7746499556a9656ae799fe16e54a4b0b149917328c5e74e6529cf69122910c51"} Jul 02 13:54:11.233115 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:11.233016 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" event={"ID":"08fc7f22-95ff-485f-9262-782c58372b6e","Type":"ContainerStarted","Data":"30036afb942bc5be0ff366b2478b53d7c139de0c7e40b9d6960e7f5c79436dbf"} Jul 02 13:54:11.254213 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:11.254164 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" podStartSLOduration=0.959313761 podStartE2EDuration="2.254150436s" totalImagesPullingTime="1.294836675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:54:11.252065122 +0000 UTC m=+762.384956687" watchObservedRunningTime="2026-07-02 13:54:11.254150436 +0000 UTC m=+762.387042000" Jul 02 13:54:19.401186 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:19.401158 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:19.401556 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:19.401211 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:19.413352 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:19.413331 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:20.303224 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:20.303191 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jzlmk" Jul 02 13:54:21.486035 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.486001 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8"] Jul 02 13:54:21.491432 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.491409 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.495255 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.495233 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 02 13:54:21.503569 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.503545 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8"] Jul 02 13:54:21.606328 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.606290 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.606551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.606351 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.606551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.606452 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.606551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.606500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.606551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.606536 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.606735 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.606559 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z589c\" (UniqueName: \"kubernetes.io/projected/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-kube-api-access-z589c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.707394 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.707358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.707394 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.707401 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.707639 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.707527 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.707639 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.707570 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z589c\" (UniqueName: \"kubernetes.io/projected/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-kube-api-access-z589c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.707639 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.707623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.707805 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.707772 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.707867 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.707824 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.707867 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.707824 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.708044 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.708024 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.709869 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.709844 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.710044 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.710027 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.718650 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.718631 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z589c\" (UniqueName: \"kubernetes.io/projected/6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106-kube-api-access-z589c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4jfv8\" (UID: \"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.802335 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.802302 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:21.943959 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:21.943915 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8"] Jul 02 13:54:21.945972 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:54:21.945917 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d33f3e4_c11a_4e5a_95e3_6ef5ddab0106.slice/crio-90d20a8f4ad9b3588a66bdc4467e9f8bb6e25559286612e30d6311ab77cc931e WatchSource:0}: Error finding container 90d20a8f4ad9b3588a66bdc4467e9f8bb6e25559286612e30d6311ab77cc931e: Status 404 returned error can't find the container with id 90d20a8f4ad9b3588a66bdc4467e9f8bb6e25559286612e30d6311ab77cc931e Jul 02 13:54:22.298125 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:22.298087 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" event={"ID":"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106","Type":"ContainerStarted","Data":"d9a937787783887cd2fae1c8968dfeac7c8adc73694d436c3848bf39683d37fa"} Jul 02 13:54:22.298288 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:22.298150 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" event={"ID":"6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106","Type":"ContainerStarted","Data":"90d20a8f4ad9b3588a66bdc4467e9f8bb6e25559286612e30d6311ab77cc931e"} Jul 02 13:54:22.319352 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:22.319298 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" podStartSLOduration=1.119116796 podStartE2EDuration="1.319282399s" totalImagesPullingTime="200.165603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:54:22.317059675 +0000 UTC m=+773.449951241" watchObservedRunningTime="2026-07-02 13:54:22.319282399 +0000 UTC m=+773.452173963" Jul 02 13:54:22.703102 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:22.703067 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wnpnm"] Jul 02 13:54:27.102886 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:27.102851 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wnpnm"] Jul 02 13:54:31.802573 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:31.802535 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:31.802983 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:31.802602 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:31.815382 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:31.815357 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:32.368405 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:32.368372 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4jfv8" Jul 02 13:54:35.908939 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:35.908891 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wnpnm"] Jul 02 13:54:50.483764 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.483690 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl"] Jul 02 13:54:50.488777 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.488748 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.491770 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.491748 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 02 13:54:50.500757 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.500733 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl"] Jul 02 13:54:50.536245 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.536211 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16676ece-e93b-4f5b-bb40-547183ee1b62-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.536407 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.536277 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqp8f\" (UniqueName: \"kubernetes.io/projected/16676ece-e93b-4f5b-bb40-547183ee1b62-kube-api-access-cqp8f\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.536407 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.536323 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16676ece-e93b-4f5b-bb40-547183ee1b62-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.536407 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.536343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16676ece-e93b-4f5b-bb40-547183ee1b62-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.536407 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.536365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16676ece-e93b-4f5b-bb40-547183ee1b62-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.536407 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.536404 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16676ece-e93b-4f5b-bb40-547183ee1b62-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.637585 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.637537 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16676ece-e93b-4f5b-bb40-547183ee1b62-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.637772 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.637637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqp8f\" (UniqueName: \"kubernetes.io/projected/16676ece-e93b-4f5b-bb40-547183ee1b62-kube-api-access-cqp8f\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.637772 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.637674 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16676ece-e93b-4f5b-bb40-547183ee1b62-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.637772 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.637700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16676ece-e93b-4f5b-bb40-547183ee1b62-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.637772 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.637726 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16676ece-e93b-4f5b-bb40-547183ee1b62-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.638012 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.637852 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16676ece-e93b-4f5b-bb40-547183ee1b62-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.638070 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.638003 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16676ece-e93b-4f5b-bb40-547183ee1b62-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.638129 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.638087 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16676ece-e93b-4f5b-bb40-547183ee1b62-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.638241 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.638212 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16676ece-e93b-4f5b-bb40-547183ee1b62-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.640071 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.640050 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16676ece-e93b-4f5b-bb40-547183ee1b62-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.640196 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.640177 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16676ece-e93b-4f5b-bb40-547183ee1b62-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.646660 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.646634 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqp8f\" (UniqueName: \"kubernetes.io/projected/16676ece-e93b-4f5b-bb40-547183ee1b62-kube-api-access-cqp8f\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl\" (UID: \"16676ece-e93b-4f5b-bb40-547183ee1b62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.798271 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.798236 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:54:50.941973 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:50.941951 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl"] Jul 02 13:54:50.944552 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:54:50.944523 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16676ece_e93b_4f5b_bb40_547183ee1b62.slice/crio-a420638f99ef40ba26978e5f118e9a1853feeda3b0054aa61aeaadc54547e18d WatchSource:0}: Error finding container a420638f99ef40ba26978e5f118e9a1853feeda3b0054aa61aeaadc54547e18d: Status 404 returned error can't find the container with id a420638f99ef40ba26978e5f118e9a1853feeda3b0054aa61aeaadc54547e18d Jul 02 13:54:51.457064 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:51.456979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" event={"ID":"16676ece-e93b-4f5b-bb40-547183ee1b62","Type":"ContainerStarted","Data":"a61efa0e5499507876e7f28b024886f532bcd242a2dd10532bb69bc33eb7280b"} Jul 02 13:54:51.457064 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:51.457016 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" event={"ID":"16676ece-e93b-4f5b-bb40-547183ee1b62","Type":"ContainerStarted","Data":"a420638f99ef40ba26978e5f118e9a1853feeda3b0054aa61aeaadc54547e18d"} Jul 02 13:54:51.480240 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:51.480191 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" podStartSLOduration=1.289229539 podStartE2EDuration="1.480175761s" totalImagesPullingTime="190.946222ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:54:51.480001485 +0000 UTC m=+802.612893053" watchObservedRunningTime="2026-07-02 13:54:51.480175761 +0000 UTC m=+802.613067326" Jul 02 13:54:53.185506 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:54:53.185476 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wnpnm"] Jul 02 13:55:00.799179 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:00.799138 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:55:00.799564 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:00.799198 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:55:00.813004 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:00.812974 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:55:01.521210 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:01.521180 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl" Jul 02 13:55:25.866742 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:25.866709 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76f99b9db5-x6s4t"] Jul 02 13:55:25.870243 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:25.870219 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76f99b9db5-x6s4t" Jul 02 13:55:25.882760 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:25.882734 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76f99b9db5-x6s4t"] Jul 02 13:55:25.930840 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:25.930804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80012330-e5dc-464d-8ce8-ee11c18a2f99-tls-cert\") pod \"authorino-76f99b9db5-x6s4t\" (UID: \"80012330-e5dc-464d-8ce8-ee11c18a2f99\") " pod="kuadrant-system/authorino-76f99b9db5-x6s4t" Jul 02 13:55:25.931031 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:25.930855 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/80012330-e5dc-464d-8ce8-ee11c18a2f99-oidc-ca\") pod \"authorino-76f99b9db5-x6s4t\" (UID: \"80012330-e5dc-464d-8ce8-ee11c18a2f99\") " pod="kuadrant-system/authorino-76f99b9db5-x6s4t" Jul 02 13:55:25.931031 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:25.930891 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx96x\" (UniqueName: \"kubernetes.io/projected/80012330-e5dc-464d-8ce8-ee11c18a2f99-kube-api-access-zx96x\") pod \"authorino-76f99b9db5-x6s4t\" (UID: \"80012330-e5dc-464d-8ce8-ee11c18a2f99\") " pod="kuadrant-system/authorino-76f99b9db5-x6s4t" Jul 02 13:55:26.032291 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:26.032258 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/80012330-e5dc-464d-8ce8-ee11c18a2f99-oidc-ca\") pod \"authorino-76f99b9db5-x6s4t\" (UID: \"80012330-e5dc-464d-8ce8-ee11c18a2f99\") " pod="kuadrant-system/authorino-76f99b9db5-x6s4t" Jul 02 13:55:26.032480 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:26.032328 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx96x\" (UniqueName: \"kubernetes.io/projected/80012330-e5dc-464d-8ce8-ee11c18a2f99-kube-api-access-zx96x\") pod \"authorino-76f99b9db5-x6s4t\" (UID: \"80012330-e5dc-464d-8ce8-ee11c18a2f99\") " pod="kuadrant-system/authorino-76f99b9db5-x6s4t" Jul 02 13:55:26.032480 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:26.032389 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80012330-e5dc-464d-8ce8-ee11c18a2f99-tls-cert\") pod \"authorino-76f99b9db5-x6s4t\" (UID: \"80012330-e5dc-464d-8ce8-ee11c18a2f99\") " pod="kuadrant-system/authorino-76f99b9db5-x6s4t" Jul 02 13:55:26.033088 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:26.033061 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/80012330-e5dc-464d-8ce8-ee11c18a2f99-oidc-ca\") pod \"authorino-76f99b9db5-x6s4t\" (UID: \"80012330-e5dc-464d-8ce8-ee11c18a2f99\") " pod="kuadrant-system/authorino-76f99b9db5-x6s4t" Jul 02 13:55:26.034714 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:26.034691 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80012330-e5dc-464d-8ce8-ee11c18a2f99-tls-cert\") pod \"authorino-76f99b9db5-x6s4t\" (UID: \"80012330-e5dc-464d-8ce8-ee11c18a2f99\") " pod="kuadrant-system/authorino-76f99b9db5-x6s4t" Jul 02 13:55:26.039847 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:26.039825 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx96x\" (UniqueName: \"kubernetes.io/projected/80012330-e5dc-464d-8ce8-ee11c18a2f99-kube-api-access-zx96x\") pod \"authorino-76f99b9db5-x6s4t\" (UID: \"80012330-e5dc-464d-8ce8-ee11c18a2f99\") " pod="kuadrant-system/authorino-76f99b9db5-x6s4t" Jul 02 13:55:26.186666 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:26.186587 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76f99b9db5-x6s4t" Jul 02 13:55:26.323792 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:26.323765 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76f99b9db5-x6s4t"] Jul 02 13:55:26.325450 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:55:26.325426 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80012330_e5dc_464d_8ce8_ee11c18a2f99.slice/crio-def5fa888274f4525774b6ce9f55e53449192bbd6d5effde8b7797a79b62cb57 WatchSource:0}: Error finding container def5fa888274f4525774b6ce9f55e53449192bbd6d5effde8b7797a79b62cb57: Status 404 returned error can't find the container with id def5fa888274f4525774b6ce9f55e53449192bbd6d5effde8b7797a79b62cb57 Jul 02 13:55:26.639997 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:26.639955 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76f99b9db5-x6s4t" event={"ID":"80012330-e5dc-464d-8ce8-ee11c18a2f99","Type":"ContainerStarted","Data":"def5fa888274f4525774b6ce9f55e53449192bbd6d5effde8b7797a79b62cb57"} Jul 02 13:55:27.648947 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:27.648883 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76f99b9db5-x6s4t" event={"ID":"80012330-e5dc-464d-8ce8-ee11c18a2f99","Type":"ContainerStarted","Data":"123f6bcd7361d3d62ef816df55206e4d75cb002368e8383f431faf6eb7c2e070"} Jul 02 13:55:27.683645 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:27.683585 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76f99b9db5-x6s4t" podStartSLOduration=2.300712986 podStartE2EDuration="2.683564088s" totalImagesPullingTime="382.851102ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:55:27.680192546 +0000 UTC m=+838.813084113" watchObservedRunningTime="2026-07-02 13:55:27.683564088 +0000 UTC m=+838.816455654" Jul 02 13:55:27.748067 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:27.748028 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76668689c6-lfdbt"] Jul 02 13:55:27.748304 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:27.748278 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-76668689c6-lfdbt" podUID="6b58d2a2-baa2-42c2-84a2-bfbda42ccb27" containerName="authorino" containerID="cri-o://b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9" gracePeriod=30 Jul 02 13:55:28.022282 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.022254 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:55:28.155251 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.155215 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-oidc-ca\") pod \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\" (UID: \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\") " Jul 02 13:55:28.155433 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.155346 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-tls-cert\") pod \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\" (UID: \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\") " Jul 02 13:55:28.155433 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.155404 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlxsd\" (UniqueName: \"kubernetes.io/projected/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-kube-api-access-nlxsd\") pod \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\" (UID: \"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27\") " Jul 02 13:55:28.157652 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.157616 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-kube-api-access-nlxsd" (OuterVolumeSpecName: "kube-api-access-nlxsd") pod "6b58d2a2-baa2-42c2-84a2-bfbda42ccb27" (UID: "6b58d2a2-baa2-42c2-84a2-bfbda42ccb27"). InnerVolumeSpecName "kube-api-access-nlxsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:55:28.161655 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.161624 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "6b58d2a2-baa2-42c2-84a2-bfbda42ccb27" (UID: "6b58d2a2-baa2-42c2-84a2-bfbda42ccb27"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:55:28.166418 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.166385 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6b58d2a2-baa2-42c2-84a2-bfbda42ccb27" (UID: "6b58d2a2-baa2-42c2-84a2-bfbda42ccb27"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:55:28.256122 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.256090 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-tls-cert\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:55:28.256122 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.256118 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlxsd\" (UniqueName: \"kubernetes.io/projected/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-kube-api-access-nlxsd\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:55:28.256122 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.256129 2573 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27-oidc-ca\") on node \"ip-10-0-131-54.ec2.internal\" DevicePath \"\"" Jul 02 13:55:28.655620 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.655579 2573 generic.go:356] "Generic (PLEG): container finished" podID="6b58d2a2-baa2-42c2-84a2-bfbda42ccb27" containerID="b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9" exitCode=0 Jul 02 13:55:28.655620 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.655622 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76668689c6-lfdbt" Jul 02 13:55:28.656186 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.655637 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76668689c6-lfdbt" event={"ID":"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27","Type":"ContainerDied","Data":"b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9"} Jul 02 13:55:28.656186 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.655701 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76668689c6-lfdbt" event={"ID":"6b58d2a2-baa2-42c2-84a2-bfbda42ccb27","Type":"ContainerDied","Data":"8b1ca0c037d6c8be8adcba12f49b4d0955ca6616fb2a4a873a61ced34974ffea"} Jul 02 13:55:28.656186 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.655730 2573 scope.go:117] "RemoveContainer" containerID="b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9" Jul 02 13:55:28.665645 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.665628 2573 scope.go:117] "RemoveContainer" containerID="b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9" Jul 02 13:55:28.665952 ip-10-0-131-54 kubenswrapper[2573]: E0702 13:55:28.665933 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9\": container with ID starting with b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9 not found: ID does not exist" containerID="b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9" Jul 02 13:55:28.666023 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.665962 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9"} err="failed to get container status \"b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9\": rpc error: code = NotFound desc = could not find container \"b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9\": container with ID starting with b7babe9f98eabec1c8751c58067236d42a1d5e0be97ade81feea894b06e7baa9 not found: ID does not exist" Jul 02 13:55:28.682605 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.682582 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76668689c6-lfdbt"] Jul 02 13:55:28.686984 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:28.686960 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76668689c6-lfdbt"] Jul 02 13:55:29.479772 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:55:29.479743 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b58d2a2-baa2-42c2-84a2-bfbda42ccb27" path="/var/lib/kubelet/pods/6b58d2a2-baa2-42c2-84a2-bfbda42ccb27/volumes" Jul 02 13:56:06.018363 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:06.018333 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76f99b9db5-x6s4t_80012330-e5dc-464d-8ce8-ee11c18a2f99/authorino/0.log" Jul 02 13:56:10.614710 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:10.614682 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5nbtd_25c05d4c-5ff3-4b9b-90ab-a669d841def2/manager/0.log" Jul 02 13:56:10.736691 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:10.736657 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2vxxc_b46c28c6-4740-4d76-816b-80790338d545/manager/0.log" Jul 02 13:56:11.127269 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:11.127243 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-v6zwm_e8bfea93-cf42-482d-a87a-99779369c3d9/server/0.log" Jul 02 13:56:11.254668 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:11.254635 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gvmbx_dba6fac0-5766-4c7a-969a-fd0af3e14c8d/manager/0.log" Jul 02 13:56:11.614829 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:11.614805 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5964c6974c-vlwt9_aad4c441-aba5-42e2-8aa6-b1fd2e2a8507/copy-manifests/0.log" Jul 02 13:56:11.627263 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:11.627239 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5964c6974c-vlwt9_aad4c441-aba5-42e2-8aa6-b1fd2e2a8507/manager/0.log" Jul 02 13:56:12.545148 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:12.545124 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv_5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2/pull/0.log" Jul 02 13:56:12.551653 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:12.551634 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv_5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2/extract/0.log" Jul 02 13:56:12.558183 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:12.558162 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv_5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2/util/0.log" Jul 02 13:56:12.682358 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:12.682329 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh_cf1910f6-ce78-4e7d-9419-e38ff32332a8/util/0.log" Jul 02 13:56:12.688078 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:12.688058 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh_cf1910f6-ce78-4e7d-9419-e38ff32332a8/pull/0.log" Jul 02 13:56:12.693658 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:12.693615 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh_cf1910f6-ce78-4e7d-9419-e38ff32332a8/extract/0.log" Jul 02 13:56:12.821396 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:12.821326 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k_0af8dae5-3203-4ecd-a3ae-fef022db0d8d/util/0.log" Jul 02 13:56:12.827989 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:12.827971 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k_0af8dae5-3203-4ecd-a3ae-fef022db0d8d/pull/0.log" Jul 02 13:56:12.835704 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:12.835687 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k_0af8dae5-3203-4ecd-a3ae-fef022db0d8d/extract/0.log" Jul 02 13:56:12.946024 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:12.945998 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj_782b6ca4-cfba-417b-b4db-c97ccacdee5e/util/0.log" Jul 02 13:56:12.952144 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:12.952125 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj_782b6ca4-cfba-417b-b4db-c97ccacdee5e/pull/0.log" Jul 02 13:56:12.958052 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:12.958036 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj_782b6ca4-cfba-417b-b4db-c97ccacdee5e/extract/0.log" Jul 02 13:56:13.074829 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:13.074751 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76f99b9db5-x6s4t_80012330-e5dc-464d-8ce8-ee11c18a2f99/authorino/0.log" Jul 02 13:56:13.194987 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:13.194962 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7b2nf_54cb44ff-807d-415b-bd6b-da7678d5ac6e/manager/0.log" Jul 02 13:56:13.314990 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:13.314956 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4qbz6_3adbde24-84e8-4dd6-8f28-703e5bafebfc/manager/0.log" Jul 02 13:56:13.549347 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:13.549324 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6rtfn_c88364ae-2c49-4371-9099-3ba52b5989e2/registry-server/0.log" Jul 02 13:56:13.676726 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:13.676695 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pfjg6_f69c93af-80dd-477e-882a-7156d8bcf036/manager/0.log" Jul 02 13:56:13.811461 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:13.811384 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wnpnm_5f1011da-c3e6-456b-8744-3e2a000d6e21/limitador/0.log" Jul 02 13:56:13.943028 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:13.943000 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-m6xws_c2b68561-471a-4944-9e67-22d33dbd04a7/manager/0.log" Jul 02 13:56:14.550392 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:14.550356 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685667f9f9-4ckgg_7937e1a5-4210-4fe9-b34d-a0fd19acac8e/kube-auth-proxy/0.log" Jul 02 13:56:15.144481 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:15.144453 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-774678d5c-9htqr_0d5f4571-f3ca-407e-9cb2-0c4b0054623a/router/0.log" Jul 02 13:56:15.640587 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:15.640549 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jzlmk_08fc7f22-95ff-485f-9262-782c58372b6e/main/0.log" Jul 02 13:56:15.758721 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:15.758682 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4jfv8_6d33f3e4-c11a-4e5a-95e3-6ef5ddab0106/main/0.log" Jul 02 13:56:16.097612 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:16.097581 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-xkscl_16676ece-e93b-4f5b-bb40-547183ee1b62/main/0.log" Jul 02 13:56:20.797942 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:20.797852 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pk25w/must-gather-8gwlg"] Jul 02 13:56:20.798365 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:20.798215 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b58d2a2-baa2-42c2-84a2-bfbda42ccb27" containerName="authorino" Jul 02 13:56:20.798365 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:20.798227 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b58d2a2-baa2-42c2-84a2-bfbda42ccb27" containerName="authorino" Jul 02 13:56:20.798365 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:20.798318 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b58d2a2-baa2-42c2-84a2-bfbda42ccb27" containerName="authorino" Jul 02 13:56:20.802325 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:20.802300 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pk25w/must-gather-8gwlg" Jul 02 13:56:20.804622 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:20.804604 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pk25w\"/\"kube-root-ca.crt\"" Jul 02 13:56:20.804728 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:20.804604 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pk25w\"/\"openshift-service-ca.crt\"" Jul 02 13:56:20.811150 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:20.811127 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pk25w/must-gather-8gwlg"] Jul 02 13:56:20.902537 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:20.902507 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b08e1279-4237-414c-b5a3-6780cf794e57-must-gather-output\") pod \"must-gather-8gwlg\" (UID: \"b08e1279-4237-414c-b5a3-6780cf794e57\") " pod="openshift-must-gather-pk25w/must-gather-8gwlg" Jul 02 13:56:20.902678 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:20.902624 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dk8r\" (UniqueName: \"kubernetes.io/projected/b08e1279-4237-414c-b5a3-6780cf794e57-kube-api-access-7dk8r\") pod \"must-gather-8gwlg\" (UID: \"b08e1279-4237-414c-b5a3-6780cf794e57\") " pod="openshift-must-gather-pk25w/must-gather-8gwlg" Jul 02 13:56:21.003145 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:21.003108 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dk8r\" (UniqueName: \"kubernetes.io/projected/b08e1279-4237-414c-b5a3-6780cf794e57-kube-api-access-7dk8r\") pod \"must-gather-8gwlg\" (UID: \"b08e1279-4237-414c-b5a3-6780cf794e57\") " pod="openshift-must-gather-pk25w/must-gather-8gwlg" Jul 02 13:56:21.003309 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:21.003165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b08e1279-4237-414c-b5a3-6780cf794e57-must-gather-output\") pod \"must-gather-8gwlg\" (UID: \"b08e1279-4237-414c-b5a3-6780cf794e57\") " pod="openshift-must-gather-pk25w/must-gather-8gwlg" Jul 02 13:56:21.003501 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:21.003480 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b08e1279-4237-414c-b5a3-6780cf794e57-must-gather-output\") pod \"must-gather-8gwlg\" (UID: \"b08e1279-4237-414c-b5a3-6780cf794e57\") " pod="openshift-must-gather-pk25w/must-gather-8gwlg" Jul 02 13:56:21.010939 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:21.010899 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dk8r\" (UniqueName: \"kubernetes.io/projected/b08e1279-4237-414c-b5a3-6780cf794e57-kube-api-access-7dk8r\") pod \"must-gather-8gwlg\" (UID: \"b08e1279-4237-414c-b5a3-6780cf794e57\") " pod="openshift-must-gather-pk25w/must-gather-8gwlg" Jul 02 13:56:21.138590 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:21.138505 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pk25w/must-gather-8gwlg" Jul 02 13:56:21.269543 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:21.269513 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pk25w/must-gather-8gwlg"] Jul 02 13:56:21.270943 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:56:21.270893 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb08e1279_4237_414c_b5a3_6780cf794e57.slice/crio-81a3025461974c4463a4d3d44f9d2342814cb49f61030eac1d020e572224df40 WatchSource:0}: Error finding container 81a3025461974c4463a4d3d44f9d2342814cb49f61030eac1d020e572224df40: Status 404 returned error can't find the container with id 81a3025461974c4463a4d3d44f9d2342814cb49f61030eac1d020e572224df40 Jul 02 13:56:21.932687 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:21.932651 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pk25w/must-gather-8gwlg" event={"ID":"b08e1279-4237-414c-b5a3-6780cf794e57","Type":"ContainerStarted","Data":"81a3025461974c4463a4d3d44f9d2342814cb49f61030eac1d020e572224df40"} Jul 02 13:56:22.940848 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:22.940809 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pk25w/must-gather-8gwlg" event={"ID":"b08e1279-4237-414c-b5a3-6780cf794e57","Type":"ContainerStarted","Data":"e617d01ee15e56fd029e68e82071bc2b567df73c5eeeb5f8a0d2685012a03d66"} Jul 02 13:56:22.940848 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:22.940855 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pk25w/must-gather-8gwlg" event={"ID":"b08e1279-4237-414c-b5a3-6780cf794e57","Type":"ContainerStarted","Data":"1a3f134b7203d8f422aedbea104178309095a535fb71e540d8c8affc6438867f"} Jul 02 13:56:22.957103 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:22.957052 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pk25w/must-gather-8gwlg" podStartSLOduration=1.782722064 podStartE2EDuration="2.957038247s" totalImagesPullingTime="1.174316183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:56:22.954736597 +0000 UTC m=+894.087628157" watchObservedRunningTime="2026-07-02 13:56:22.957038247 +0000 UTC m=+894.089929812" Jul 02 13:56:24.021514 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:24.021484 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fkm9t_cd777315-3f9e-4c1d-bbeb-d9587d0e62b3/global-pull-secret-syncer/0.log" Jul 02 13:56:24.204781 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:24.204747 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lhrtf_1d092476-9613-4e39-ab3b-9f2fdf62db80/konnectivity-agent/0.log" Jul 02 13:56:24.224373 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:24.224342 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-54.ec2.internal_29c61269dc44284c55ddf8a33477c594/haproxy/0.log" Jul 02 13:56:28.389558 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.389515 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv_5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2/extract/0.log" Jul 02 13:56:28.411361 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.411272 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv_5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2/util/0.log" Jul 02 13:56:28.432561 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.432521 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759286nv_5bf2b19a-a06c-471b-b0ad-8ebc8f6624f2/pull/0.log" Jul 02 13:56:28.460516 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.460460 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh_cf1910f6-ce78-4e7d-9419-e38ff32332a8/extract/0.log" Jul 02 13:56:28.484541 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.484509 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh_cf1910f6-ce78-4e7d-9419-e38ff32332a8/util/0.log" Jul 02 13:56:28.507100 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.507075 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hjxlh_cf1910f6-ce78-4e7d-9419-e38ff32332a8/pull/0.log" Jul 02 13:56:28.536725 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.536662 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k_0af8dae5-3203-4ecd-a3ae-fef022db0d8d/extract/0.log" Jul 02 13:56:28.570592 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.570454 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k_0af8dae5-3203-4ecd-a3ae-fef022db0d8d/util/0.log" Jul 02 13:56:28.638877 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.638849 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ttd7k_0af8dae5-3203-4ecd-a3ae-fef022db0d8d/pull/0.log" Jul 02 13:56:28.703198 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.703120 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj_782b6ca4-cfba-417b-b4db-c97ccacdee5e/extract/0.log" Jul 02 13:56:28.731807 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.731779 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj_782b6ca4-cfba-417b-b4db-c97ccacdee5e/util/0.log" Jul 02 13:56:28.754989 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.754964 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qfzj_782b6ca4-cfba-417b-b4db-c97ccacdee5e/pull/0.log" Jul 02 13:56:28.807945 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.807178 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76f99b9db5-x6s4t_80012330-e5dc-464d-8ce8-ee11c18a2f99/authorino/0.log" Jul 02 13:56:28.868945 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.868365 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7b2nf_54cb44ff-807d-415b-bd6b-da7678d5ac6e/manager/0.log" Jul 02 13:56:28.904682 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.904650 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4qbz6_3adbde24-84e8-4dd6-8f28-703e5bafebfc/manager/0.log" Jul 02 13:56:28.964994 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:28.964902 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6rtfn_c88364ae-2c49-4371-9099-3ba52b5989e2/registry-server/0.log" Jul 02 13:56:29.007626 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:29.007589 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pfjg6_f69c93af-80dd-477e-882a-7156d8bcf036/manager/0.log" Jul 02 13:56:29.056862 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:29.056830 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wnpnm_5f1011da-c3e6-456b-8744-3e2a000d6e21/limitador/0.log" Jul 02 13:56:29.086938 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:29.086885 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-m6xws_c2b68561-471a-4944-9e67-22d33dbd04a7/manager/0.log" Jul 02 13:56:29.512246 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:29.512221 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-acl-logging/0.log" Jul 02 13:56:29.520424 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:29.520400 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-acl-logging/0.log" Jul 02 13:56:31.356249 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:31.356021 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7846_3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a/node-exporter/0.log" Jul 02 13:56:31.384099 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:31.384065 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7846_3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a/kube-rbac-proxy/0.log" Jul 02 13:56:31.407859 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:31.407825 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7846_3c6cce6b-9eea-4e16-bb65-fca63a6a7b6a/init-textfile/0.log" Jul 02 13:56:34.051343 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.051316 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4w7mc_6f4c6208-f2de-43e2-9665-ed4538a8f71f/console-operator/0.log" Jul 02 13:56:34.684495 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.684455 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9"] Jul 02 13:56:34.700716 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.699587 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9"] Jul 02 13:56:34.700716 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.699710 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.703048 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.702784 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pk25w\"/\"default-dockercfg-q9h4c\"" Jul 02 13:56:34.852560 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.852522 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkzwq\" (UniqueName: \"kubernetes.io/projected/6876c61c-a10a-472f-ac0c-8afc5134a321-kube-api-access-hkzwq\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.852774 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.852590 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6876c61c-a10a-472f-ac0c-8afc5134a321-proc\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.852774 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.852630 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6876c61c-a10a-472f-ac0c-8afc5134a321-podres\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.852774 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.852661 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6876c61c-a10a-472f-ac0c-8afc5134a321-sys\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.852774 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.852711 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6876c61c-a10a-472f-ac0c-8afc5134a321-lib-modules\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.953290 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.953204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkzwq\" (UniqueName: \"kubernetes.io/projected/6876c61c-a10a-472f-ac0c-8afc5134a321-kube-api-access-hkzwq\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.954053 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.954032 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6876c61c-a10a-472f-ac0c-8afc5134a321-proc\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.954439 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.954419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6876c61c-a10a-472f-ac0c-8afc5134a321-podres\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.954551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.954454 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6876c61c-a10a-472f-ac0c-8afc5134a321-sys\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.954551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.954241 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6876c61c-a10a-472f-ac0c-8afc5134a321-proc\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.954551 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.954501 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6876c61c-a10a-472f-ac0c-8afc5134a321-lib-modules\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.954709 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.954630 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6876c61c-a10a-472f-ac0c-8afc5134a321-podres\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.954709 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.954640 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6876c61c-a10a-472f-ac0c-8afc5134a321-sys\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.954709 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.954675 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6876c61c-a10a-472f-ac0c-8afc5134a321-lib-modules\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:34.970396 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:34.970366 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkzwq\" (UniqueName: \"kubernetes.io/projected/6876c61c-a10a-472f-ac0c-8afc5134a321-kube-api-access-hkzwq\") pod \"perf-node-gather-daemonset-v4xb9\" (UID: \"6876c61c-a10a-472f-ac0c-8afc5134a321\") " pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:35.016183 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:35.016148 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:35.195944 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:35.193412 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9"] Jul 02 13:56:35.202498 ip-10-0-131-54 kubenswrapper[2573]: W0702 13:56:35.200895 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6876c61c_a10a_472f_ac0c_8afc5134a321.slice/crio-0c79951451d1d8df733b9fd0da3c2f300c34a627a5df54f777791531a2ea84d9 WatchSource:0}: Error finding container 0c79951451d1d8df733b9fd0da3c2f300c34a627a5df54f777791531a2ea84d9: Status 404 returned error can't find the container with id 0c79951451d1d8df733b9fd0da3c2f300c34a627a5df54f777791531a2ea84d9 Jul 02 13:56:35.368814 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:35.368790 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-z5b5x_2c665df0-af24-4518-ae1f-2b92507881cb/volume-data-source-validator/0.log" Jul 02 13:56:36.054621 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:36.054560 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" event={"ID":"6876c61c-a10a-472f-ac0c-8afc5134a321","Type":"ContainerStarted","Data":"dad292d8416d245875d63f37f52d2246058ba8bc3be3fd1da8ed4744ec3b449d"} Jul 02 13:56:36.054849 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:36.054648 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" event={"ID":"6876c61c-a10a-472f-ac0c-8afc5134a321","Type":"ContainerStarted","Data":"0c79951451d1d8df733b9fd0da3c2f300c34a627a5df54f777791531a2ea84d9"} Jul 02 13:56:36.054943 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:36.054855 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:36.072775 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:36.072715 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" podStartSLOduration=2.072695152 podStartE2EDuration="2.072695152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:56:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:56:36.070218642 +0000 UTC m=+907.203110208" watchObservedRunningTime="2026-07-02 13:56:36.072695152 +0000 UTC m=+907.205586717" Jul 02 13:56:36.448999 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:36.448907 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l4hcx_348180ec-a210-44a4-9b94-b14890b5869d/dns/0.log" Jul 02 13:56:36.472166 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:36.472130 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l4hcx_348180ec-a210-44a4-9b94-b14890b5869d/kube-rbac-proxy/0.log" Jul 02 13:56:36.571889 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:36.571860 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7cf2b_61d94ef8-11f8-46ee-b67d-7aa90e074512/dns-node-resolver/0.log" Jul 02 13:56:37.121983 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:37.121950 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b7f449549-z6tw8_59753f68-eab8-488e-a8a2-3821df8ebcaa/registry/0.log" Jul 02 13:56:37.168471 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:37.168438 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jd9tr_18745f0d-e7b8-4f0e-bfc8-021979556351/node-ca/0.log" Jul 02 13:56:38.146897 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:38.146866 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685667f9f9-4ckgg_7937e1a5-4210-4fe9-b34d-a0fd19acac8e/kube-auth-proxy/0.log" Jul 02 13:56:38.269097 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:38.269068 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-774678d5c-9htqr_0d5f4571-f3ca-407e-9cb2-0c4b0054623a/router/0.log" Jul 02 13:56:38.860410 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:38.860377 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ct4b6_bb57b91a-b68a-45b7-a1d5-1c1aa3693765/serve-healthcheck-canary/0.log" Jul 02 13:56:39.378782 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:39.378753 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-n66cn_e017484a-637e-493c-a1fe-b100d1cb714e/insights-operator/0.log" Jul 02 13:56:39.539609 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:39.539581 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pq7rc_85ad1bc1-d5b1-423d-8d1d-562dcc86c04e/kube-rbac-proxy/0.log" Jul 02 13:56:39.559778 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:39.559754 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pq7rc_85ad1bc1-d5b1-423d-8d1d-562dcc86c04e/exporter/0.log" Jul 02 13:56:39.580707 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:39.580680 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pq7rc_85ad1bc1-d5b1-423d-8d1d-562dcc86c04e/extractor/0.log" Jul 02 13:56:41.740153 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:41.740125 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5nbtd_25c05d4c-5ff3-4b9b-90ab-a669d841def2/manager/0.log" Jul 02 13:56:41.774392 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:41.774356 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2vxxc_b46c28c6-4740-4d76-816b-80790338d545/manager/0.log" Jul 02 13:56:41.861423 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:41.861394 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-v6zwm_e8bfea93-cf42-482d-a87a-99779369c3d9/server/0.log" Jul 02 13:56:41.912411 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:41.912381 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gvmbx_dba6fac0-5766-4c7a-969a-fd0af3e14c8d/manager/0.log" Jul 02 13:56:42.056408 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:42.056363 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5964c6974c-vlwt9_aad4c441-aba5-42e2-8aa6-b1fd2e2a8507/manager/0.log" Jul 02 13:56:42.074129 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:42.074099 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5964c6974c-vlwt9_aad4c441-aba5-42e2-8aa6-b1fd2e2a8507/copy-manifests/0.log" Jul 02 13:56:42.074581 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:42.074557 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pk25w/perf-node-gather-daemonset-v4xb9" Jul 02 13:56:45.056071 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:45.056044 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685667f9f9-4ckgg_7937e1a5-4210-4fe9-b34d-a0fd19acac8e/kube-auth-proxy/0.log" Jul 02 13:56:45.128084 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:45.128040 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-774678d5c-9htqr_0d5f4571-f3ca-407e-9cb2-0c4b0054623a/router/0.log" Jul 02 13:56:46.338316 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:46.338281 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685667f9f9-4ckgg_7937e1a5-4210-4fe9-b34d-a0fd19acac8e/kube-auth-proxy/0.log" Jul 02 13:56:46.418459 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:46.418432 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-774678d5c-9htqr_0d5f4571-f3ca-407e-9cb2-0c4b0054623a/router/0.log" Jul 02 13:56:50.287142 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:50.287113 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-596nb_5299a8ec-cec6-42be-bd4c-533005533331/kube-multus/0.log" Jul 02 13:56:50.313183 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:50.313146 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ddp8_635ded76-12ca-4c08-9766-b4f11093f394/kube-multus-additional-cni-plugins/0.log" Jul 02 13:56:50.335905 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:50.335878 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ddp8_635ded76-12ca-4c08-9766-b4f11093f394/egress-router-binary-copy/0.log" Jul 02 13:56:50.358395 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:50.358368 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ddp8_635ded76-12ca-4c08-9766-b4f11093f394/cni-plugins/0.log" Jul 02 13:56:50.380779 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:50.380751 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ddp8_635ded76-12ca-4c08-9766-b4f11093f394/bond-cni-plugin/0.log" Jul 02 13:56:50.402528 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:50.402505 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ddp8_635ded76-12ca-4c08-9766-b4f11093f394/routeoverride-cni/0.log" Jul 02 13:56:50.425225 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:50.425202 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ddp8_635ded76-12ca-4c08-9766-b4f11093f394/whereabouts-cni-bincopy/0.log" Jul 02 13:56:50.447886 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:50.447861 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9ddp8_635ded76-12ca-4c08-9766-b4f11093f394/whereabouts-cni/0.log" Jul 02 13:56:50.877642 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:50.877616 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v2d9m_b559aa27-2922-474b-98e6-3a00eb31f57c/network-metrics-daemon/0.log" Jul 02 13:56:50.896073 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:50.896050 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v2d9m_b559aa27-2922-474b-98e6-3a00eb31f57c/kube-rbac-proxy/0.log" Jul 02 13:56:51.779630 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:51.779605 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-controller/0.log" Jul 02 13:56:51.797957 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:51.797913 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-acl-logging/1.log" Jul 02 13:56:51.798091 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:51.798004 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovn-acl-logging/0.log" Jul 02 13:56:51.815004 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:51.814979 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/kube-rbac-proxy-node/0.log" Jul 02 13:56:51.836312 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:51.836289 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 13:56:51.858935 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:51.858909 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/northd/0.log" Jul 02 13:56:51.882214 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:51.882192 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/nbdb/0.log" Jul 02 13:56:51.905317 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:51.905296 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/sbdb/0.log" Jul 02 13:56:51.956580 ip-10-0-131-54 kubenswrapper[2573]: I0702 13:56:51.956543 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7fgt_e68fa2ab-0d34-4558-94e4-277fb555cff1/ovnkube-controller/0.log"