Jul 15 21:07:48.255754 ip-10-0-136-107 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 21:07:48.255763 ip-10-0-136-107 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 21:07:48.255770 ip-10-0-136-107 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 21:07:48.255992 ip-10-0-136-107 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 21:07:58.380696 ip-10-0-136-107 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 21:07:58.380717 ip-10-0-136-107 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b19fe04a76a54b49a630d4dfe4e0a4e4 -- Jul 15 21:09:38.673377 ip-10-0-136-107 systemd[1]: Starting Kubernetes Kubelet... Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.085440 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093469 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093484 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093488 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093492 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093495 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093499 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093502 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:39.146874 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093505 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093508 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093511 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093515 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093524 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093527 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093530 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093532 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093535 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093538 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093541 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093543 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093546 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093549 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093552 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093556 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093560 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093563 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093566 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093569 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:39.390197 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093572 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:39.161840 ip-10-0-136-107 systemd[1]: Started Kubernetes Kubelet. Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093575 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093578 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093581 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093583 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093586 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093588 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093591 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093595 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093599 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093602 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093605 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093608 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093612 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093615 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093618 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093621 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093624 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093626 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093630 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:39.394285 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093633 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093635 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093639 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093642 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093645 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093649 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093652 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093654 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093657 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093660 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093663 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093666 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093669 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093671 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093674 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093677 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093679 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093682 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093684 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:39.396598 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093687 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093690 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093692 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093695 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093697 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093700 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093703 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093706 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093709 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093712 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093715 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093717 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093720 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093722 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093725 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093728 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093730 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093732 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093736 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093739 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:39.397630 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093742 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093744 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093747 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093750 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093752 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093755 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093758 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093761 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093764 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093766 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093768 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093771 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.093773 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094582 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094590 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094593 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094597 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094600 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094604 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094607 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:39.399615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094612 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094616 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094619 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094622 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094625 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094628 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094631 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094633 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094636 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094640 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094643 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094645 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094648 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094651 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094654 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094656 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094659 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094662 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094664 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:39.401512 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094667 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094669 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094672 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094675 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094678 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094681 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094683 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094686 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094689 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094691 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094694 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094697 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094700 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094703 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094708 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094710 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094713 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094716 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094719 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094722 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:39.402434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094725 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094728 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094731 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094734 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094737 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094739 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094742 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094745 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094747 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094751 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094755 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094758 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094760 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094763 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094766 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094768 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094772 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094775 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094778 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094781 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:39.403407 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094784 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094787 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094789 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094792 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094794 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094797 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094800 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094804 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094807 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094809 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094812 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094814 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094817 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094820 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094822 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094825 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094827 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094830 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094833 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094836 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:39.404513 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094838 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094841 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094843 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094846 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094849 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094851 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094857 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094860 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094863 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094865 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094868 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094871 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.094875 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095282 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095288 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095291 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095293 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095297 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095300 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095303 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:39.405578 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095305 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095308 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095311 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095314 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095317 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095319 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095322 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095324 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095328 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095330 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095333 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095336 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095338 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095341 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095344 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095348 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095352 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095355 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095360 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:39.406455 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095363 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095366 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095369 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095372 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095375 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095378 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095381 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095385 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095389 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095392 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095395 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095398 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095401 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095404 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095406 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095409 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095412 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095415 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095418 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:39.407521 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095420 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095423 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095425 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095428 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095430 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095433 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095435 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095438 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095440 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095443 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095445 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095448 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095453 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095456 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095458 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095461 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095464 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095466 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095469 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095472 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:39.408402 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095475 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095477 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095480 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095482 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095485 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095489 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095491 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095494 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095496 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095499 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095501 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095504 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095507 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095510 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095512 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095514 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095517 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095519 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095522 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:39.409485 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095526 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095529 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095532 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095535 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095538 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095542 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095545 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095548 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095553 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095555 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095558 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095561 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095564 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095566 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.095568 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095665 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095673 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095688 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095700 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095705 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095708 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095712 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 21:09:39.410287 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095717 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095720 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095723 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095727 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095730 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095733 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095736 2578 flags.go:64] FLAG: --cgroup-root="" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095739 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095743 2578 flags.go:64] FLAG: --client-ca-file="" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095745 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095748 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095753 2578 flags.go:64] FLAG: --cluster-domain="" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095755 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095759 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095763 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095768 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095772 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095775 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095779 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095782 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095785 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095788 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095792 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095795 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 21:09:39.411353 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095798 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095802 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095805 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095808 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095811 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095815 2578 flags.go:64] FLAG: --enable-server="true" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095818 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095823 2578 flags.go:64] FLAG: --event-burst="100" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095826 2578 flags.go:64] FLAG: --event-qps="50" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095829 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095832 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095835 2578 flags.go:64] FLAG: --eviction-hard="" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095839 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095843 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095846 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095848 2578 flags.go:64] FLAG: --eviction-soft="" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095852 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095855 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095858 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095861 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095864 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095867 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095870 2578 flags.go:64] FLAG: --feature-gates="" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095875 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095879 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 21:09:39.412422 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095882 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095886 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095889 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095892 2578 flags.go:64] FLAG: --help="false" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095895 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095898 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095902 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095905 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095908 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095912 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095915 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095917 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095920 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095924 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095927 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095930 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095934 2578 flags.go:64] FLAG: --kube-reserved="" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095937 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095940 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095943 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095945 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095948 2578 flags.go:64] FLAG: --lock-file="" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095951 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095954 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 21:09:39.413528 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095957 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095962 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095965 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095968 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095971 2578 flags.go:64] FLAG: --logging-format="text" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095974 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095978 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095981 2578 flags.go:64] FLAG: --manifest-url="" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095984 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095989 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095992 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.095997 2578 flags.go:64] FLAG: --max-pods="110" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096000 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096003 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096007 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096010 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096013 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096016 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096019 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096041 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096045 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096048 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096051 2578 flags.go:64] FLAG: --pod-cidr="" Jul 15 21:09:39.414641 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096055 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096061 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096065 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096068 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096071 2578 flags.go:64] FLAG: --port="10250" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096074 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096077 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03058742d078ab933" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096081 2578 flags.go:64] FLAG: --qos-reserved="" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096084 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096087 2578 flags.go:64] FLAG: --register-node="true" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096090 2578 flags.go:64] FLAG: --register-with-taints="" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096093 2578 flags.go:64] FLAG: --registry-burst="10" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096096 2578 flags.go:64] FLAG: --registry-qps="5" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096099 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096102 2578 flags.go:64] FLAG: --reserved-memory="" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096107 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096110 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096114 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096116 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096122 2578 flags.go:64] FLAG: --runonce="false" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096125 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096129 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096132 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096135 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096138 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096141 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 21:09:39.415716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096144 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096147 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096150 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096153 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096156 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096159 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096162 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096166 2578 flags.go:64] FLAG: --system-cgroups="" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096169 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096175 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096177 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096180 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096185 2578 flags.go:64] FLAG: --tls-min-version="" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096187 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096190 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096193 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096196 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096199 2578 flags.go:64] FLAG: --v="2" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096203 2578 flags.go:64] FLAG: --version="false" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096206 2578 flags.go:64] FLAG: --vmodule="" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096210 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.096215 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096339 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096343 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:39.419332 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096346 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096351 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096354 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096357 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096360 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096362 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096365 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096368 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096370 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096373 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096376 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096378 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096381 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096384 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096387 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096390 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096393 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096396 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096398 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096401 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:39.420413 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096404 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096406 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096409 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096411 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096414 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096416 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096419 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096421 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096424 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096428 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096430 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096433 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096435 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096440 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096442 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096445 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096448 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096450 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096453 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096455 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:39.427417 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096458 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096460 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096463 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096466 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096468 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096471 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096473 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096476 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096479 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096481 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096484 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096488 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096492 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096494 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096497 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096500 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096503 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096506 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096509 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:39.428328 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096511 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096515 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096520 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096523 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096526 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096529 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096533 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096537 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096539 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096542 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096545 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096548 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096550 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096553 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096556 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096558 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096561 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096565 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096568 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:39.429208 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096570 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096573 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096576 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096579 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096582 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096585 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096588 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096590 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096593 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096595 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096598 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096600 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096603 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096605 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096608 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096611 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096614 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096616 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:39.430320 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.096619 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.097185 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.104505 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.104523 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.105383 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.105391 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105453 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105460 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105463 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105467 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105470 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105472 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105476 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105481 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:39.431434 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105484 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105487 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105490 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105493 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105496 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105498 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105501 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105504 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105507 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105509 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105512 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105514 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105518 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105521 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105523 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105529 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105532 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105535 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105538 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105540 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:39.432098 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105543 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105546 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105549 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105552 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105555 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105557 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105560 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105562 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105566 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105569 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105571 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105574 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105576 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105579 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105582 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105584 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105587 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105589 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105592 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105596 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:39.432990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105599 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105602 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105605 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105608 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105611 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105613 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105616 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105620 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105624 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105626 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105631 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105634 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105637 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105640 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105643 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105646 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105649 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105652 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105655 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105657 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:39.433857 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105660 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105663 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105665 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105668 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105670 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105673 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105675 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105678 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105680 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105683 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105685 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105688 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105691 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105693 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105696 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105699 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105701 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105704 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105706 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:39.434747 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105710 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105714 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105717 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105722 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105725 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105728 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105731 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105734 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105737 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105740 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105743 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105746 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.105751 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105876 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:09:39.435615 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105882 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105885 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105889 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105893 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105896 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105899 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105902 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105905 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105908 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105910 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105913 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105915 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105920 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105923 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105926 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105928 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105931 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105934 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105938 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:09:39.436269 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105941 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105943 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105946 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105950 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105952 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105955 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105958 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105960 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105963 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105966 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105968 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105971 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105973 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105976 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105978 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105981 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105983 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105986 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105989 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105991 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105994 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:09:39.437151 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105996 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.105999 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106001 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106004 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106006 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106009 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106011 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106013 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106016 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106018 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106022 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106025 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106041 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106044 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106048 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106050 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106053 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106056 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106058 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:09:39.438025 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106061 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106064 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106067 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106070 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106072 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106075 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106078 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106080 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106083 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106085 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106088 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106090 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106093 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106096 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106098 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106101 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106104 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106106 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106109 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106111 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:09:39.438890 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106113 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106116 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106119 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106123 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106125 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106128 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106130 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106135 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106137 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106140 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106143 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106145 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106148 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106151 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106154 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106156 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106159 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106161 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:09:39.439769 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:39.106165 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:09:39.626194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.106170 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:09:39.626194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.106319 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 21:09:39.626194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.109381 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 21:09:39.626194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.110896 2578 server.go:1019] "Starting client certificate rotation" Jul 15 21:09:39.626194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.110996 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 21:09:39.626194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.111044 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 21:09:39.626194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.113601 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 21:09:39.626194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.119167 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 21:09:39.626194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.129062 2578 log.go:25] "Validated CRI v1 runtime API" Jul 15 21:09:39.626194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.131291 2578 log.go:25] "Validated CRI v1 image API" Jul 15 21:09:39.626194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.132054 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 21:09:39.626194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.134923 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bec8d162-f4e8-4364-822a-eeddc9515ea4:/dev/nvme0n1p4 e1e8a502-eaaf-46f9-a11a-6707d6e9dcb2:/dev/nvme0n1p3] Jul 15 21:09:39.626917 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.134939 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 21:09:39.627339 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.141007 2578 manager.go:216] Machine: {Timestamp:2026-07-15 21:09:39.13939739 +0000 UTC m=+0.327877905 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100626 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cc386ce6b11e2cbbdf69b40bdacbf SystemUUID:ec2cc386-ce6b-11e2-cbbd-f69b40bdacbf BootID:b19fe04a-76a5-4b49-a630-d4dfe4e0a4e4 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:70:08:30:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:70:08:30:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:0a:9d:9b:42:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 21:09:39.627339 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.141161 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 21:09:39.627339 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.141276 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 21:09:39.627339 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.144712 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 21:09:39.627339 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.144745 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 21:09:39.627339 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.145695 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 21:09:39.627339 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.145714 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 21:09:39.627339 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.145723 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.146512 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.147660 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.149936 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.151329 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.151445 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.151471 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.151481 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.151496 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.151505 2578 kubelet.go:398] "Adding apiserver pod source" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.151514 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.151958 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.151974 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.154492 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.156260 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.156287 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157215 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157229 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157236 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157241 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157250 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157256 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157265 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157270 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157277 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157282 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157295 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157301 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157880 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.157890 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.160960 2578 server.go:1268] "Started kubelet" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.161244 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.161248 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.161523 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.165897 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.167290 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.170146 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.170142 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.170243 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 21:09:39.627771 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.170300 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.172743 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.172747 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.172878 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.173417 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.173448 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.173463 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.173622 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.173632 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.173937 2578 factory.go:153] Registering CRI-O factory Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.173952 2578 factory.go:223] Registration of the crio container factory successfully Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.174016 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.174023 2578 factory.go:55] Registering systemd factory Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.174045 2578 factory.go:223] Registration of the systemd container factory successfully Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.174064 2578 factory.go:103] Registering Raw factory Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.174077 2578 manager.go:1196] Started watching for new ooms in manager Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.174442 2578 manager.go:349] Starting recovery of all containers Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.187749 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.187913 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.187621 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-107.ec2.internal.18c292c574fa8e8b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-107.ec2.internal,UID:ip-10-0-136-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-107.ec2.internal,},FirstTimestamp:2026-07-15 21:09:39.160927883 +0000 UTC m=+0.349408388,LastTimestamp:2026-07-15 21:09:39.160927883 +0000 UTC m=+0.349408388,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-107.ec2.internal,}" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.190836 2578 manager.go:354] Recovery completed Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.196716 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.198482 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.198527 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.198546 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.199102 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.199113 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.199114 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.199128 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.199770 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.199788 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.199798 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.200303 2578 policy_none.go:49] "None policy: Start" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.200316 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 21:09:39.629517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.200326 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 21:09:39.634355 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.201089 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-107.ec2.internal.18c292c577380068 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-107.ec2.internal,UID:ip-10-0-136-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-107.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-107.ec2.internal,},FirstTimestamp:2026-07-15 21:09:39.19850916 +0000 UTC m=+0.386989680,LastTimestamp:2026-07-15 21:09:39.19850916 +0000 UTC m=+0.386989680,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-107.ec2.internal,}" Jul 15 21:09:39.634355 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.201392 2578 policy_none.go:47] "Start" Jul 15 21:09:39.634355 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.211241 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-107.ec2.internal.18c292c577386e4b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-107.ec2.internal,UID:ip-10-0-136-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-107.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-107.ec2.internal,},FirstTimestamp:2026-07-15 21:09:39.198537291 +0000 UTC m=+0.387017804,LastTimestamp:2026-07-15 21:09:39.198537291 +0000 UTC m=+0.387017804,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-107.ec2.internal,}" Jul 15 21:09:39.634355 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.221468 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-107.ec2.internal.18c292c57738a9dd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-107.ec2.internal,UID:ip-10-0-136-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-107.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-107.ec2.internal,},FirstTimestamp:2026-07-15 21:09:39.198552541 +0000 UTC m=+0.387033054,LastTimestamp:2026-07-15 21:09:39.198552541 +0000 UTC m=+0.387033054,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-107.ec2.internal,}" Jul 15 21:09:39.634355 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.225806 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w8fgk" Jul 15 21:09:39.634355 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.232680 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-107.ec2.internal.18c292c577380068\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-107.ec2.internal.18c292c577380068 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-107.ec2.internal,UID:ip-10-0-136-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-107.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-107.ec2.internal,},FirstTimestamp:2026-07-15 21:09:39.19850916 +0000 UTC m=+0.386989680,LastTimestamp:2026-07-15 21:09:39.199779839 +0000 UTC m=+0.388260352,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-107.ec2.internal,}" Jul 15 21:09:39.634355 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.234686 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w8fgk" Jul 15 21:09:39.634355 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.255705 2578 manager.go:337] "Starting Device Plugin manager" Jul 15 21:09:39.634355 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.255735 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 21:09:39.634355 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.255746 2578 server.go:87] "Starting device plugin registration server" Jul 15 21:09:39.634355 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.256045 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 21:09:39.634355 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.256059 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.256153 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.256242 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.256250 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.257003 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.257065 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-107.ec2.internal\" not found" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.329418 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.330923 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.330963 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.330989 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.331025 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.334064 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.356754 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.357709 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.357737 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.357750 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.357782 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.367070 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.367088 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-107.ec2.internal\": node \"ip-10-0-136-107.ec2.internal\" not found" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.398492 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.431713 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal"] Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.431785 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.433685 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.433717 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.433729 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.435119 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.435227 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.435258 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.435884 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.435913 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.435923 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.435886 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.435977 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.435989 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.437115 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.635015 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.437136 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:09:39.640576 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.437802 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:09:39.640576 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.437826 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:09:39.640576 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.437836 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:09:39.640576 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.476042 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-107.ec2.internal\" not found" node="ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.640576 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.480644 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-107.ec2.internal\" not found" node="ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.640576 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.498751 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Jul 15 21:09:39.640576 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.574865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09dfa2203c1443c4cf09671187656131-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal\" (UID: \"09dfa2203c1443c4cf09671187656131\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.640576 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.574895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09dfa2203c1443c4cf09671187656131-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal\" (UID: \"09dfa2203c1443c4cf09671187656131\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.640576 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.574912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ee02da604e394d7a77bd64a803f84f9-config\") pod \"kube-apiserver-proxy-ip-10-0-136-107.ec2.internal\" (UID: \"0ee02da604e394d7a77bd64a803f84f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.640576 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.598947 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Jul 15 21:09:39.811635 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.675586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09dfa2203c1443c4cf09671187656131-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal\" (UID: \"09dfa2203c1443c4cf09671187656131\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.811635 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.675614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ee02da604e394d7a77bd64a803f84f9-config\") pod \"kube-apiserver-proxy-ip-10-0-136-107.ec2.internal\" (UID: \"0ee02da604e394d7a77bd64a803f84f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.811635 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.675631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09dfa2203c1443c4cf09671187656131-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal\" (UID: \"09dfa2203c1443c4cf09671187656131\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.811635 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.675668 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09dfa2203c1443c4cf09671187656131-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal\" (UID: \"09dfa2203c1443c4cf09671187656131\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.811635 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.675688 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ee02da604e394d7a77bd64a803f84f9-config\") pod \"kube-apiserver-proxy-ip-10-0-136-107.ec2.internal\" (UID: \"0ee02da604e394d7a77bd64a803f84f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.811635 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.675711 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09dfa2203c1443c4cf09671187656131-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal\" (UID: \"09dfa2203c1443c4cf09671187656131\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.811635 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.699714 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Jul 15 21:09:39.811635 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.779184 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.811635 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:39.784842 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" Jul 15 21:09:39.811635 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.800233 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Jul 15 21:09:39.979875 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:39.900723 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.001586 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.102648 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-107.ec2.internal\" not found" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.110352 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.110490 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.121156 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.153398 2578 apiserver.go:52] "Watching apiserver" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.165005 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.166639 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-wfbd7","openshift-multus/multus-j9f5x","openshift-multus/network-metrics-daemon-fxtxv","openshift-network-diagnostics/network-check-target-kwwkk","kube-system/konnectivity-agent-blczl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks","openshift-dns/node-resolver-s5mqn","openshift-multus/multus-additional-cni-plugins-kcn9l","openshift-network-operator/iptables-alerter-v8xmd","openshift-ovn-kubernetes/ovnkube-node-ggffq","kube-system/global-pull-secret-syncer-6k6wd","openshift-cluster-node-tuning-operator/tuned-84fh8"] Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.168458 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wfbd7" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.170816 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.171671 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.171884 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kvkfc\"" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.172059 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.172240 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.175127 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.175323 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.175591 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kdr5c\"" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.175758 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.175912 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.176250 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.176309 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.176504 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.176551 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.176609 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-blczl" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.177223 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.185652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.177945 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s5mqn" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.179346 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.179517 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.179891 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.180054 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.180228 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2ch28\"" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.180574 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.180746 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.180937 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-thzb2\"" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.181083 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cfs9q\"" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.181299 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.181573 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.182206 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v8xmd" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.183167 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.183470 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.183520 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.183624 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.183945 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce9a409f-624e-4213-bc69-c760ed247c6c-tmp-dir\") pod \"node-resolver-s5mqn\" (UID: \"ce9a409f-624e-4213-bc69-c760ed247c6c\") " pod="openshift-dns/node-resolver-s5mqn" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-etc-kubernetes\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kv6r\" (UniqueName: \"kubernetes.io/projected/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-kube-api-access-9kv6r\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184140 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fb855b08-480a-4ab2-a350-13c13522a436-serviceca\") pod \"node-ca-wfbd7\" (UID: \"fb855b08-480a-4ab2-a350-13c13522a436\") " pod="openshift-image-registry/node-ca-wfbd7" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-var-lib-cni-multus\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184174 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8kck9\"" Jul 15 21:09:40.187468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184326 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-hostroot\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-multus-conf-dir\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-system-cni-dir\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-etc-selinux\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-sys-fs\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184518 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184527 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce9a409f-624e-4213-bc69-c760ed247c6c-hosts-file\") pod \"node-resolver-s5mqn\" (UID: \"ce9a409f-624e-4213-bc69-c760ed247c6c\") " pod="openshift-dns/node-resolver-s5mqn" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-os-release\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184608 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-var-lib-kubelet\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-run-multus-certs\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.188356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-registration-dir\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddxp9\" (UniqueName: \"kubernetes.io/projected/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-kube-api-access-ddxp9\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184722 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d8349b9-3157-4527-8d1d-68b724cde1e0-iptables-alerter-script\") pod \"iptables-alerter-v8xmd\" (UID: \"4d8349b9-3157-4527-8d1d-68b724cde1e0\") " pod="openshift-network-operator/iptables-alerter-v8xmd" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kmnm\" (UniqueName: \"kubernetes.io/projected/4d8349b9-3157-4527-8d1d-68b724cde1e0-kube-api-access-8kmnm\") pod \"iptables-alerter-v8xmd\" (UID: \"4d8349b9-3157-4527-8d1d-68b724cde1e0\") " pod="openshift-network-operator/iptables-alerter-v8xmd" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d27faf9-6e82-4607-a427-5b391a57e548-konnectivity-ca\") pod \"konnectivity-agent-blczl\" (UID: \"4d27faf9-6e82-4607-a427-5b391a57e548\") " pod="kube-system/konnectivity-agent-blczl" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-cni-binary-copy\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-socket-dir\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-system-cni-dir\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184900 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d8349b9-3157-4527-8d1d-68b724cde1e0-host-slash\") pod \"iptables-alerter-v8xmd\" (UID: \"4d8349b9-3157-4527-8d1d-68b724cde1e0\") " pod="openshift-network-operator/iptables-alerter-v8xmd" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-cnibin\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-run-netns\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184956 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-var-lib-cni-bin\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.189014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.184999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb855b08-480a-4ab2-a350-13c13522a436-host\") pod \"node-ca-wfbd7\" (UID: \"fb855b08-480a-4ab2-a350-13c13522a436\") " pod="openshift-image-registry/node-ca-wfbd7" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-run-k8s-cni-cncf-io\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-os-release\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz7zw\" (UniqueName: \"kubernetes.io/projected/fb855b08-480a-4ab2-a350-13c13522a436-kube-api-access-qz7zw\") pod \"node-ca-wfbd7\" (UID: \"fb855b08-480a-4ab2-a350-13c13522a436\") " pod="openshift-image-registry/node-ca-wfbd7" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-multus-socket-dir-parent\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt5qk\" (UniqueName: \"kubernetes.io/projected/460bc0b3-2150-4a1d-9d9d-36d8c2143267-kube-api-access-jt5qk\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzrv2\" (UniqueName: \"kubernetes.io/projected/ce9a409f-624e-4213-bc69-c760ed247c6c-kube-api-access-wzrv2\") pod \"node-resolver-s5mqn\" (UID: \"ce9a409f-624e-4213-bc69-c760ed247c6c\") " pod="openshift-dns/node-resolver-s5mqn" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-cnibin\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-multus-cni-dir\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-multus-daemon-config\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckkkd\" (UniqueName: \"kubernetes.io/projected/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-kube-api-access-ckkkd\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:40.189639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hd6p\" (UniqueName: \"kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p\") pod \"network-check-target-kwwkk\" (UID: \"3fa8856a-c739-4e0b-b917-bfb707308b68\") " pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d27faf9-6e82-4607-a427-5b391a57e548-agent-certs\") pod \"konnectivity-agent-blczl\" (UID: \"4d27faf9-6e82-4607-a427-5b391a57e548\") " pod="kube-system/konnectivity-agent-blczl" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.185386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-device-dir\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.186125 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.186854 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.187437 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cpldt\"" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.188201 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.188425 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.188537 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.188657 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.188767 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.188873 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.189031 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.189265 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6b9bc\"" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.189391 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8mfzk\"" Jul 15 21:09:40.190063 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.189528 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.200367 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.209190 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.209272 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.209412 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal"] Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.217436 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal"] Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.217485 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.236074 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-88tsk" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.239075 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 21:04:39 +0000 UTC" deadline="2027-12-16 18:24:13.582472858 +0000 UTC" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.239126 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12453h14m33.343350731s" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.245791 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-88tsk" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.274193 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-systemd\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-run\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d27faf9-6e82-4607-a427-5b391a57e548-konnectivity-ca\") pod \"konnectivity-agent-blczl\" (UID: \"4d27faf9-6e82-4607-a427-5b391a57e548\") " pod="kube-system/konnectivity-agent-blczl" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b58099c3-0641-4b25-8a15-890a56048105-etc-tuned\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-run-netns\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286667 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-run-netns\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-var-lib-cni-bin\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.361932 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-sysctl-d\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286728 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-var-lib-cni-bin\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb855b08-480a-4ab2-a350-13c13522a436-host\") pod \"node-ca-wfbd7\" (UID: \"fb855b08-480a-4ab2-a350-13c13522a436\") " pod="openshift-image-registry/node-ca-wfbd7" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286790 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286795 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb855b08-480a-4ab2-a350-13c13522a436-host\") pod \"node-ca-wfbd7\" (UID: \"fb855b08-480a-4ab2-a350-13c13522a436\") " pod="openshift-image-registry/node-ca-wfbd7" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286812 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-run-k8s-cni-cncf-io\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7bf7611a-bc20-4785-85ef-3fa8ef337b76-kubelet-config\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286872 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-run-k8s-cni-cncf-io\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-multus-socket-dir-parent\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cead259e-135e-46c5-9f12-9b473470c523-env-overrides\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286957 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vc22\" (UniqueName: \"kubernetes.io/projected/cead259e-135e-46c5-9f12-9b473470c523-kube-api-access-8vc22\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddxp9\" (UniqueName: \"kubernetes.io/projected/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-kube-api-access-ddxp9\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.286993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kmnm\" (UniqueName: \"kubernetes.io/projected/4d8349b9-3157-4527-8d1d-68b724cde1e0-kube-api-access-8kmnm\") pod \"iptables-alerter-v8xmd\" (UID: \"4d8349b9-3157-4527-8d1d-68b724cde1e0\") " pod="openshift-network-operator/iptables-alerter-v8xmd" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-run-netns\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.363492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287059 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-multus-socket-dir-parent\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d27faf9-6e82-4607-a427-5b391a57e548-agent-certs\") pod \"konnectivity-agent-blczl\" (UID: \"4d27faf9-6e82-4607-a427-5b391a57e548\") " pod="kube-system/konnectivity-agent-blczl" Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce9a409f-624e-4213-bc69-c760ed247c6c-tmp-dir\") pod \"node-resolver-s5mqn\" (UID: \"ce9a409f-624e-4213-bc69-c760ed247c6c\") " pod="openshift-dns/node-resolver-s5mqn" Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.287200 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cead259e-135e-46c5-9f12-9b473470c523-ovnkube-config\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kv6r\" (UniqueName: \"kubernetes.io/projected/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-kube-api-access-9kv6r\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287163 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d27faf9-6e82-4607-a427-5b391a57e548-konnectivity-ca\") pod \"konnectivity-agent-blczl\" (UID: \"4d27faf9-6e82-4607-a427-5b391a57e548\") " pod="kube-system/konnectivity-agent-blczl" Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.287347 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs podName:e3f782c6-eee1-4867-b1c7-52b75c1bb2d6 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:40.787272864 +0000 UTC m=+1.975753369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs") pod "network-metrics-daemon-fxtxv" (UID: "e3f782c6-eee1-4867-b1c7-52b75c1bb2d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-var-lib-cni-multus\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-system-cni-dir\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-etc-selinux\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287453 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-var-lib-cni-multus\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.364903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287469 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-system-cni-dir\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287474 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-sys-fs\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287493 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce9a409f-624e-4213-bc69-c760ed247c6c-hosts-file\") pod \"node-resolver-s5mqn\" (UID: \"ce9a409f-624e-4213-bc69-c760ed247c6c\") " pod="openshift-dns/node-resolver-s5mqn" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287543 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-sys-fs\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287567 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-etc-selinux\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287580 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-run-openvswitch\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287588 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce9a409f-624e-4213-bc69-c760ed247c6c-hosts-file\") pod \"node-resolver-s5mqn\" (UID: \"ce9a409f-624e-4213-bc69-c760ed247c6c\") " pod="openshift-dns/node-resolver-s5mqn" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287617 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce9a409f-624e-4213-bc69-c760ed247c6c-tmp-dir\") pod \"node-resolver-s5mqn\" (UID: \"ce9a409f-624e-4213-bc69-c760ed247c6c\") " pod="openshift-dns/node-resolver-s5mqn" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-run-ovn\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-run-multus-certs\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287688 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287739 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-run-multus-certs\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-etc-openvswitch\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.365589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-node-log\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-cni-bin\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-sysctl-conf\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-cni-binary-copy\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-socket-dir\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-system-cni-dir\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d8349b9-3157-4527-8d1d-68b724cde1e0-host-slash\") pod \"iptables-alerter-v8xmd\" (UID: \"4d8349b9-3157-4527-8d1d-68b724cde1e0\") " pod="openshift-network-operator/iptables-alerter-v8xmd" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cead259e-135e-46c5-9f12-9b473470c523-ovn-node-metrics-cert\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.287980 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-system-cni-dir\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clk4w\" (UniqueName: \"kubernetes.io/projected/b58099c3-0641-4b25-8a15-890a56048105-kube-api-access-clk4w\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288019 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-socket-dir\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-cnibin\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288082 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d8349b9-3157-4527-8d1d-68b724cde1e0-host-slash\") pod \"iptables-alerter-v8xmd\" (UID: \"4d8349b9-3157-4527-8d1d-68b724cde1e0\") " pod="openshift-network-operator/iptables-alerter-v8xmd" Jul 15 21:09:40.366333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7bf7611a-bc20-4785-85ef-3fa8ef337b76-dbus\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-systemd-units\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-var-lib-openvswitch\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288148 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-cnibin\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-sysconfig\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-host\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-os-release\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-run-systemd\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-lib-modules\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz7zw\" (UniqueName: \"kubernetes.io/projected/fb855b08-480a-4ab2-a350-13c13522a436-kube-api-access-qz7zw\") pod \"node-ca-wfbd7\" (UID: \"fb855b08-480a-4ab2-a350-13c13522a436\") " pod="openshift-image-registry/node-ca-wfbd7" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288333 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt5qk\" (UniqueName: \"kubernetes.io/projected/460bc0b3-2150-4a1d-9d9d-36d8c2143267-kube-api-access-jt5qk\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzrv2\" (UniqueName: \"kubernetes.io/projected/ce9a409f-624e-4213-bc69-c760ed247c6c-kube-api-access-wzrv2\") pod \"node-resolver-s5mqn\" (UID: \"ce9a409f-624e-4213-bc69-c760ed247c6c\") " pod="openshift-dns/node-resolver-s5mqn" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-cnibin\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-kubelet\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.367025 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-modprobe-d\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288408 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-os-release\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288426 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-cni-binary-copy\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-sys\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d8349b9-3157-4527-8d1d-68b724cde1e0-iptables-alerter-script\") pod \"iptables-alerter-v8xmd\" (UID: \"4d8349b9-3157-4527-8d1d-68b724cde1e0\") " pod="openshift-network-operator/iptables-alerter-v8xmd" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-slash\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288546 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-multus-cni-dir\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-multus-daemon-config\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckkkd\" (UniqueName: \"kubernetes.io/projected/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-kube-api-access-ckkkd\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hd6p\" (UniqueName: \"kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p\") pod \"network-check-target-kwwkk\" (UID: \"3fa8856a-c739-4e0b-b917-bfb707308b68\") " pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288649 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-cnibin\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-device-dir\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288705 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-multus-cni-dir\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.368073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288798 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-etc-kubernetes\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fb855b08-480a-4ab2-a350-13c13522a436-serviceca\") pod \"node-ca-wfbd7\" (UID: \"fb855b08-480a-4ab2-a350-13c13522a436\") " pod="openshift-image-registry/node-ca-wfbd7" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-hostroot\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-multus-conf-dir\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-cni-netd\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.288992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cead259e-135e-46c5-9f12-9b473470c523-ovnkube-script-lib\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-var-lib-kubelet\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289303 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b58099c3-0641-4b25-8a15-890a56048105-tmp\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-os-release\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289393 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fb855b08-480a-4ab2-a350-13c13522a436-serviceca\") pod \"node-ca-wfbd7\" (UID: \"fb855b08-480a-4ab2-a350-13c13522a436\") " pod="openshift-image-registry/node-ca-wfbd7" Jul 15 21:09:40.368772 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-var-lib-kubelet\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289444 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-device-dir\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-registration-dir\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289492 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/460bc0b3-2150-4a1d-9d9d-36d8c2143267-registration-dir\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-log-socket\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-kubernetes\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289574 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-multus-daemon-config\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289606 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-etc-kubernetes\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289640 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-multus-conf-dir\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289645 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-hostroot\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289704 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-os-release\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289739 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-host-var-lib-kubelet\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.289818 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.369461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.291884 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d27faf9-6e82-4607-a427-5b391a57e548-agent-certs\") pod \"konnectivity-agent-blczl\" (UID: \"4d27faf9-6e82-4607-a427-5b391a57e548\") " pod="kube-system/konnectivity-agent-blczl" Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.295058 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d8349b9-3157-4527-8d1d-68b724cde1e0-iptables-alerter-script\") pod \"iptables-alerter-v8xmd\" (UID: \"4d8349b9-3157-4527-8d1d-68b724cde1e0\") " pod="openshift-network-operator/iptables-alerter-v8xmd" Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.299699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kv6r\" (UniqueName: \"kubernetes.io/projected/fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb-kube-api-access-9kv6r\") pod \"multus-j9f5x\" (UID: \"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb\") " pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.299721 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddxp9\" (UniqueName: \"kubernetes.io/projected/be24de37-d807-4d7f-9e19-ea9d7cf2caa4-kube-api-access-ddxp9\") pod \"multus-additional-cni-plugins-kcn9l\" (UID: \"be24de37-d807-4d7f-9e19-ea9d7cf2caa4\") " pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.299850 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.299869 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.299897 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6hd6p for pod openshift-network-diagnostics/network-check-target-kwwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.300394 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p podName:3fa8856a-c739-4e0b-b917-bfb707308b68 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:40.800371838 +0000 UTC m=+1.988852346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6hd6p" (UniqueName: "kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p") pod "network-check-target-kwwkk" (UID: "3fa8856a-c739-4e0b-b917-bfb707308b68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.300651 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kmnm\" (UniqueName: \"kubernetes.io/projected/4d8349b9-3157-4527-8d1d-68b724cde1e0-kube-api-access-8kmnm\") pod \"iptables-alerter-v8xmd\" (UID: \"4d8349b9-3157-4527-8d1d-68b724cde1e0\") " pod="openshift-network-operator/iptables-alerter-v8xmd" Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.301711 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckkkd\" (UniqueName: \"kubernetes.io/projected/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-kube-api-access-ckkkd\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.302822 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt5qk\" (UniqueName: \"kubernetes.io/projected/460bc0b3-2150-4a1d-9d9d-36d8c2143267-kube-api-access-jt5qk\") pod \"aws-ebs-csi-driver-node-vc9ks\" (UID: \"460bc0b3-2150-4a1d-9d9d-36d8c2143267\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.304201 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzrv2\" (UniqueName: \"kubernetes.io/projected/ce9a409f-624e-4213-bc69-c760ed247c6c-kube-api-access-wzrv2\") pod \"node-resolver-s5mqn\" (UID: \"ce9a409f-624e-4213-bc69-c760ed247c6c\") " pod="openshift-dns/node-resolver-s5mqn" Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.306713 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz7zw\" (UniqueName: \"kubernetes.io/projected/fb855b08-480a-4ab2-a350-13c13522a436-kube-api-access-qz7zw\") pod \"node-ca-wfbd7\" (UID: \"fb855b08-480a-4ab2-a350-13c13522a436\") " pod="openshift-image-registry/node-ca-wfbd7" Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.315790 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kcn9l" Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.316396 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:40.370006 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.349279 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v8xmd" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cead259e-135e-46c5-9f12-9b473470c523-ovnkube-config\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-run-openvswitch\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-run-ovn\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390445 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390463 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-run-ovn\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390476 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-run-openvswitch\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-etc-openvswitch\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-node-log\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-cni-bin\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390539 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-etc-openvswitch\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-sysctl-conf\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390570 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-node-log\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390589 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-cni-bin\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.537515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cead259e-135e-46c5-9f12-9b473470c523-ovn-node-metrics-cert\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390630 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clk4w\" (UniqueName: \"kubernetes.io/projected/b58099c3-0641-4b25-8a15-890a56048105-kube-api-access-clk4w\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7bf7611a-bc20-4785-85ef-3fa8ef337b76-dbus\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-systemd-units\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-var-lib-openvswitch\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-sysconfig\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390738 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-sysctl-conf\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390749 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-host\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390750 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7bf7611a-bc20-4785-85ef-3fa8ef337b76-dbus\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-run-systemd\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-lib-modules\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390806 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-var-lib-openvswitch\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390809 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-host\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390840 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-systemd-units\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-kubelet\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.538787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390852 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-sysconfig\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-modprobe-d\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-sys\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390911 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-kubelet\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390936 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-run-systemd\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-slash\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390987 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-sys\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391014 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cead259e-135e-46c5-9f12-9b473470c523-ovnkube-config\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391027 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-slash\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391028 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-modprobe-d\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-cni-netd\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.390945 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-lib-modules\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391084 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-cni-netd\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cead259e-135e-46c5-9f12-9b473470c523-ovnkube-script-lib\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.540582 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-var-lib-kubelet\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b58099c3-0641-4b25-8a15-890a56048105-tmp\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-log-socket\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-kubernetes\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-var-lib-kubelet\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-systemd\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391293 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391298 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-log-socket\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-run\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b58099c3-0641-4b25-8a15-890a56048105-etc-tuned\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391350 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-systemd\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.391358 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-sysctl-d\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.541555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7bf7611a-bc20-4785-85ef-3fa8ef337b76-kubelet-config\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.391412 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret podName:7bf7611a-bc20-4785-85ef-3fa8ef337b76 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:40.891395194 +0000 UTC m=+2.079875696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret") pod "global-pull-secret-syncer-6k6wd" (UID: "7bf7611a-bc20-4785-85ef-3fa8ef337b76") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391419 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-run\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391440 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cead259e-135e-46c5-9f12-9b473470c523-env-overrides\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391446 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7bf7611a-bc20-4785-85ef-3fa8ef337b76-kubelet-config\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vc22\" (UniqueName: \"kubernetes.io/projected/cead259e-135e-46c5-9f12-9b473470c523-kube-api-access-8vc22\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-run-netns\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391557 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-sysctl-d\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391607 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cead259e-135e-46c5-9f12-9b473470c523-host-run-netns\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391609 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cead259e-135e-46c5-9f12-9b473470c523-ovnkube-script-lib\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391671 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b58099c3-0641-4b25-8a15-890a56048105-etc-kubernetes\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.391890 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cead259e-135e-46c5-9f12-9b473470c523-env-overrides\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.393602 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b58099c3-0641-4b25-8a15-890a56048105-etc-tuned\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.393626 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b58099c3-0641-4b25-8a15-890a56048105-tmp\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.542515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.393730 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cead259e-135e-46c5-9f12-9b473470c523-ovn-node-metrics-cert\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.544833 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.408394 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clk4w\" (UniqueName: \"kubernetes.io/projected/b58099c3-0641-4b25-8a15-890a56048105-kube-api-access-clk4w\") pod \"tuned-84fh8\" (UID: \"b58099c3-0641-4b25-8a15-890a56048105\") " pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.544833 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.408394 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vc22\" (UniqueName: \"kubernetes.io/projected/cead259e-135e-46c5-9f12-9b473470c523-kube-api-access-8vc22\") pod \"ovnkube-node-ggffq\" (UID: \"cead259e-135e-46c5-9f12-9b473470c523\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.544833 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:40.446774 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09dfa2203c1443c4cf09671187656131.slice/crio-9d521800c1f342b00d3ce386b7af07aec04181d5d06f9958c7d86e1a64cc5465 WatchSource:0}: Error finding container 9d521800c1f342b00d3ce386b7af07aec04181d5d06f9958c7d86e1a64cc5465: Status 404 returned error can't find the container with id 9d521800c1f342b00d3ce386b7af07aec04181d5d06f9958c7d86e1a64cc5465 Jul 15 21:09:40.544833 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:40.447412 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee02da604e394d7a77bd64a803f84f9.slice/crio-4bfa07b82e81780baf5530cc870781cab1179cb24d5591d6f3fbdcc9fa0862f4 WatchSource:0}: Error finding container 4bfa07b82e81780baf5530cc870781cab1179cb24d5591d6f3fbdcc9fa0862f4: Status 404 returned error can't find the container with id 4bfa07b82e81780baf5530cc870781cab1179cb24d5591d6f3fbdcc9fa0862f4 Jul 15 21:09:40.544833 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.452131 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:09:40.544833 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.518874 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wfbd7" Jul 15 21:09:40.544833 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.527070 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9f5x" Jul 15 21:09:40.544833 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:40.527770 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb855b08_480a_4ab2_a350_13c13522a436.slice/crio-d4e2784bdc6131fa4038361d406547d930793deb545aa505cba12bc44400361a WatchSource:0}: Error finding container d4e2784bdc6131fa4038361d406547d930793deb545aa505cba12bc44400361a: Status 404 returned error can't find the container with id d4e2784bdc6131fa4038361d406547d930793deb545aa505cba12bc44400361a Jul 15 21:09:40.544833 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:40.536852 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1b65c7_3653_4f4e_a2c2_5b9fb5f101fb.slice/crio-304d0aadb6cbb2a147a767b9b772d37a627c45fbe15ebc7e8aae0571124a8527 WatchSource:0}: Error finding container 304d0aadb6cbb2a147a767b9b772d37a627c45fbe15ebc7e8aae0571124a8527: Status 404 returned error can't find the container with id 304d0aadb6cbb2a147a767b9b772d37a627c45fbe15ebc7e8aae0571124a8527 Jul 15 21:09:40.549668 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.549201 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-blczl" Jul 15 21:09:40.708750 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:40.560269 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d27faf9_6e82_4607_a427_5b391a57e548.slice/crio-db5b2b124af8a34ef50531a26f032f84abbbbcc8da15e14f7883f0973594e668 WatchSource:0}: Error finding container db5b2b124af8a34ef50531a26f032f84abbbbcc8da15e14f7883f0973594e668: Status 404 returned error can't find the container with id db5b2b124af8a34ef50531a26f032f84abbbbcc8da15e14f7883f0973594e668 Jul 15 21:09:40.708750 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.568369 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" Jul 15 21:09:40.708750 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:40.577051 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460bc0b3_2150_4a1d_9d9d_36d8c2143267.slice/crio-1e5cdc63cbc361863bf8e9b46d33ad77c844de7bf18358a9b93b5cc27c710c5d WatchSource:0}: Error finding container 1e5cdc63cbc361863bf8e9b46d33ad77c844de7bf18358a9b93b5cc27c710c5d: Status 404 returned error can't find the container with id 1e5cdc63cbc361863bf8e9b46d33ad77c844de7bf18358a9b93b5cc27c710c5d Jul 15 21:09:40.708750 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.589052 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s5mqn" Jul 15 21:09:40.708750 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:40.597604 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9a409f_624e_4213_bc69_c760ed247c6c.slice/crio-a48e3ae16a417a7e523506f7fa4f79454b5deef9bfb6c650a93587714e90ea9e WatchSource:0}: Error finding container a48e3ae16a417a7e523506f7fa4f79454b5deef9bfb6c650a93587714e90ea9e: Status 404 returned error can't find the container with id a48e3ae16a417a7e523506f7fa4f79454b5deef9bfb6c650a93587714e90ea9e Jul 15 21:09:40.708750 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:40.644380 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe24de37_d807_4d7f_9e19_ea9d7cf2caa4.slice/crio-08bc8d2be43c1cb5daabbf6ec6ab566a39c96196dba83a2674c47dfd6ff77485 WatchSource:0}: Error finding container 08bc8d2be43c1cb5daabbf6ec6ab566a39c96196dba83a2674c47dfd6ff77485: Status 404 returned error can't find the container with id 08bc8d2be43c1cb5daabbf6ec6ab566a39c96196dba83a2674c47dfd6ff77485 Jul 15 21:09:40.708750 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.671409 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:09:40.708750 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.677098 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-84fh8" Jul 15 21:09:40.708750 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:40.679708 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcead259e_135e_46c5_9f12_9b473470c523.slice/crio-2780d3ad7c781fc7ced24e445aa02b3c07e0cf3fa633832de051204db045a357 WatchSource:0}: Error finding container 2780d3ad7c781fc7ced24e445aa02b3c07e0cf3fa633832de051204db045a357: Status 404 returned error can't find the container with id 2780d3ad7c781fc7ced24e445aa02b3c07e0cf3fa633832de051204db045a357 Jul 15 21:09:40.708750 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:40.685415 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58099c3_0641_4b25_8a15_890a56048105.slice/crio-2d69db955aa78439a1538f30284b7aea121bac870346205e7ab8ae03dbaef683 WatchSource:0}: Error finding container 2d69db955aa78439a1538f30284b7aea121bac870346205e7ab8ae03dbaef683: Status 404 returned error can't find the container with id 2d69db955aa78439a1538f30284b7aea121bac870346205e7ab8ae03dbaef683 Jul 15 21:09:40.712925 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.712567 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:40.872797 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:09:40.753302 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8349b9_3157_4527_8d1d_68b724cde1e0.slice/crio-f9e9cf59f1e2310ee37e82466046217d442fd2d33696a8e4aa193d8f370f1af0 WatchSource:0}: Error finding container f9e9cf59f1e2310ee37e82466046217d442fd2d33696a8e4aa193d8f370f1af0: Status 404 returned error can't find the container with id f9e9cf59f1e2310ee37e82466046217d442fd2d33696a8e4aa193d8f370f1af0 Jul 15 21:09:40.872797 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.793850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:40.872797 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.793981 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:40.872797 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.794029 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs podName:e3f782c6-eee1-4867-b1c7-52b75c1bb2d6 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:41.794016118 +0000 UTC m=+2.982496620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs") pod "network-metrics-daemon-fxtxv" (UID: "e3f782c6-eee1-4867-b1c7-52b75c1bb2d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:40.970462 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.894356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hd6p\" (UniqueName: \"kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p\") pod \"network-check-target-kwwkk\" (UID: \"3fa8856a-c739-4e0b-b917-bfb707308b68\") " pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:40.970462 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:40.894405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:40.970462 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.894534 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:40.970462 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.894537 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:40.970462 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.894559 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:40.970462 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.894569 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6hd6p for pod openshift-network-diagnostics/network-check-target-kwwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:40.970462 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.894587 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret podName:7bf7611a-bc20-4785-85ef-3fa8ef337b76 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:41.894573675 +0000 UTC m=+3.083054177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret") pod "global-pull-secret-syncer-6k6wd" (UID: "7bf7611a-bc20-4785-85ef-3fa8ef337b76") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:40.970462 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:40.894612 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p podName:3fa8856a-c739-4e0b-b917-bfb707308b68 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:41.894598026 +0000 UTC m=+3.083078527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6hd6p" (UniqueName: "kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p") pod "network-check-target-kwwkk" (UID: "3fa8856a-c739-4e0b-b917-bfb707308b68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:41.252376 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.248213 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:04:40 +0000 UTC" deadline="2028-03-03 19:13:14.32821152 +0000 UTC" Jul 15 21:09:41.252376 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.248274 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14326h3m33.079941348s" Jul 15 21:09:41.334202 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.333721 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:41.334202 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:41.333857 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:09:41.334202 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.333991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:41.334202 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:41.334108 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:09:41.344891 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.344860 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:09:41.373033 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.372906 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9f5x" event={"ID":"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb","Type":"ContainerStarted","Data":"304d0aadb6cbb2a147a767b9b772d37a627c45fbe15ebc7e8aae0571124a8527"} Jul 15 21:09:41.380776 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.380737 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" event={"ID":"0ee02da604e394d7a77bd64a803f84f9","Type":"ContainerStarted","Data":"4bfa07b82e81780baf5530cc870781cab1179cb24d5591d6f3fbdcc9fa0862f4"} Jul 15 21:09:41.388691 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.388588 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" event={"ID":"09dfa2203c1443c4cf09671187656131","Type":"ContainerStarted","Data":"9d521800c1f342b00d3ce386b7af07aec04181d5d06f9958c7d86e1a64cc5465"} Jul 15 21:09:41.397029 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.396937 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v8xmd" event={"ID":"4d8349b9-3157-4527-8d1d-68b724cde1e0","Type":"ContainerStarted","Data":"f9e9cf59f1e2310ee37e82466046217d442fd2d33696a8e4aa193d8f370f1af0"} Jul 15 21:09:41.412714 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.412677 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcn9l" event={"ID":"be24de37-d807-4d7f-9e19-ea9d7cf2caa4","Type":"ContainerStarted","Data":"08bc8d2be43c1cb5daabbf6ec6ab566a39c96196dba83a2674c47dfd6ff77485"} Jul 15 21:09:41.424058 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.424014 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s5mqn" event={"ID":"ce9a409f-624e-4213-bc69-c760ed247c6c","Type":"ContainerStarted","Data":"a48e3ae16a417a7e523506f7fa4f79454b5deef9bfb6c650a93587714e90ea9e"} Jul 15 21:09:41.429554 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.429444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" event={"ID":"460bc0b3-2150-4a1d-9d9d-36d8c2143267","Type":"ContainerStarted","Data":"1e5cdc63cbc361863bf8e9b46d33ad77c844de7bf18358a9b93b5cc27c710c5d"} Jul 15 21:09:41.434360 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.434324 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wfbd7" event={"ID":"fb855b08-480a-4ab2-a350-13c13522a436","Type":"ContainerStarted","Data":"d4e2784bdc6131fa4038361d406547d930793deb545aa505cba12bc44400361a"} Jul 15 21:09:41.449977 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.449860 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-84fh8" event={"ID":"b58099c3-0641-4b25-8a15-890a56048105","Type":"ContainerStarted","Data":"2d69db955aa78439a1538f30284b7aea121bac870346205e7ab8ae03dbaef683"} Jul 15 21:09:41.468076 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.467878 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" event={"ID":"cead259e-135e-46c5-9f12-9b473470c523","Type":"ContainerStarted","Data":"2780d3ad7c781fc7ced24e445aa02b3c07e0cf3fa633832de051204db045a357"} Jul 15 21:09:41.472460 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.472424 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-blczl" event={"ID":"4d27faf9-6e82-4607-a427-5b391a57e548","Type":"ContainerStarted","Data":"db5b2b124af8a34ef50531a26f032f84abbbbcc8da15e14f7883f0973594e668"} Jul 15 21:09:41.801448 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.801408 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:41.801647 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:41.801576 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:41.801647 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:41.801645 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs podName:e3f782c6-eee1-4867-b1c7-52b75c1bb2d6 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:43.801623893 +0000 UTC m=+4.990104398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs") pod "network-metrics-daemon-fxtxv" (UID: "e3f782c6-eee1-4867-b1c7-52b75c1bb2d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:41.902626 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.902586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hd6p\" (UniqueName: \"kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p\") pod \"network-check-target-kwwkk\" (UID: \"3fa8856a-c739-4e0b-b917-bfb707308b68\") " pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:41.902805 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:41.902647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:41.902805 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:41.902796 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:41.902935 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:41.902820 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:41.902935 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:41.902850 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:41.902935 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:41.902864 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6hd6p for pod openshift-network-diagnostics/network-check-target-kwwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:41.902935 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:41.902871 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret podName:7bf7611a-bc20-4785-85ef-3fa8ef337b76 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:43.902851286 +0000 UTC m=+5.091331808 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret") pod "global-pull-secret-syncer-6k6wd" (UID: "7bf7611a-bc20-4785-85ef-3fa8ef337b76") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:41.902935 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:41.902921 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p podName:3fa8856a-c739-4e0b-b917-bfb707308b68 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:43.902903185 +0000 UTC m=+5.091383707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6hd6p" (UniqueName: "kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p") pod "network-check-target-kwwkk" (UID: "3fa8856a-c739-4e0b-b917-bfb707308b68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:42.248628 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:42.248480 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:04:40 +0000 UTC" deadline="2028-03-10 16:54:53.758065475 +0000 UTC" Jul 15 21:09:42.248628 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:42.248523 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14491h45m11.509547516s" Jul 15 21:09:42.332613 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:42.332048 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:42.332613 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:42.332220 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:09:43.333885 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:43.333230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:43.333885 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:43.333358 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:09:43.333885 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:43.333238 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:43.333885 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:43.333831 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:09:43.819973 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:43.819873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:43.820215 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:43.820067 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:43.820215 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:43.820175 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs podName:e3f782c6-eee1-4867-b1c7-52b75c1bb2d6 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:47.820153702 +0000 UTC m=+9.008634220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs") pod "network-metrics-daemon-fxtxv" (UID: "e3f782c6-eee1-4867-b1c7-52b75c1bb2d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:43.922070 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:43.921152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hd6p\" (UniqueName: \"kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p\") pod \"network-check-target-kwwkk\" (UID: \"3fa8856a-c739-4e0b-b917-bfb707308b68\") " pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:43.922070 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:43.921227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:43.922070 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:43.921388 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:43.922070 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:43.921463 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret podName:7bf7611a-bc20-4785-85ef-3fa8ef337b76 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:47.921434085 +0000 UTC m=+9.109914597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret") pod "global-pull-secret-syncer-6k6wd" (UID: "7bf7611a-bc20-4785-85ef-3fa8ef337b76") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:43.922070 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:43.921897 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:43.922070 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:43.921916 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:43.922070 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:43.921930 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6hd6p for pod openshift-network-diagnostics/network-check-target-kwwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:43.922070 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:43.921974 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p podName:3fa8856a-c739-4e0b-b917-bfb707308b68 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:47.921959279 +0000 UTC m=+9.110439796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6hd6p" (UniqueName: "kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p") pod "network-check-target-kwwkk" (UID: "3fa8856a-c739-4e0b-b917-bfb707308b68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:44.332265 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:44.332227 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:44.332467 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:44.332373 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:09:45.331669 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:45.331634 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:45.332190 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:45.331634 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:45.332190 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:45.331778 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:09:45.332190 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:45.331839 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:09:46.331570 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:46.331530 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:46.331816 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:46.331684 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:09:47.332290 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:47.332249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:47.332785 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:47.332405 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:09:47.332785 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:47.332431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:47.332785 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:47.332557 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:09:47.858608 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:47.858567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:47.858795 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:47.858771 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:47.858867 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:47.858843 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs podName:e3f782c6-eee1-4867-b1c7-52b75c1bb2d6 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:55.858820216 +0000 UTC m=+17.047300724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs") pod "network-metrics-daemon-fxtxv" (UID: "e3f782c6-eee1-4867-b1c7-52b75c1bb2d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:47.960020 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:47.959979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hd6p\" (UniqueName: \"kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p\") pod \"network-check-target-kwwkk\" (UID: \"3fa8856a-c739-4e0b-b917-bfb707308b68\") " pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:47.960235 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:47.960046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:47.960235 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:47.960201 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:47.960235 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:47.960207 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:47.960408 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:47.960238 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:47.960408 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:47.960256 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6hd6p for pod openshift-network-diagnostics/network-check-target-kwwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:47.960408 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:47.960257 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret podName:7bf7611a-bc20-4785-85ef-3fa8ef337b76 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:55.960242533 +0000 UTC m=+17.148723035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret") pod "global-pull-secret-syncer-6k6wd" (UID: "7bf7611a-bc20-4785-85ef-3fa8ef337b76") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:47.960408 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:47.960322 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p podName:3fa8856a-c739-4e0b-b917-bfb707308b68 nodeName:}" failed. No retries permitted until 2026-07-15 21:09:55.960304649 +0000 UTC m=+17.148785160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6hd6p" (UniqueName: "kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p") pod "network-check-target-kwwkk" (UID: "3fa8856a-c739-4e0b-b917-bfb707308b68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:48.331469 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:48.331430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:48.331695 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:48.331590 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:09:49.332833 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:49.332431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:49.332833 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:49.332541 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:09:49.333570 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:49.333443 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:49.333570 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:49.333529 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:09:50.331899 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:50.331551 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:50.331899 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:50.331646 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:09:51.332191 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:51.331910 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:51.332627 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:51.331971 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:51.332627 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:51.332262 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:09:51.332627 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:51.332361 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:09:52.332038 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:52.331988 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:52.332201 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:52.332132 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:09:53.331841 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:53.331798 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:53.332045 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:53.331798 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:53.332045 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:53.331955 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:09:53.332045 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:53.332005 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:09:54.331905 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:54.331866 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:54.332282 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:54.331992 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:09:55.331785 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:55.331743 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:55.331986 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:55.331797 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:55.331986 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:55.331883 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:09:55.331986 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:55.331967 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:09:55.924763 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:55.924725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:55.924986 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:55.924893 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:55.924986 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:55.924973 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs podName:e3f782c6-eee1-4867-b1c7-52b75c1bb2d6 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:11.924951521 +0000 UTC m=+33.113432034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs") pod "network-metrics-daemon-fxtxv" (UID: "e3f782c6-eee1-4867-b1c7-52b75c1bb2d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:09:56.025462 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:56.025426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hd6p\" (UniqueName: \"kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p\") pod \"network-check-target-kwwkk\" (UID: \"3fa8856a-c739-4e0b-b917-bfb707308b68\") " pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:56.025462 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:56.025467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:56.025680 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:56.025580 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:56.025680 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:56.025595 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:09:56.025680 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:56.025612 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:09:56.025680 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:56.025624 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6hd6p for pod openshift-network-diagnostics/network-check-target-kwwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:56.025680 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:56.025646 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret podName:7bf7611a-bc20-4785-85ef-3fa8ef337b76 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:12.025628583 +0000 UTC m=+33.214109101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret") pod "global-pull-secret-syncer-6k6wd" (UID: "7bf7611a-bc20-4785-85ef-3fa8ef337b76") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:09:56.025680 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:56.025663 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p podName:3fa8856a-c739-4e0b-b917-bfb707308b68 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:12.02565432 +0000 UTC m=+33.214134820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6hd6p" (UniqueName: "kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p") pod "network-check-target-kwwkk" (UID: "3fa8856a-c739-4e0b-b917-bfb707308b68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:09:56.332190 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:56.332110 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:56.332639 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:56.332226 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:09:57.331243 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:57.331210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:57.331426 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:57.331351 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:09:57.331426 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:57.331416 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:57.331550 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:57.331524 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:09:58.332197 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:58.332165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:09:58.332606 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:58.332268 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:09:59.332465 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:59.332316 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:09:59.332465 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:59.332446 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:09:59.332986 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:09:59.332533 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:09:59.332986 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:09:59.332634 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:10:00.331819 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:00.331779 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:00.331979 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:00.331900 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:10:01.331301 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:01.331273 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:10:01.331686 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:01.331301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:01.331686 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:01.331440 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:10:01.331686 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:01.331572 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:10:01.550452 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:01.550417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" event={"ID":"cead259e-135e-46c5-9f12-9b473470c523","Type":"ContainerStarted","Data":"c0a7d4fc5cee8370f372f741849c55296cc8d03dada7123eda4388789236d3a8"} Jul 15 21:10:01.551819 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:01.551793 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9f5x" event={"ID":"fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb","Type":"ContainerStarted","Data":"0ee3764ef81871096b209fb781f6860502590325f0a2dc36d50340a5fe353906"} Jul 15 21:10:01.553291 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:01.553266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" event={"ID":"0ee02da604e394d7a77bd64a803f84f9","Type":"ContainerStarted","Data":"98ab4a758f57787ae163b986fa1b20eed5e063145528b2d57249d3a32c93f874"} Jul 15 21:10:01.555906 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:01.555882 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-84fh8" event={"ID":"b58099c3-0641-4b25-8a15-890a56048105","Type":"ContainerStarted","Data":"cd16048d0623cda0b2fc27bd979ce857b91c0e24bf2cdf10cf279a8b7ad1c468"} Jul 15 21:10:01.576472 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:01.576420 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j9f5x" podStartSLOduration=0.747530474 podStartE2EDuration="21.57640567s" totalImagesPullingTime="20.828875196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:01.576318223 +0000 UTC m=+22.764798746" watchObservedRunningTime="2026-07-15 21:10:01.57640567 +0000 UTC m=+22.764886191" Jul 15 21:10:01.592535 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:01.592480 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-107.ec2.internal" podStartSLOduration=21.592460056 podStartE2EDuration="21.592460056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:01.592121371 +0000 UTC m=+22.780601897" watchObservedRunningTime="2026-07-15 21:10:01.592460056 +0000 UTC m=+22.780940579" Jul 15 21:10:02.332081 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.331820 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:02.332727 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:02.332204 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:10:02.559660 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.559464 2578 generic.go:356] "Generic (PLEG): container finished" podID="be24de37-d807-4d7f-9e19-ea9d7cf2caa4" containerID="780354cd0d525bbc8a41a4c53dc9d5e1e7401a69c0db10e114db5e21f00a0837" exitCode=0 Jul 15 21:10:02.559840 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.559554 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcn9l" event={"ID":"be24de37-d807-4d7f-9e19-ea9d7cf2caa4","Type":"ContainerDied","Data":"780354cd0d525bbc8a41a4c53dc9d5e1e7401a69c0db10e114db5e21f00a0837"} Jul 15 21:10:02.561360 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.561339 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s5mqn" event={"ID":"ce9a409f-624e-4213-bc69-c760ed247c6c","Type":"ContainerStarted","Data":"330a63e30657fe0cfb88d40d130c18285e321e0e84f8364b7f8a1d99c1dcf47d"} Jul 15 21:10:02.562890 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.562868 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" event={"ID":"460bc0b3-2150-4a1d-9d9d-36d8c2143267","Type":"ContainerStarted","Data":"5823bafc821a8f585be825b106360cb68ebb08b21545361be99e51eeb3b5215c"} Jul 15 21:10:02.564274 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.564246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wfbd7" event={"ID":"fb855b08-480a-4ab2-a350-13c13522a436","Type":"ContainerStarted","Data":"1a962b1c22b60e699ace6311d324067688871cec898d67ecbd340f824c380e2b"} Jul 15 21:10:02.567317 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.567298 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:10:02.567626 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.567608 2578 generic.go:356] "Generic (PLEG): container finished" podID="cead259e-135e-46c5-9f12-9b473470c523" containerID="31cb5921acb40b3d7ab8343a7244a926dace6dc263593560ca73c61ffc8a7bf6" exitCode=1 Jul 15 21:10:02.567691 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.567669 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" event={"ID":"cead259e-135e-46c5-9f12-9b473470c523","Type":"ContainerStarted","Data":"c140a417ba64b68ab88b2a2304ceb4d4803fb84e7f04580f19922d429f12df7b"} Jul 15 21:10:02.567736 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.567719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" event={"ID":"cead259e-135e-46c5-9f12-9b473470c523","Type":"ContainerStarted","Data":"2ac89ed6b00cb299274f445ed019e430396523a925cbca924aff00abec8fe2dc"} Jul 15 21:10:02.567781 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.567754 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" event={"ID":"cead259e-135e-46c5-9f12-9b473470c523","Type":"ContainerStarted","Data":"675fd250f2fa0393ee4378e22ad030efec8666db99adc60331c47b9f03b54c05"} Jul 15 21:10:02.567819 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.567784 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" event={"ID":"cead259e-135e-46c5-9f12-9b473470c523","Type":"ContainerStarted","Data":"c8bce1309088f3bfaeac679eaac6015ae7d883121388ed61e3e70cf1519c7710"} Jul 15 21:10:02.567819 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.567811 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" event={"ID":"cead259e-135e-46c5-9f12-9b473470c523","Type":"ContainerDied","Data":"31cb5921acb40b3d7ab8343a7244a926dace6dc263593560ca73c61ffc8a7bf6"} Jul 15 21:10:02.568922 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.568899 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-blczl" event={"ID":"4d27faf9-6e82-4607-a427-5b391a57e548","Type":"ContainerStarted","Data":"6ce498ae1fedea0077d16a731c46bcf0a1276a5e6db9323578fb67ee0b1656cc"} Jul 15 21:10:02.570114 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.570094 2578 generic.go:356] "Generic (PLEG): container finished" podID="09dfa2203c1443c4cf09671187656131" containerID="b5f8aa403e1de9e16322c9b6c41131dbaf077eb64ffab9e53e8f26bc789dfd21" exitCode=0 Jul 15 21:10:02.570207 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.570123 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" event={"ID":"09dfa2203c1443c4cf09671187656131","Type":"ContainerDied","Data":"b5f8aa403e1de9e16322c9b6c41131dbaf077eb64ffab9e53e8f26bc789dfd21"} Jul 15 21:10:02.583581 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.583538 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-84fh8" podStartSLOduration=1.9234258340000001 podStartE2EDuration="22.58352231s" totalImagesPullingTime="20.660096476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:01.613996521 +0000 UTC m=+22.802477042" watchObservedRunningTime="2026-07-15 21:10:02.58352231 +0000 UTC m=+23.772002829" Jul 15 21:10:02.615613 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.615567 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-blczl" podStartSLOduration=1.8589767350000002 podStartE2EDuration="22.615543929s" totalImagesPullingTime="20.756567194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:02.598532879 +0000 UTC m=+23.787013399" watchObservedRunningTime="2026-07-15 21:10:02.615543929 +0000 UTC m=+23.804024455" Jul 15 21:10:02.648546 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.648333 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wfbd7" podStartSLOduration=1.856082598 podStartE2EDuration="22.648316736s" totalImagesPullingTime="20.792234138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:02.648183196 +0000 UTC m=+23.836663719" watchObservedRunningTime="2026-07-15 21:10:02.648316736 +0000 UTC m=+23.836797257" Jul 15 21:10:02.648710 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:02.648682 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s5mqn" podStartSLOduration=1.925285155 podStartE2EDuration="22.648675408s" totalImagesPullingTime="20.723390253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:02.632245126 +0000 UTC m=+23.820725660" watchObservedRunningTime="2026-07-15 21:10:02.648675408 +0000 UTC m=+23.837155929" Jul 15 21:10:03.331700 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:03.331604 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:10:03.331700 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:03.331650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:03.331942 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:03.331750 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:10:03.331942 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:03.331859 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:10:03.573566 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:03.573516 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" event={"ID":"09dfa2203c1443c4cf09671187656131","Type":"ContainerStarted","Data":"087c201bfe0894caf7639574276a88072dbc61076f9f4f0045f3f4f416872bb9"} Jul 15 21:10:03.574819 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:03.574795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v8xmd" event={"ID":"4d8349b9-3157-4527-8d1d-68b724cde1e0","Type":"ContainerStarted","Data":"ce2381dfc27f3b9d109e79886e1705d36a9ba738f9caa6ad3022883eec5e9838"} Jul 15 21:10:03.594484 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:03.594390 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-107.ec2.internal" podStartSLOduration=23.594374878 podStartE2EDuration="23.594374878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:03.594172973 +0000 UTC m=+24.782653495" watchObservedRunningTime="2026-07-15 21:10:03.594374878 +0000 UTC m=+24.782855399" Jul 15 21:10:03.612421 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:03.612369 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v8xmd" podStartSLOduration=3.040282699 podStartE2EDuration="23.612353811s" totalImagesPullingTime="20.572071112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:03.612345412 +0000 UTC m=+24.800825935" watchObservedRunningTime="2026-07-15 21:10:03.612353811 +0000 UTC m=+24.800834332" Jul 15 21:10:03.802935 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:03.802907 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 21:10:04.270065 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:04.269951 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T21:10:03.802932747Z","UUID":"9ea4633a-dc14-459c-9860-fb1ed03a4410","Handler":null,"Name":"","Endpoint":""} Jul 15 21:10:04.271653 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:04.271630 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 21:10:04.271793 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:04.271674 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 21:10:04.331223 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:04.331198 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:04.331362 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:04.331317 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:10:04.513961 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:04.513926 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-blczl" Jul 15 21:10:04.581951 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:04.581876 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:10:04.582435 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:04.582394 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" event={"ID":"cead259e-135e-46c5-9f12-9b473470c523","Type":"ContainerStarted","Data":"43b159ce00f6440d39253c7f4f747b62f8ac6e5037eddbd53f6fb9e23d88a8cd"} Jul 15 21:10:04.584666 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:04.584594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" event={"ID":"460bc0b3-2150-4a1d-9d9d-36d8c2143267","Type":"ContainerStarted","Data":"08d17f8d8e2ac89424fa323ed016b8ff94461391dc671043203df66ba648577f"} Jul 15 21:10:04.793953 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:04.793920 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-blczl" Jul 15 21:10:04.794648 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:04.794630 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-blczl" Jul 15 21:10:05.331723 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:05.331687 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:05.331907 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:05.331737 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:10:05.331907 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:05.331811 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:10:05.332061 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:05.331953 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:10:05.588836 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:05.588738 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" event={"ID":"460bc0b3-2150-4a1d-9d9d-36d8c2143267","Type":"ContainerStarted","Data":"9a3dd8fef69d805093ad43ee75bda06ce2001fedc9602b3191ffaaa1c1cf99c3"} Jul 15 21:10:05.589514 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:05.589493 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-blczl" Jul 15 21:10:05.611604 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:05.611545 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vc9ks" podStartSLOduration=2.256047021 podStartE2EDuration="25.611526628s" totalImagesPullingTime="23.355479607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:05.611097341 +0000 UTC m=+26.799577864" watchObservedRunningTime="2026-07-15 21:10:05.611526628 +0000 UTC m=+26.800007150" Jul 15 21:10:06.332102 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:06.332073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:06.332276 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:06.332181 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:10:07.331703 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:07.331528 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:10:07.332193 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:07.331563 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:07.332193 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:07.331841 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:10:07.332193 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:07.331906 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:10:07.596483 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:07.596455 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:10:07.596839 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:07.596816 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" event={"ID":"cead259e-135e-46c5-9f12-9b473470c523","Type":"ContainerStarted","Data":"933198f99135d7c6f7e5cb95962d74ae9973126b839a65b594ad303eee412dd2"} Jul 15 21:10:07.597080 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:07.597056 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:10:07.597286 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:07.597263 2578 scope.go:117] "RemoveContainer" containerID="31cb5921acb40b3d7ab8343a7244a926dace6dc263593560ca73c61ffc8a7bf6" Jul 15 21:10:07.598720 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:07.598696 2578 generic.go:356] "Generic (PLEG): container finished" podID="be24de37-d807-4d7f-9e19-ea9d7cf2caa4" containerID="9a9f081f582711606a3f093c395a6270ec4eba3134a21d7f1ba05dcae868fe6b" exitCode=0 Jul 15 21:10:07.598837 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:07.598786 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcn9l" event={"ID":"be24de37-d807-4d7f-9e19-ea9d7cf2caa4","Type":"ContainerDied","Data":"9a9f081f582711606a3f093c395a6270ec4eba3134a21d7f1ba05dcae868fe6b"} Jul 15 21:10:07.613689 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:07.613663 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:10:08.331592 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:08.331416 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:08.331766 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:08.331657 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:10:08.606441 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:08.606301 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:10:08.608390 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:08.606964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" event={"ID":"cead259e-135e-46c5-9f12-9b473470c523","Type":"ContainerStarted","Data":"cabbde0ec1254d85fe01b763cb8b2ae3232987104144093a24f1f5b02d43494e"} Jul 15 21:10:08.608390 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:08.607237 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 21:10:08.608390 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:08.608299 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:10:08.626314 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:08.626292 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:10:08.641092 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:08.641044 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" podStartSLOduration=7.911295237 podStartE2EDuration="28.641010295s" totalImagesPullingTime="20.729715058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:08.639625049 +0000 UTC m=+29.828105571" watchObservedRunningTime="2026-07-15 21:10:08.641010295 +0000 UTC m=+29.829490816" Jul 15 21:10:09.090585 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:09.090553 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:10:09.332251 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:09.332171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:10:09.332856 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:09.332297 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:10:09.332856 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:09.332352 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:09.332856 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:09.332439 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:10:09.535571 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:09.535535 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6k6wd"] Jul 15 21:10:09.535725 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:09.535662 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:09.535805 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:09.535780 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:10:09.548854 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:09.548816 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kwwkk"] Jul 15 21:10:09.549490 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:09.549467 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fxtxv"] Jul 15 21:10:09.611119 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:09.611012 2578 generic.go:356] "Generic (PLEG): container finished" podID="be24de37-d807-4d7f-9e19-ea9d7cf2caa4" containerID="ee22105891964afbb84b04e95b45f83b5dcf060b7c20374240e1bd203f41bad7" exitCode=0 Jul 15 21:10:09.611119 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:09.611096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcn9l" event={"ID":"be24de37-d807-4d7f-9e19-ea9d7cf2caa4","Type":"ContainerDied","Data":"ee22105891964afbb84b04e95b45f83b5dcf060b7c20374240e1bd203f41bad7"} Jul 15 21:10:09.611337 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:09.611283 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:10:09.611399 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:09.611382 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:10:09.611455 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:09.611410 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:09.611863 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:09.611840 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:10:11.331737 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:11.331696 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:10:11.331737 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:11.331738 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:11.332309 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:11.331696 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:11.332309 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:11.331809 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:10:11.332309 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:11.331871 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:10:11.332309 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:11.331940 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:10:11.618623 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:11.618588 2578 generic.go:356] "Generic (PLEG): container finished" podID="be24de37-d807-4d7f-9e19-ea9d7cf2caa4" containerID="bad4ad6774485060583fdc698b31ded3f2ad0de4ab6552ebdef5b7d3b7790543" exitCode=0 Jul 15 21:10:11.618789 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:11.618674 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcn9l" event={"ID":"be24de37-d807-4d7f-9e19-ea9d7cf2caa4","Type":"ContainerDied","Data":"bad4ad6774485060583fdc698b31ded3f2ad0de4ab6552ebdef5b7d3b7790543"} Jul 15 21:10:11.940168 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:11.940084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:10:11.940319 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:11.940235 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:11.940319 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:11.940296 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs podName:e3f782c6-eee1-4867-b1c7-52b75c1bb2d6 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:43.940282125 +0000 UTC m=+65.128762626 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs") pod "network-metrics-daemon-fxtxv" (UID: "e3f782c6-eee1-4867-b1c7-52b75c1bb2d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:12.041374 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:12.041343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hd6p\" (UniqueName: \"kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p\") pod \"network-check-target-kwwkk\" (UID: \"3fa8856a-c739-4e0b-b917-bfb707308b68\") " pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:12.041554 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:12.041381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:12.041554 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:12.041493 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:12.041554 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:12.041524 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:10:12.041554 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:12.041545 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret podName:7bf7611a-bc20-4785-85ef-3fa8ef337b76 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.041530855 +0000 UTC m=+65.230011355 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret") pod "global-pull-secret-syncer-6k6wd" (UID: "7bf7611a-bc20-4785-85ef-3fa8ef337b76") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:12.041554 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:12.041550 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:10:12.041766 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:12.041562 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6hd6p for pod openshift-network-diagnostics/network-check-target-kwwkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:12.041766 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:12.041611 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p podName:3fa8856a-c739-4e0b-b917-bfb707308b68 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.041595376 +0000 UTC m=+65.230075891 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6hd6p" (UniqueName: "kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p") pod "network-check-target-kwwkk" (UID: "3fa8856a-c739-4e0b-b917-bfb707308b68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:13.331710 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:13.331677 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:13.332125 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:13.331677 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:10:13.332125 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:13.331798 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwwkk" podUID="3fa8856a-c739-4e0b-b917-bfb707308b68" Jul 15 21:10:13.332125 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:13.331862 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxtxv" podUID="e3f782c6-eee1-4867-b1c7-52b75c1bb2d6" Jul 15 21:10:13.332125 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:13.331923 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:13.332125 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:13.332055 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6k6wd" podUID="7bf7611a-bc20-4785-85ef-3fa8ef337b76" Jul 15 21:10:14.624138 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.624107 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-107.ec2.internal" event="NodeReady" Jul 15 21:10:14.624569 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.624259 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 21:10:14.662007 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.661976 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9"] Jul 15 21:10:14.663955 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.663930 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.667109 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.667084 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 21:10:14.667229 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.667115 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 21:10:14.669971 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.669947 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r7n6n\"" Jul 15 21:10:14.670382 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.670362 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 21:10:14.673803 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.673781 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 21:10:14.681377 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.681347 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2fgr9"] Jul 15 21:10:14.683218 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.683202 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:14.684403 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.684367 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9"] Jul 15 21:10:14.685147 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.685120 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n49fs"] Jul 15 21:10:14.688574 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.686740 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 21:10:14.688574 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.686810 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4b2pm\"" Jul 15 21:10:14.688574 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.686953 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 21:10:14.690785 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.690761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n49fs" Jul 15 21:10:14.693425 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.693348 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 21:10:14.693601 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.693562 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhvhm\"" Jul 15 21:10:14.693691 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.693601 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 21:10:14.693752 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.693726 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 21:10:14.704370 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.704294 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n49fs"] Jul 15 21:10:14.705749 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.705718 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2fgr9"] Jul 15 21:10:14.761902 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.761864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21d9f46f-abef-498e-91ae-e0c813afa9ff-config-volume\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:14.762127 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.761911 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c971c1a-7fac-484d-bc79-65bef4b1e03f-ca-trust-extracted\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.762127 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.761941 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c971c1a-7fac-484d-bc79-65bef4b1e03f-installation-pull-secrets\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.762127 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.762052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21d9f46f-abef-498e-91ae-e0c813afa9ff-tmp-dir\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:14.762127 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.762077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.762127 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.762123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8986\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-kube-api-access-f8986\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.762384 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.762177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:14.762384 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.762266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4brj\" (UniqueName: \"kubernetes.io/projected/21d9f46f-abef-498e-91ae-e0c813afa9ff-kube-api-access-d4brj\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:14.762384 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.762311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c971c1a-7fac-484d-bc79-65bef4b1e03f-trusted-ca\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.762384 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.762335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-bound-sa-token\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.762384 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.762374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c971c1a-7fac-484d-bc79-65bef4b1e03f-image-registry-private-configuration\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.762578 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.762416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-certificates\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.863782 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.863747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4brj\" (UniqueName: \"kubernetes.io/projected/21d9f46f-abef-498e-91ae-e0c813afa9ff-kube-api-access-d4brj\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:14.863966 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.863792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54819573-6ef6-47f0-8aee-bb199f8f29b3-cert\") pod \"ingress-canary-n49fs\" (UID: \"54819573-6ef6-47f0-8aee-bb199f8f29b3\") " pod="openshift-ingress-canary/ingress-canary-n49fs" Jul 15 21:10:14.863966 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.863828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c971c1a-7fac-484d-bc79-65bef4b1e03f-trusted-ca\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.863966 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.863853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-bound-sa-token\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.864143 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.863994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8czjz\" (UniqueName: \"kubernetes.io/projected/54819573-6ef6-47f0-8aee-bb199f8f29b3-kube-api-access-8czjz\") pod \"ingress-canary-n49fs\" (UID: \"54819573-6ef6-47f0-8aee-bb199f8f29b3\") " pod="openshift-ingress-canary/ingress-canary-n49fs" Jul 15 21:10:14.864143 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.864068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c971c1a-7fac-484d-bc79-65bef4b1e03f-image-registry-private-configuration\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.864143 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.864106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-certificates\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.864143 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.864137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21d9f46f-abef-498e-91ae-e0c813afa9ff-config-volume\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:14.864356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.864155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c971c1a-7fac-484d-bc79-65bef4b1e03f-ca-trust-extracted\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.864356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.864185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c971c1a-7fac-484d-bc79-65bef4b1e03f-installation-pull-secrets\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.864356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.864251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21d9f46f-abef-498e-91ae-e0c813afa9ff-tmp-dir\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:14.864356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.864269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.864356 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.864313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8986\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-kube-api-access-f8986\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.864545 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.864358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:14.864545 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:14.864490 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:14.864545 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:14.864540 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls podName:21d9f46f-abef-498e-91ae-e0c813afa9ff nodeName:}" failed. No retries permitted until 2026-07-15 21:10:15.364524352 +0000 UTC m=+36.553004852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls") pod "dns-default-2fgr9" (UID: "21d9f46f-abef-498e-91ae-e0c813afa9ff") : secret "dns-default-metrics-tls" not found Jul 15 21:10:14.865415 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:14.864871 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:14.865415 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:14.864890 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9: secret "image-registry-tls" not found Jul 15 21:10:14.865415 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.864912 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21d9f46f-abef-498e-91ae-e0c813afa9ff-config-volume\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:14.865415 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:14.864941 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls podName:8c971c1a-7fac-484d-bc79-65bef4b1e03f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:15.364923934 +0000 UTC m=+36.553404434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls") pod "image-registry-5d7fdd8bbf-rnqj9" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f") : secret "image-registry-tls" not found Jul 15 21:10:14.865415 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.865197 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c971c1a-7fac-484d-bc79-65bef4b1e03f-trusted-ca\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.865415 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.865206 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21d9f46f-abef-498e-91ae-e0c813afa9ff-tmp-dir\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:14.865415 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.865388 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-certificates\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.865766 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.865490 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c971c1a-7fac-484d-bc79-65bef4b1e03f-ca-trust-extracted\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.869873 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.869737 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c971c1a-7fac-484d-bc79-65bef4b1e03f-installation-pull-secrets\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.869982 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.869751 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c971c1a-7fac-484d-bc79-65bef4b1e03f-image-registry-private-configuration\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.876374 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.876311 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-bound-sa-token\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.876374 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.876352 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4brj\" (UniqueName: \"kubernetes.io/projected/21d9f46f-abef-498e-91ae-e0c813afa9ff-kube-api-access-d4brj\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:14.876584 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.876550 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8986\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-kube-api-access-f8986\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:14.964868 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.964830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54819573-6ef6-47f0-8aee-bb199f8f29b3-cert\") pod \"ingress-canary-n49fs\" (UID: \"54819573-6ef6-47f0-8aee-bb199f8f29b3\") " pod="openshift-ingress-canary/ingress-canary-n49fs" Jul 15 21:10:14.965068 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.964884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czjz\" (UniqueName: \"kubernetes.io/projected/54819573-6ef6-47f0-8aee-bb199f8f29b3-kube-api-access-8czjz\") pod \"ingress-canary-n49fs\" (UID: \"54819573-6ef6-47f0-8aee-bb199f8f29b3\") " pod="openshift-ingress-canary/ingress-canary-n49fs" Jul 15 21:10:14.967610 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.967580 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54819573-6ef6-47f0-8aee-bb199f8f29b3-cert\") pod \"ingress-canary-n49fs\" (UID: \"54819573-6ef6-47f0-8aee-bb199f8f29b3\") " pod="openshift-ingress-canary/ingress-canary-n49fs" Jul 15 21:10:14.973882 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:14.973842 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8czjz\" (UniqueName: \"kubernetes.io/projected/54819573-6ef6-47f0-8aee-bb199f8f29b3-kube-api-access-8czjz\") pod \"ingress-canary-n49fs\" (UID: \"54819573-6ef6-47f0-8aee-bb199f8f29b3\") " pod="openshift-ingress-canary/ingress-canary-n49fs" Jul 15 21:10:15.002874 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:15.002833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n49fs" Jul 15 21:10:15.331738 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:15.331649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:15.331896 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:15.331649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:15.331990 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:15.331663 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:10:15.334657 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:15.334634 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 21:10:15.334871 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:15.334855 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 21:10:15.335953 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:15.335362 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xbx8z\"" Jul 15 21:10:15.335953 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:15.335539 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 21:10:15.335953 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:15.335545 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jtv82\"" Jul 15 21:10:15.335953 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:15.335676 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 21:10:15.368451 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:15.368416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:15.368631 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:15.368477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:15.368631 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:15.368595 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:15.368631 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:15.368626 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9: secret "image-registry-tls" not found Jul 15 21:10:15.368787 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:15.368689 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls podName:8c971c1a-7fac-484d-bc79-65bef4b1e03f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:16.368668954 +0000 UTC m=+37.557149467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls") pod "image-registry-5d7fdd8bbf-rnqj9" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f") : secret "image-registry-tls" not found Jul 15 21:10:15.368787 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:15.368600 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:15.368787 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:15.368775 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls podName:21d9f46f-abef-498e-91ae-e0c813afa9ff nodeName:}" failed. No retries permitted until 2026-07-15 21:10:16.368749089 +0000 UTC m=+37.557229624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls") pod "dns-default-2fgr9" (UID: "21d9f46f-abef-498e-91ae-e0c813afa9ff") : secret "dns-default-metrics-tls" not found Jul 15 21:10:16.321092 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:16.321068 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n49fs"] Jul 15 21:10:16.324325 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:16.324299 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54819573_6ef6_47f0_8aee_bb199f8f29b3.slice/crio-4e085a5efa61557bd61bcfba8a6d505793dcbff28eab6f7b8014fac8331297c4 WatchSource:0}: Error finding container 4e085a5efa61557bd61bcfba8a6d505793dcbff28eab6f7b8014fac8331297c4: Status 404 returned error can't find the container with id 4e085a5efa61557bd61bcfba8a6d505793dcbff28eab6f7b8014fac8331297c4 Jul 15 21:10:16.377568 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:16.377533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:16.377707 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:16.377630 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:16.377778 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:16.377732 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:16.377778 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:16.377732 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:16.377846 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:16.377825 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls podName:21d9f46f-abef-498e-91ae-e0c813afa9ff nodeName:}" failed. No retries permitted until 2026-07-15 21:10:18.377802556 +0000 UTC m=+39.566283079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls") pod "dns-default-2fgr9" (UID: "21d9f46f-abef-498e-91ae-e0c813afa9ff") : secret "dns-default-metrics-tls" not found Jul 15 21:10:16.377846 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:16.377744 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9: secret "image-registry-tls" not found Jul 15 21:10:16.377922 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:16.377878 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls podName:8c971c1a-7fac-484d-bc79-65bef4b1e03f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:18.377864802 +0000 UTC m=+39.566345322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls") pod "image-registry-5d7fdd8bbf-rnqj9" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f") : secret "image-registry-tls" not found Jul 15 21:10:16.631775 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:16.631741 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n49fs" event={"ID":"54819573-6ef6-47f0-8aee-bb199f8f29b3","Type":"ContainerStarted","Data":"4e085a5efa61557bd61bcfba8a6d505793dcbff28eab6f7b8014fac8331297c4"} Jul 15 21:10:16.634315 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:16.634287 2578 generic.go:356] "Generic (PLEG): container finished" podID="be24de37-d807-4d7f-9e19-ea9d7cf2caa4" containerID="417bbd582840b64fe85ab6b625a0e9e15df7882ddf77d36c625cf0005f46cdde" exitCode=0 Jul 15 21:10:16.634436 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:16.634332 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcn9l" event={"ID":"be24de37-d807-4d7f-9e19-ea9d7cf2caa4","Type":"ContainerDied","Data":"417bbd582840b64fe85ab6b625a0e9e15df7882ddf77d36c625cf0005f46cdde"} Jul 15 21:10:17.639313 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:17.639053 2578 generic.go:356] "Generic (PLEG): container finished" podID="be24de37-d807-4d7f-9e19-ea9d7cf2caa4" containerID="308fab4b2c0dbe3f1f425bd8b6328c46a681a852b16b5fc5ca22869db258a7fd" exitCode=0 Jul 15 21:10:17.639313 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:17.639119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcn9l" event={"ID":"be24de37-d807-4d7f-9e19-ea9d7cf2caa4","Type":"ContainerDied","Data":"308fab4b2c0dbe3f1f425bd8b6328c46a681a852b16b5fc5ca22869db258a7fd"} Jul 15 21:10:18.395465 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:18.395433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:18.395614 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:18.395476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:18.395614 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:18.395573 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:18.395614 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:18.395579 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:18.395614 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:18.395598 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9: secret "image-registry-tls" not found Jul 15 21:10:18.395760 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:18.395633 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls podName:21d9f46f-abef-498e-91ae-e0c813afa9ff nodeName:}" failed. No retries permitted until 2026-07-15 21:10:22.395620287 +0000 UTC m=+43.584100787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls") pod "dns-default-2fgr9" (UID: "21d9f46f-abef-498e-91ae-e0c813afa9ff") : secret "dns-default-metrics-tls" not found Jul 15 21:10:18.395760 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:18.395646 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls podName:8c971c1a-7fac-484d-bc79-65bef4b1e03f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:22.395640252 +0000 UTC m=+43.584120752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls") pod "image-registry-5d7fdd8bbf-rnqj9" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f") : secret "image-registry-tls" not found Jul 15 21:10:18.644292 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:18.644251 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcn9l" event={"ID":"be24de37-d807-4d7f-9e19-ea9d7cf2caa4","Type":"ContainerStarted","Data":"cc1451cfbe2a6066ea398921cb46578849498086522515d683d4178899d43e1c"} Jul 15 21:10:18.673242 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:18.673135 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kcn9l" podStartSLOduration=6.32859913 podStartE2EDuration="38.67311765s" totalImagesPullingTime="32.34451852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:18.672395582 +0000 UTC m=+39.860876116" watchObservedRunningTime="2026-07-15 21:10:18.67311765 +0000 UTC m=+39.861598172" Jul 15 21:10:18.868296 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:18.868228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blczl_4d27faf9-6e82-4607-a427-5b391a57e548/konnectivity-agent/0.log" limit=1024 Jul 15 21:10:18.959629 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:18.959599 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blczl_4d27faf9-6e82-4607-a427-5b391a57e548/konnectivity-agent/0.log" limit=1024 Jul 15 21:10:19.587804 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:19.587770 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blczl_4d27faf9-6e82-4607-a427-5b391a57e548/konnectivity-agent/0.log" limit=1024 Jul 15 21:10:19.648195 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:19.648161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n49fs" event={"ID":"54819573-6ef6-47f0-8aee-bb199f8f29b3","Type":"ContainerStarted","Data":"e3bb506b1371bea837947c80a826f247d40511f2d6cf71999653c3bc86bfd0c3"} Jul 15 21:10:19.666919 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:19.666870 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n49fs" podStartSLOduration=3.226580419 podStartE2EDuration="5.666854509s" totalImagesPullingTime="2.44027409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:19.666620001 +0000 UTC m=+40.855100526" watchObservedRunningTime="2026-07-15 21:10:19.666854509 +0000 UTC m=+40.855335067" Jul 15 21:10:19.671262 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:19.671240 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blczl_4d27faf9-6e82-4607-a427-5b391a57e548/konnectivity-agent/0.log" limit=1024 Jul 15 21:10:20.134843 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:20.134801 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blczl_4d27faf9-6e82-4607-a427-5b391a57e548/konnectivity-agent/0.log" limit=1024 Jul 15 21:10:20.194718 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:20.194682 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blczl_4d27faf9-6e82-4607-a427-5b391a57e548/konnectivity-agent/0.log" limit=1024 Jul 15 21:10:22.427832 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:22.427791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:22.427832 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:22.427837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:22.428257 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:22.427932 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:22.428257 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:22.427938 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:22.428257 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:22.427954 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9: secret "image-registry-tls" not found Jul 15 21:10:22.428257 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:22.427984 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls podName:21d9f46f-abef-498e-91ae-e0c813afa9ff nodeName:}" failed. No retries permitted until 2026-07-15 21:10:30.427970406 +0000 UTC m=+51.616450908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls") pod "dns-default-2fgr9" (UID: "21d9f46f-abef-498e-91ae-e0c813afa9ff") : secret "dns-default-metrics-tls" not found Jul 15 21:10:22.428257 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:22.427996 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls podName:8c971c1a-7fac-484d-bc79-65bef4b1e03f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:30.427990699 +0000 UTC m=+51.616471199 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls") pod "image-registry-5d7fdd8bbf-rnqj9" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f") : secret "image-registry-tls" not found Jul 15 21:10:28.520235 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.520202 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6"] Jul 15 21:10:28.564366 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.564333 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7"] Jul 15 21:10:28.564533 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.564449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" Jul 15 21:10:28.567210 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.567184 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 21:10:28.567210 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.567185 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 21:10:28.567408 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.567186 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:28.567408 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.567186 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vlqjh\"" Jul 15 21:10:28.567531 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.567514 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 21:10:28.579957 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.579880 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh"] Jul 15 21:10:28.579957 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.579952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:28.582503 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.582482 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 21:10:28.582642 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.582482 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5bsl5\"" Jul 15 21:10:28.582642 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.582487 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:28.582736 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.582678 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 21:10:28.597887 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.597868 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx"] Jul 15 21:10:28.597995 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.597978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" Jul 15 21:10:28.600786 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.600766 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 21:10:28.600903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.600766 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 21:10:28.600903 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.600774 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 21:10:28.601020 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.600901 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dnn2v\"" Jul 15 21:10:28.601215 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.601199 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:28.622269 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.622240 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6pnfg"] Jul 15 21:10:28.622469 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.622420 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:28.624948 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.624925 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 21:10:28.625830 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.625812 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d5nvr\"" Jul 15 21:10:28.626656 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.626576 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 21:10:28.630117 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.628701 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 21:10:28.630117 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.629745 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 21:10:28.639691 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.639670 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6pnfg"] Jul 15 21:10:28.639691 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.639698 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6"] Jul 15 21:10:28.639831 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.639712 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx"] Jul 15 21:10:28.639831 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.639730 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7"] Jul 15 21:10:28.639831 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.639747 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh"] Jul 15 21:10:28.639831 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.639804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.639969 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.639839 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lvb26"] Jul 15 21:10:28.642262 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.642239 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 21:10:28.642376 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.642298 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 21:10:28.642629 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.642611 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4kqtj\"" Jul 15 21:10:28.642882 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.642864 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 21:10:28.642959 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.642945 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 21:10:28.647566 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.647549 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 21:10:28.659879 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.659858 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5bc5f88888-2px5d"] Jul 15 21:10:28.659996 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.659981 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lvb26" Jul 15 21:10:28.662557 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.662541 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:28.662661 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.662556 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 21:10:28.662838 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.662825 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-sng78\"" Jul 15 21:10:28.673833 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.673811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-stjm7\" (UID: \"47fef52e-e97b-4baf-9da3-ec911d1995a8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:28.673944 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.673842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de413493-569c-4559-a915-24f958922892-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-cbrf6\" (UID: \"de413493-569c-4559-a915-24f958922892\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" Jul 15 21:10:28.673944 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.673867 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h559\" (UniqueName: \"kubernetes.io/projected/47fef52e-e97b-4baf-9da3-ec911d1995a8-kube-api-access-9h559\") pod \"cluster-samples-operator-65db858894-stjm7\" (UID: \"47fef52e-e97b-4baf-9da3-ec911d1995a8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:28.674083 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.673987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de413493-569c-4559-a915-24f958922892-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-cbrf6\" (UID: \"de413493-569c-4559-a915-24f958922892\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" Jul 15 21:10:28.674083 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.674072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45hnh\" (UniqueName: \"kubernetes.io/projected/de413493-569c-4559-a915-24f958922892-kube-api-access-45hnh\") pod \"kube-storage-version-migrator-operator-799cb7f958-cbrf6\" (UID: \"de413493-569c-4559-a915-24f958922892\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" Jul 15 21:10:28.684073 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.684054 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lvb26"] Jul 15 21:10:28.684179 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.684087 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bc5f88888-2px5d"] Jul 15 21:10:28.684179 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.684147 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.687127 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.687104 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 21:10:28.687257 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.687148 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 21:10:28.687257 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.687188 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 21:10:28.687257 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.687114 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 21:10:28.687654 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.687638 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 21:10:28.687747 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.687641 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 21:10:28.687747 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.687664 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l9rh5\"" Jul 15 21:10:28.775055 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.774947 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.775215 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de413493-569c-4559-a915-24f958922892-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-cbrf6\" (UID: \"de413493-569c-4559-a915-24f958922892\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" Jul 15 21:10:28.775215 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjclb\" (UniqueName: \"kubernetes.io/projected/69bd13d1-c703-4ab9-87f6-298e59f1ffac-kube-api-access-qjclb\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:28.775333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba5075a3-2701-42ca-94a4-506afa04f56e-config\") pod \"service-ca-operator-7695fc6c8c-wz2zh\" (UID: \"ba5075a3-2701-42ca-94a4-506afa04f56e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" Jul 15 21:10:28.775333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-tmp\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.775333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/69bd13d1-c703-4ab9-87f6-298e59f1ffac-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:28.775333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktlzd\" (UniqueName: \"kubernetes.io/projected/c6c1958d-9088-4d84-8dee-81facd159ee8-kube-api-access-ktlzd\") pod \"volume-data-source-validator-78495597f6-lvb26\" (UID: \"c6c1958d-9088-4d84-8dee-81facd159ee8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lvb26" Jul 15 21:10:28.775526 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de413493-569c-4559-a915-24f958922892-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-cbrf6\" (UID: \"de413493-569c-4559-a915-24f958922892\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" Jul 15 21:10:28.775526 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h559\" (UniqueName: \"kubernetes.io/projected/47fef52e-e97b-4baf-9da3-ec911d1995a8-kube-api-access-9h559\") pod \"cluster-samples-operator-65db858894-stjm7\" (UID: \"47fef52e-e97b-4baf-9da3-ec911d1995a8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:28.775526 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-snapshots\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.775526 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba5075a3-2701-42ca-94a4-506afa04f56e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-wz2zh\" (UID: \"ba5075a3-2701-42ca-94a4-506afa04f56e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" Jul 15 21:10:28.775526 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-serving-cert\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.775526 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:28.775804 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45hnh\" (UniqueName: \"kubernetes.io/projected/de413493-569c-4559-a915-24f958922892-kube-api-access-45hnh\") pod \"kube-storage-version-migrator-operator-799cb7f958-cbrf6\" (UID: \"de413493-569c-4559-a915-24f958922892\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" Jul 15 21:10:28.775804 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6wws\" (UniqueName: \"kubernetes.io/projected/ba5075a3-2701-42ca-94a4-506afa04f56e-kube-api-access-k6wws\") pod \"service-ca-operator-7695fc6c8c-wz2zh\" (UID: \"ba5075a3-2701-42ca-94a4-506afa04f56e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" Jul 15 21:10:28.775804 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4jtf\" (UniqueName: \"kubernetes.io/projected/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-kube-api-access-b4jtf\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.775804 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.775804 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-stjm7\" (UID: \"47fef52e-e97b-4baf-9da3-ec911d1995a8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:28.775998 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.775826 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de413493-569c-4559-a915-24f958922892-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-cbrf6\" (UID: \"de413493-569c-4559-a915-24f958922892\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" Jul 15 21:10:28.775998 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:28.775866 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 21:10:28.775998 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:28.775929 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls podName:47fef52e-e97b-4baf-9da3-ec911d1995a8 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:29.275914677 +0000 UTC m=+50.464395177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls") pod "cluster-samples-operator-65db858894-stjm7" (UID: "47fef52e-e97b-4baf-9da3-ec911d1995a8") : secret "samples-operator-tls" not found Jul 15 21:10:28.778846 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.778826 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de413493-569c-4559-a915-24f958922892-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-cbrf6\" (UID: \"de413493-569c-4559-a915-24f958922892\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" Jul 15 21:10:28.787016 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.786994 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45hnh\" (UniqueName: \"kubernetes.io/projected/de413493-569c-4559-a915-24f958922892-kube-api-access-45hnh\") pod \"kube-storage-version-migrator-operator-799cb7f958-cbrf6\" (UID: \"de413493-569c-4559-a915-24f958922892\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" Jul 15 21:10:28.787293 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.787273 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h559\" (UniqueName: \"kubernetes.io/projected/47fef52e-e97b-4baf-9da3-ec911d1995a8-kube-api-access-9h559\") pod \"cluster-samples-operator-65db858894-stjm7\" (UID: \"47fef52e-e97b-4baf-9da3-ec911d1995a8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:28.792173 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.792148 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blczl_4d27faf9-6e82-4607-a427-5b391a57e548/konnectivity-agent/0.log" limit=1024 Jul 15 21:10:28.873420 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.873380 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" Jul 15 21:10:28.876716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.876693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba5075a3-2701-42ca-94a4-506afa04f56e-config\") pod \"service-ca-operator-7695fc6c8c-wz2zh\" (UID: \"ba5075a3-2701-42ca-94a4-506afa04f56e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" Jul 15 21:10:28.876784 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.876727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-tmp\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.876784 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.876752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/69bd13d1-c703-4ab9-87f6-298e59f1ffac-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:28.876855 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.876796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktlzd\" (UniqueName: \"kubernetes.io/projected/c6c1958d-9088-4d84-8dee-81facd159ee8-kube-api-access-ktlzd\") pod \"volume-data-source-validator-78495597f6-lvb26\" (UID: \"c6c1958d-9088-4d84-8dee-81facd159ee8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lvb26" Jul 15 21:10:28.876936 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.876914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.876992 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.876972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-snapshots\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.877045 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-default-certificate\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.877099 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-stats-auth\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.877151 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.877151 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba5075a3-2701-42ca-94a4-506afa04f56e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-wz2zh\" (UID: \"ba5075a3-2701-42ca-94a4-506afa04f56e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" Jul 15 21:10:28.877151 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877140 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-tmp\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.877269 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-serving-cert\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.877269 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:28.877269 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6wws\" (UniqueName: \"kubernetes.io/projected/ba5075a3-2701-42ca-94a4-506afa04f56e-kube-api-access-k6wws\") pod \"service-ca-operator-7695fc6c8c-wz2zh\" (UID: \"ba5075a3-2701-42ca-94a4-506afa04f56e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" Jul 15 21:10:28.877269 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld5cp\" (UniqueName: \"kubernetes.io/projected/11455e3b-a5e4-4885-b34a-7726f892fa13-kube-api-access-ld5cp\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.877451 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4jtf\" (UniqueName: \"kubernetes.io/projected/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-kube-api-access-b4jtf\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.877451 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:28.877316 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:28.877451 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.877451 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:28.877389 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls podName:69bd13d1-c703-4ab9-87f6-298e59f1ffac nodeName:}" failed. No retries permitted until 2026-07-15 21:10:29.377369393 +0000 UTC m=+50.565849907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-84hfx" (UID: "69bd13d1-c703-4ab9-87f6-298e59f1ffac") : secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:28.877451 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877391 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba5075a3-2701-42ca-94a4-506afa04f56e-config\") pod \"service-ca-operator-7695fc6c8c-wz2zh\" (UID: \"ba5075a3-2701-42ca-94a4-506afa04f56e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" Jul 15 21:10:28.877451 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.877722 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjclb\" (UniqueName: \"kubernetes.io/projected/69bd13d1-c703-4ab9-87f6-298e59f1ffac-kube-api-access-qjclb\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:28.877722 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877590 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/69bd13d1-c703-4ab9-87f6-298e59f1ffac-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:28.877722 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.877626 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-snapshots\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.878160 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.878137 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.878219 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.878196 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.879424 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.879406 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba5075a3-2701-42ca-94a4-506afa04f56e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-wz2zh\" (UID: \"ba5075a3-2701-42ca-94a4-506afa04f56e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" Jul 15 21:10:28.879521 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.879483 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-serving-cert\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.891004 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.890980 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6wws\" (UniqueName: \"kubernetes.io/projected/ba5075a3-2701-42ca-94a4-506afa04f56e-kube-api-access-k6wws\") pod \"service-ca-operator-7695fc6c8c-wz2zh\" (UID: \"ba5075a3-2701-42ca-94a4-506afa04f56e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" Jul 15 21:10:28.891558 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.891536 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4jtf\" (UniqueName: \"kubernetes.io/projected/d660a20e-f03a-44f9-b1c5-e94bb77d0e3e-kube-api-access-b4jtf\") pod \"insights-operator-68d9dd94cf-6pnfg\" (UID: \"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.894149 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.894130 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjclb\" (UniqueName: \"kubernetes.io/projected/69bd13d1-c703-4ab9-87f6-298e59f1ffac-kube-api-access-qjclb\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:28.895979 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.895959 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktlzd\" (UniqueName: \"kubernetes.io/projected/c6c1958d-9088-4d84-8dee-81facd159ee8-kube-api-access-ktlzd\") pod \"volume-data-source-validator-78495597f6-lvb26\" (UID: \"c6c1958d-9088-4d84-8dee-81facd159ee8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lvb26" Jul 15 21:10:28.898101 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.898074 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blczl_4d27faf9-6e82-4607-a427-5b391a57e548/konnectivity-agent/0.log" limit=1024 Jul 15 21:10:28.906125 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.906100 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" Jul 15 21:10:28.949458 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.949435 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" Jul 15 21:10:28.968519 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.968492 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lvb26" Jul 15 21:10:28.978864 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.977868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-default-certificate\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.978864 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.977929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-stats-auth\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.978864 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.977962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.978864 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.978010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld5cp\" (UniqueName: \"kubernetes.io/projected/11455e3b-a5e4-4885-b34a-7726f892fa13-kube-api-access-ld5cp\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.978864 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.978181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.978864 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:28.978309 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 21:10:28.978864 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:28.978376 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs podName:11455e3b-a5e4-4885-b34a-7726f892fa13 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:29.478356151 +0000 UTC m=+50.666836671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs") pod "router-default-5bc5f88888-2px5d" (UID: "11455e3b-a5e4-4885-b34a-7726f892fa13") : secret "router-metrics-certs-default" not found Jul 15 21:10:28.979390 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:28.979117 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle podName:11455e3b-a5e4-4885-b34a-7726f892fa13 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:29.479097057 +0000 UTC m=+50.667577557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle") pod "router-default-5bc5f88888-2px5d" (UID: "11455e3b-a5e4-4885-b34a-7726f892fa13") : configmap references non-existent config key: service-ca.crt Jul 15 21:10:28.981699 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.981608 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-default-certificate\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.981699 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.981659 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-stats-auth\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:28.991334 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:28.991270 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld5cp\" (UniqueName: \"kubernetes.io/projected/11455e3b-a5e4-4885-b34a-7726f892fa13-kube-api-access-ld5cp\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:29.015243 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.004998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blczl_4d27faf9-6e82-4607-a427-5b391a57e548/konnectivity-agent/0.log" limit=1024 Jul 15 21:10:29.048135 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.048043 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6"] Jul 15 21:10:29.055544 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:29.055494 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde413493_569c_4559_a915_24f958922892.slice/crio-89c4c58686b4dacb4ea15efd2d165b42a9dcef39fc67f4fd0ab28552204d71be WatchSource:0}: Error finding container 89c4c58686b4dacb4ea15efd2d165b42a9dcef39fc67f4fd0ab28552204d71be: Status 404 returned error can't find the container with id 89c4c58686b4dacb4ea15efd2d165b42a9dcef39fc67f4fd0ab28552204d71be Jul 15 21:10:29.107248 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.107191 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh"] Jul 15 21:10:29.110543 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:29.110512 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5075a3_2701_42ca_94a4_506afa04f56e.slice/crio-28a1c589c05e9c2845b1c0c11545b19ac6bc842e1d45dbcfbf56036f626f2ce0 WatchSource:0}: Error finding container 28a1c589c05e9c2845b1c0c11545b19ac6bc842e1d45dbcfbf56036f626f2ce0: Status 404 returned error can't find the container with id 28a1c589c05e9c2845b1c0c11545b19ac6bc842e1d45dbcfbf56036f626f2ce0 Jul 15 21:10:29.145786 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.145758 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6pnfg"] Jul 15 21:10:29.148811 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:29.148787 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd660a20e_f03a_44f9_b1c5_e94bb77d0e3e.slice/crio-79aea6aa57709cf280903e604a001d43b8e52792015df45eb643d8ca2f2f821d WatchSource:0}: Error finding container 79aea6aa57709cf280903e604a001d43b8e52792015df45eb643d8ca2f2f821d: Status 404 returned error can't find the container with id 79aea6aa57709cf280903e604a001d43b8e52792015df45eb643d8ca2f2f821d Jul 15 21:10:29.159749 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.159728 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lvb26"] Jul 15 21:10:29.162575 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:29.162548 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c1958d_9088_4d84_8dee_81facd159ee8.slice/crio-0370c9b572a9db2210a1f2dd0d17769547b5be0fc009cdb1f42f43434602e23d WatchSource:0}: Error finding container 0370c9b572a9db2210a1f2dd0d17769547b5be0fc009cdb1f42f43434602e23d: Status 404 returned error can't find the container with id 0370c9b572a9db2210a1f2dd0d17769547b5be0fc009cdb1f42f43434602e23d Jul 15 21:10:29.281646 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.281544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-stjm7\" (UID: \"47fef52e-e97b-4baf-9da3-ec911d1995a8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:29.284618 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:29.281794 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 21:10:29.284618 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:29.281892 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls podName:47fef52e-e97b-4baf-9da3-ec911d1995a8 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:30.281866234 +0000 UTC m=+51.470346737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls") pod "cluster-samples-operator-65db858894-stjm7" (UID: "47fef52e-e97b-4baf-9da3-ec911d1995a8") : secret "samples-operator-tls" not found Jul 15 21:10:29.382975 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.382932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:29.383176 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:29.383076 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:29.383176 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:29.383132 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls podName:69bd13d1-c703-4ab9-87f6-298e59f1ffac nodeName:}" failed. No retries permitted until 2026-07-15 21:10:30.383117177 +0000 UTC m=+51.571597678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-84hfx" (UID: "69bd13d1-c703-4ab9-87f6-298e59f1ffac") : secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:29.484151 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.484110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:29.484298 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.484169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:29.484298 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:29.484272 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle podName:11455e3b-a5e4-4885-b34a-7726f892fa13 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:30.484255634 +0000 UTC m=+51.672736134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle") pod "router-default-5bc5f88888-2px5d" (UID: "11455e3b-a5e4-4885-b34a-7726f892fa13") : configmap references non-existent config key: service-ca.crt Jul 15 21:10:29.484298 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:29.484271 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 21:10:29.484417 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:29.484333 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs podName:11455e3b-a5e4-4885-b34a-7726f892fa13 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:30.484316341 +0000 UTC m=+51.672796844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs") pod "router-default-5bc5f88888-2px5d" (UID: "11455e3b-a5e4-4885-b34a-7726f892fa13") : secret "router-metrics-certs-default" not found Jul 15 21:10:29.533446 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.533365 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-bc8kx"] Jul 15 21:10:29.543639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.543613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.546813 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.546786 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:29.546942 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.546859 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 21:10:29.546942 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.546877 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-csrxv\"" Jul 15 21:10:29.547079 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.546965 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 21:10:29.547141 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.547122 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 21:10:29.554292 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.554263 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-bc8kx"] Jul 15 21:10:29.554600 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.554500 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 21:10:29.672539 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.672465 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lvb26" event={"ID":"c6c1958d-9088-4d84-8dee-81facd159ee8","Type":"ContainerStarted","Data":"0370c9b572a9db2210a1f2dd0d17769547b5be0fc009cdb1f42f43434602e23d"} Jul 15 21:10:29.674497 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.674470 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" event={"ID":"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e","Type":"ContainerStarted","Data":"79aea6aa57709cf280903e604a001d43b8e52792015df45eb643d8ca2f2f821d"} Jul 15 21:10:29.675763 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.675708 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" event={"ID":"de413493-569c-4559-a915-24f958922892","Type":"ContainerStarted","Data":"89c4c58686b4dacb4ea15efd2d165b42a9dcef39fc67f4fd0ab28552204d71be"} Jul 15 21:10:29.677518 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.677494 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" event={"ID":"ba5075a3-2701-42ca-94a4-506afa04f56e","Type":"ContainerStarted","Data":"28a1c589c05e9c2845b1c0c11545b19ac6bc842e1d45dbcfbf56036f626f2ce0"} Jul 15 21:10:29.687123 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.687094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6426605a-7777-443e-9cd5-474ad2c118a2-serving-cert\") pod \"console-operator-7866497494-bc8kx\" (UID: \"6426605a-7777-443e-9cd5-474ad2c118a2\") " pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.687276 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.687137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6426605a-7777-443e-9cd5-474ad2c118a2-config\") pod \"console-operator-7866497494-bc8kx\" (UID: \"6426605a-7777-443e-9cd5-474ad2c118a2\") " pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.687276 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.687241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6426605a-7777-443e-9cd5-474ad2c118a2-trusted-ca\") pod \"console-operator-7866497494-bc8kx\" (UID: \"6426605a-7777-443e-9cd5-474ad2c118a2\") " pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.687387 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.687337 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7nl6\" (UniqueName: \"kubernetes.io/projected/6426605a-7777-443e-9cd5-474ad2c118a2-kube-api-access-q7nl6\") pod \"console-operator-7866497494-bc8kx\" (UID: \"6426605a-7777-443e-9cd5-474ad2c118a2\") " pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.788638 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.788559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6426605a-7777-443e-9cd5-474ad2c118a2-trusted-ca\") pod \"console-operator-7866497494-bc8kx\" (UID: \"6426605a-7777-443e-9cd5-474ad2c118a2\") " pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.788638 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.788635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7nl6\" (UniqueName: \"kubernetes.io/projected/6426605a-7777-443e-9cd5-474ad2c118a2-kube-api-access-q7nl6\") pod \"console-operator-7866497494-bc8kx\" (UID: \"6426605a-7777-443e-9cd5-474ad2c118a2\") " pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.788834 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.788738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6426605a-7777-443e-9cd5-474ad2c118a2-serving-cert\") pod \"console-operator-7866497494-bc8kx\" (UID: \"6426605a-7777-443e-9cd5-474ad2c118a2\") " pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.788834 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.788775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6426605a-7777-443e-9cd5-474ad2c118a2-config\") pod \"console-operator-7866497494-bc8kx\" (UID: \"6426605a-7777-443e-9cd5-474ad2c118a2\") " pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.789618 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.789590 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6426605a-7777-443e-9cd5-474ad2c118a2-config\") pod \"console-operator-7866497494-bc8kx\" (UID: \"6426605a-7777-443e-9cd5-474ad2c118a2\") " pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.790492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.790464 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6426605a-7777-443e-9cd5-474ad2c118a2-trusted-ca\") pod \"console-operator-7866497494-bc8kx\" (UID: \"6426605a-7777-443e-9cd5-474ad2c118a2\") " pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.793060 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.793018 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6426605a-7777-443e-9cd5-474ad2c118a2-serving-cert\") pod \"console-operator-7866497494-bc8kx\" (UID: \"6426605a-7777-443e-9cd5-474ad2c118a2\") " pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.808228 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.808111 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7nl6\" (UniqueName: \"kubernetes.io/projected/6426605a-7777-443e-9cd5-474ad2c118a2-kube-api-access-q7nl6\") pod \"console-operator-7866497494-bc8kx\" (UID: \"6426605a-7777-443e-9cd5-474ad2c118a2\") " pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:29.855821 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:29.855585 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:30.052299 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:30.052174 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-bc8kx"] Jul 15 21:10:30.069742 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:30.069696 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6426605a_7777_443e_9cd5_474ad2c118a2.slice/crio-ad74775f78d13ddd23d942c55087bcd097a9569492550b6833536aaab41a1039 WatchSource:0}: Error finding container ad74775f78d13ddd23d942c55087bcd097a9569492550b6833536aaab41a1039: Status 404 returned error can't find the container with id ad74775f78d13ddd23d942c55087bcd097a9569492550b6833536aaab41a1039 Jul 15 21:10:30.293886 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:30.293848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-stjm7\" (UID: \"47fef52e-e97b-4baf-9da3-ec911d1995a8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:30.294207 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:30.294188 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 21:10:30.294294 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:30.294264 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls podName:47fef52e-e97b-4baf-9da3-ec911d1995a8 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:32.294243959 +0000 UTC m=+53.482724483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls") pod "cluster-samples-operator-65db858894-stjm7" (UID: "47fef52e-e97b-4baf-9da3-ec911d1995a8") : secret "samples-operator-tls" not found Jul 15 21:10:30.395148 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:30.395104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:30.395419 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:30.395403 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:30.395488 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:30.395476 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls podName:69bd13d1-c703-4ab9-87f6-298e59f1ffac nodeName:}" failed. No retries permitted until 2026-07-15 21:10:32.395454711 +0000 UTC m=+53.583935214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-84hfx" (UID: "69bd13d1-c703-4ab9-87f6-298e59f1ffac") : secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:30.496183 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:30.496148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:30.496358 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:30.496207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:30.496358 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:30.496278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:30.496358 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:30.496296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:30.496358 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:30.496314 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 21:10:30.496541 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:30.496381 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 21:10:30.496541 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:30.496388 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 21:10:30.496541 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:30.496396 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9: secret "image-registry-tls" not found Jul 15 21:10:30.496541 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:30.496392 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs podName:11455e3b-a5e4-4885-b34a-7726f892fa13 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:32.496372512 +0000 UTC m=+53.684853040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs") pod "router-default-5bc5f88888-2px5d" (UID: "11455e3b-a5e4-4885-b34a-7726f892fa13") : secret "router-metrics-certs-default" not found Jul 15 21:10:30.496541 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:30.496442 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle podName:11455e3b-a5e4-4885-b34a-7726f892fa13 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:32.496426565 +0000 UTC m=+53.684907081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle") pod "router-default-5bc5f88888-2px5d" (UID: "11455e3b-a5e4-4885-b34a-7726f892fa13") : configmap references non-existent config key: service-ca.crt Jul 15 21:10:30.496541 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:30.496457 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls podName:21d9f46f-abef-498e-91ae-e0c813afa9ff nodeName:}" failed. No retries permitted until 2026-07-15 21:10:46.496448121 +0000 UTC m=+67.684928626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls") pod "dns-default-2fgr9" (UID: "21d9f46f-abef-498e-91ae-e0c813afa9ff") : secret "dns-default-metrics-tls" not found Jul 15 21:10:30.496541 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:30.496472 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls podName:8c971c1a-7fac-484d-bc79-65bef4b1e03f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:46.496462323 +0000 UTC m=+67.684942829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls") pod "image-registry-5d7fdd8bbf-rnqj9" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f") : secret "image-registry-tls" not found Jul 15 21:10:30.684791 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:30.684682 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bc8kx" event={"ID":"6426605a-7777-443e-9cd5-474ad2c118a2","Type":"ContainerStarted","Data":"ad74775f78d13ddd23d942c55087bcd097a9569492550b6833536aaab41a1039"} Jul 15 21:10:32.311498 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:32.311455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-stjm7\" (UID: \"47fef52e-e97b-4baf-9da3-ec911d1995a8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:32.311860 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:32.311608 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 21:10:32.311860 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:32.311677 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls podName:47fef52e-e97b-4baf-9da3-ec911d1995a8 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:36.31165924 +0000 UTC m=+57.500139739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls") pod "cluster-samples-operator-65db858894-stjm7" (UID: "47fef52e-e97b-4baf-9da3-ec911d1995a8") : secret "samples-operator-tls" not found Jul 15 21:10:32.413074 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:32.413010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:32.413219 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:32.413152 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:32.413219 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:32.413213 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls podName:69bd13d1-c703-4ab9-87f6-298e59f1ffac nodeName:}" failed. No retries permitted until 2026-07-15 21:10:36.413196565 +0000 UTC m=+57.601677065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-84hfx" (UID: "69bd13d1-c703-4ab9-87f6-298e59f1ffac") : secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:32.513508 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:32.513464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:32.513647 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:32.513520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:32.513647 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:32.513620 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 21:10:32.513647 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:32.513643 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle podName:11455e3b-a5e4-4885-b34a-7726f892fa13 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:36.513629584 +0000 UTC m=+57.702110087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle") pod "router-default-5bc5f88888-2px5d" (UID: "11455e3b-a5e4-4885-b34a-7726f892fa13") : configmap references non-existent config key: service-ca.crt Jul 15 21:10:32.513769 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:32.513686 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs podName:11455e3b-a5e4-4885-b34a-7726f892fa13 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:36.513670874 +0000 UTC m=+57.702151379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs") pod "router-default-5bc5f88888-2px5d" (UID: "11455e3b-a5e4-4885-b34a-7726f892fa13") : secret "router-metrics-certs-default" not found Jul 15 21:10:34.514788 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.514696 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-c9zm4"] Jul 15 21:10:34.516792 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.516774 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-c9zm4" Jul 15 21:10:34.519176 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.519151 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-55tfp\"" Jul 15 21:10:34.530249 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.530224 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-c9zm4"] Jul 15 21:10:34.532380 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.532361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf4hf\" (UniqueName: \"kubernetes.io/projected/4df820d3-ed13-47f3-a9c4-52b382cb0173-kube-api-access-mf4hf\") pod \"network-check-source-869dcfcdcd-c9zm4\" (UID: \"4df820d3-ed13-47f3-a9c4-52b382cb0173\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-c9zm4" Jul 15 21:10:34.633175 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.633131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf4hf\" (UniqueName: \"kubernetes.io/projected/4df820d3-ed13-47f3-a9c4-52b382cb0173-kube-api-access-mf4hf\") pod \"network-check-source-869dcfcdcd-c9zm4\" (UID: \"4df820d3-ed13-47f3-a9c4-52b382cb0173\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-c9zm4" Jul 15 21:10:34.642729 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.642700 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf4hf\" (UniqueName: \"kubernetes.io/projected/4df820d3-ed13-47f3-a9c4-52b382cb0173-kube-api-access-mf4hf\") pod \"network-check-source-869dcfcdcd-c9zm4\" (UID: \"4df820d3-ed13-47f3-a9c4-52b382cb0173\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-c9zm4" Jul 15 21:10:34.698471 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.698439 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" event={"ID":"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e","Type":"ContainerStarted","Data":"1533c8c0232704f04ee0cd63f5d4683b4c5c241116e9ea6e4c772f2b07b7881f"} Jul 15 21:10:34.700097 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.700068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" event={"ID":"de413493-569c-4559-a915-24f958922892","Type":"ContainerStarted","Data":"91a0000092354ad3969021da466620b82113694b3ad729afbc12881218b258f2"} Jul 15 21:10:34.701789 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.701770 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/0.log" Jul 15 21:10:34.701895 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.701804 2578 generic.go:356] "Generic (PLEG): container finished" podID="6426605a-7777-443e-9cd5-474ad2c118a2" containerID="122e8e6176b514d66b98aef45bc25f20019d3e381c7d8a52aebb859c2450fda3" exitCode=255 Jul 15 21:10:34.701895 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.701849 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bc8kx" event={"ID":"6426605a-7777-443e-9cd5-474ad2c118a2","Type":"ContainerDied","Data":"122e8e6176b514d66b98aef45bc25f20019d3e381c7d8a52aebb859c2450fda3"} Jul 15 21:10:34.702121 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.702100 2578 scope.go:117] "RemoveContainer" containerID="122e8e6176b514d66b98aef45bc25f20019d3e381c7d8a52aebb859c2450fda3" Jul 15 21:10:34.703771 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.703750 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" event={"ID":"ba5075a3-2701-42ca-94a4-506afa04f56e","Type":"ContainerStarted","Data":"9a1cb1bc060dfd116130a151ef679801172efd6d510263dcd549387ceec98038"} Jul 15 21:10:34.705362 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.705340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lvb26" event={"ID":"c6c1958d-9088-4d84-8dee-81facd159ee8","Type":"ContainerStarted","Data":"3af88df8c755aa2aa280331af91506f40dade853ca1709046f965075a0a3cf36"} Jul 15 21:10:34.717392 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.717325 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" podStartSLOduration=1.7405920209999999 podStartE2EDuration="6.717306582s" totalImagesPullingTime="4.976714561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:34.715997864 +0000 UTC m=+55.904478388" watchObservedRunningTime="2026-07-15 21:10:34.717306582 +0000 UTC m=+55.905787106" Jul 15 21:10:34.738525 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.738468 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" podStartSLOduration=1.6698108139999999 podStartE2EDuration="6.738446144s" totalImagesPullingTime="5.06863533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:34.736940799 +0000 UTC m=+55.925421326" watchObservedRunningTime="2026-07-15 21:10:34.738446144 +0000 UTC m=+55.926926669" Jul 15 21:10:34.754162 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.754115 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lvb26" podStartSLOduration=1.791631416 podStartE2EDuration="6.754093908s" totalImagesPullingTime="4.962462492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:34.753885775 +0000 UTC m=+55.942366298" watchObservedRunningTime="2026-07-15 21:10:34.754093908 +0000 UTC m=+55.942574432" Jul 15 21:10:34.804918 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.804865 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" podStartSLOduration=1.790713591 podStartE2EDuration="6.804846943s" totalImagesPullingTime="5.014133352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:34.803492349 +0000 UTC m=+55.991972871" watchObservedRunningTime="2026-07-15 21:10:34.804846943 +0000 UTC m=+55.993327465" Jul 15 21:10:34.826008 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.825975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-c9zm4" Jul 15 21:10:34.968283 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:34.968110 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-c9zm4"] Jul 15 21:10:34.970710 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:34.970683 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df820d3_ed13_47f3_a9c4_52b382cb0173.slice/crio-4cbed62456ca732fac52fe4e6d14e192f8e8d46f8ce3efc6347fc7ede2ca3ff8 WatchSource:0}: Error finding container 4cbed62456ca732fac52fe4e6d14e192f8e8d46f8ce3efc6347fc7ede2ca3ff8: Status 404 returned error can't find the container with id 4cbed62456ca732fac52fe4e6d14e192f8e8d46f8ce3efc6347fc7ede2ca3ff8 Jul 15 21:10:35.714834 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.714750 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-c9zm4" event={"ID":"4df820d3-ed13-47f3-a9c4-52b382cb0173","Type":"ContainerStarted","Data":"4cbed62456ca732fac52fe4e6d14e192f8e8d46f8ce3efc6347fc7ede2ca3ff8"} Jul 15 21:10:35.721560 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.718360 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:10:35.721560 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.718892 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/0.log" Jul 15 21:10:35.721560 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.718924 2578 generic.go:356] "Generic (PLEG): container finished" podID="6426605a-7777-443e-9cd5-474ad2c118a2" containerID="2f31b032992299bd239739df1ff1351bc3e94eed6d211d167182da9111e16a45" exitCode=255 Jul 15 21:10:35.721560 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.719806 2578 scope.go:117] "RemoveContainer" containerID="2f31b032992299bd239739df1ff1351bc3e94eed6d211d167182da9111e16a45" Jul 15 21:10:35.721560 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:35.719965 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-bc8kx_openshift-console-operator(6426605a-7777-443e-9cd5-474ad2c118a2)\"" pod="openshift-console-operator/console-operator-7866497494-bc8kx" podUID="6426605a-7777-443e-9cd5-474ad2c118a2" Jul 15 21:10:35.721560 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.720231 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bc8kx" event={"ID":"6426605a-7777-443e-9cd5-474ad2c118a2","Type":"ContainerDied","Data":"2f31b032992299bd239739df1ff1351bc3e94eed6d211d167182da9111e16a45"} Jul 15 21:10:35.721560 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.720296 2578 scope.go:117] "RemoveContainer" containerID="122e8e6176b514d66b98aef45bc25f20019d3e381c7d8a52aebb859c2450fda3" Jul 15 21:10:35.747302 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.747256 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rk9tw"] Jul 15 21:10:35.753283 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.753256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.756556 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.756121 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 21:10:35.756556 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.756205 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8zghz\"" Jul 15 21:10:35.757517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.757491 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 21:10:35.767521 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.767493 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rk9tw"] Jul 15 21:10:35.847164 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.847128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6gl8\" (UniqueName: \"kubernetes.io/projected/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-api-access-g6gl8\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.847350 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.847201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa4043d2-3da2-4780-b4bc-cea7277b018f-crio-socket\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.847350 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.847230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.847350 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.847259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.847350 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.847302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa4043d2-3da2-4780-b4bc-cea7277b018f-data-volume\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.947979 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.947947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6gl8\" (UniqueName: \"kubernetes.io/projected/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-api-access-g6gl8\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.948189 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.948007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa4043d2-3da2-4780-b4bc-cea7277b018f-crio-socket\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.948189 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.948085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.948189 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.948122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.948189 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.948159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa4043d2-3da2-4780-b4bc-cea7277b018f-data-volume\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.948404 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.948300 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa4043d2-3da2-4780-b4bc-cea7277b018f-crio-socket\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.948404 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:35.948376 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:35.948404 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:35.948381 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:35.948532 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:35.948433 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm podName:fa4043d2-3da2-4780-b4bc-cea7277b018f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:36.448413097 +0000 UTC m=+57.636893601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rk9tw" (UID: "fa4043d2-3da2-4780-b4bc-cea7277b018f") : configmap "kube-rbac-proxy" not found Jul 15 21:10:35.948532 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:35.948454 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls podName:fa4043d2-3da2-4780-b4bc-cea7277b018f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:36.448442152 +0000 UTC m=+57.636922655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rk9tw" (UID: "fa4043d2-3da2-4780-b4bc-cea7277b018f") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:35.948635 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.948600 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa4043d2-3da2-4780-b4bc-cea7277b018f-data-volume\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:35.957847 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:35.957818 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6gl8\" (UniqueName: \"kubernetes.io/projected/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-api-access-g6gl8\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:36.353284 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:36.353242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-stjm7\" (UID: \"47fef52e-e97b-4baf-9da3-ec911d1995a8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:36.353483 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:36.353391 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 21:10:36.353483 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:36.353473 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls podName:47fef52e-e97b-4baf-9da3-ec911d1995a8 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.353451613 +0000 UTC m=+65.541932115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls") pod "cluster-samples-operator-65db858894-stjm7" (UID: "47fef52e-e97b-4baf-9da3-ec911d1995a8") : secret "samples-operator-tls" not found Jul 15 21:10:36.454242 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:36.454201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:36.454435 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:36.454276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:36.454435 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:36.454315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:36.454435 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:36.454372 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:36.454435 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:36.454423 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:36.454609 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:36.454437 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:36.454609 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:36.454451 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls podName:69bd13d1-c703-4ab9-87f6-298e59f1ffac nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.454429559 +0000 UTC m=+65.642910085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-84hfx" (UID: "69bd13d1-c703-4ab9-87f6-298e59f1ffac") : secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:36.454609 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:36.454469 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls podName:fa4043d2-3da2-4780-b4bc-cea7277b018f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:37.454460236 +0000 UTC m=+58.642940737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rk9tw" (UID: "fa4043d2-3da2-4780-b4bc-cea7277b018f") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:36.454609 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:36.454495 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm podName:fa4043d2-3da2-4780-b4bc-cea7277b018f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:37.454477334 +0000 UTC m=+58.642957835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rk9tw" (UID: "fa4043d2-3da2-4780-b4bc-cea7277b018f") : configmap "kube-rbac-proxy" not found Jul 15 21:10:36.555302 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:36.555258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:36.555493 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:36.555330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:36.555493 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:36.555440 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 21:10:36.555493 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:36.555493 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle podName:11455e3b-a5e4-4885-b34a-7726f892fa13 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.555473923 +0000 UTC m=+65.743954438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle") pod "router-default-5bc5f88888-2px5d" (UID: "11455e3b-a5e4-4885-b34a-7726f892fa13") : configmap references non-existent config key: service-ca.crt Jul 15 21:10:36.555652 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:36.555514 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs podName:11455e3b-a5e4-4885-b34a-7726f892fa13 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:44.555503899 +0000 UTC m=+65.743984405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs") pod "router-default-5bc5f88888-2px5d" (UID: "11455e3b-a5e4-4885-b34a-7726f892fa13") : secret "router-metrics-certs-default" not found Jul 15 21:10:36.724825 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:36.724794 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:10:36.725333 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:36.725203 2578 scope.go:117] "RemoveContainer" containerID="2f31b032992299bd239739df1ff1351bc3e94eed6d211d167182da9111e16a45" Jul 15 21:10:36.725450 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:36.725410 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-bc8kx_openshift-console-operator(6426605a-7777-443e-9cd5-474ad2c118a2)\"" pod="openshift-console-operator/console-operator-7866497494-bc8kx" podUID="6426605a-7777-443e-9cd5-474ad2c118a2" Jul 15 21:10:36.931882 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:36.931853 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s5mqn_ce9a409f-624e-4213-bc69-c760ed247c6c/dns-node-resolver/0.log" Jul 15 21:10:37.071410 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:37.071329 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rlljz"] Jul 15 21:10:37.074179 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:37.074157 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rlljz" Jul 15 21:10:37.077872 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:37.077844 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:37.077987 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:37.077881 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 15 21:10:37.079125 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:37.079102 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5424g\"" Jul 15 21:10:37.086941 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:37.086915 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rlljz"] Jul 15 21:10:37.163484 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:37.163451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdx7t\" (UniqueName: \"kubernetes.io/projected/734a8d6b-1969-4f11-9b53-fcac166abe33-kube-api-access-cdx7t\") pod \"migrator-7f59b54f6c-rlljz\" (UID: \"734a8d6b-1969-4f11-9b53-fcac166abe33\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rlljz" Jul 15 21:10:37.265072 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:37.265016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdx7t\" (UniqueName: \"kubernetes.io/projected/734a8d6b-1969-4f11-9b53-fcac166abe33-kube-api-access-cdx7t\") pod \"migrator-7f59b54f6c-rlljz\" (UID: \"734a8d6b-1969-4f11-9b53-fcac166abe33\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rlljz" Jul 15 21:10:37.274173 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:37.274141 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdx7t\" (UniqueName: \"kubernetes.io/projected/734a8d6b-1969-4f11-9b53-fcac166abe33-kube-api-access-cdx7t\") pod \"migrator-7f59b54f6c-rlljz\" (UID: \"734a8d6b-1969-4f11-9b53-fcac166abe33\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rlljz" Jul 15 21:10:37.384880 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:37.384846 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rlljz" Jul 15 21:10:37.467523 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:37.467482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:37.467709 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:37.467541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:37.467709 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:37.467672 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:37.467816 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:37.467738 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:37.467816 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:37.467753 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls podName:fa4043d2-3da2-4780-b4bc-cea7277b018f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:39.467729204 +0000 UTC m=+60.656209722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rk9tw" (UID: "fa4043d2-3da2-4780-b4bc-cea7277b018f") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:37.467816 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:37.467793 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm podName:fa4043d2-3da2-4780-b4bc-cea7277b018f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:39.467775245 +0000 UTC m=+60.656255763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rk9tw" (UID: "fa4043d2-3da2-4780-b4bc-cea7277b018f") : configmap "kube-rbac-proxy" not found Jul 15 21:10:38.006624 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.006581 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-hfb97"] Jul 15 21:10:38.008634 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.008613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" Jul 15 21:10:38.011451 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.011272 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 15 21:10:38.011451 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.011273 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 15 21:10:38.012751 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.012724 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7srm8\"" Jul 15 21:10:38.012879 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.012763 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 15 21:10:38.013366 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.013273 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 15 21:10:38.019853 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.019822 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-hfb97"] Jul 15 21:10:38.074076 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.074052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37373edf-c1ae-4307-b65c-3fc8e303fc95-signing-cabundle\") pod \"service-ca-79f68b9f4f-hfb97\" (UID: \"37373edf-c1ae-4307-b65c-3fc8e303fc95\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" Jul 15 21:10:38.074194 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.074158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37373edf-c1ae-4307-b65c-3fc8e303fc95-signing-key\") pod \"service-ca-79f68b9f4f-hfb97\" (UID: \"37373edf-c1ae-4307-b65c-3fc8e303fc95\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" Jul 15 21:10:38.074237 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.074207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fj7v\" (UniqueName: \"kubernetes.io/projected/37373edf-c1ae-4307-b65c-3fc8e303fc95-kube-api-access-6fj7v\") pod \"service-ca-79f68b9f4f-hfb97\" (UID: \"37373edf-c1ae-4307-b65c-3fc8e303fc95\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" Jul 15 21:10:38.138076 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.138052 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wfbd7_fb855b08-480a-4ab2-a350-13c13522a436/node-ca/0.log" Jul 15 21:10:38.146433 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.146410 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rlljz"] Jul 15 21:10:38.148849 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:38.148819 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734a8d6b_1969_4f11_9b53_fcac166abe33.slice/crio-273da75ce1d1db67f2eaa765dc4efe9508480f83cd036639fdf463815f98b047 WatchSource:0}: Error finding container 273da75ce1d1db67f2eaa765dc4efe9508480f83cd036639fdf463815f98b047: Status 404 returned error can't find the container with id 273da75ce1d1db67f2eaa765dc4efe9508480f83cd036639fdf463815f98b047 Jul 15 21:10:38.174713 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.174684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37373edf-c1ae-4307-b65c-3fc8e303fc95-signing-cabundle\") pod \"service-ca-79f68b9f4f-hfb97\" (UID: \"37373edf-c1ae-4307-b65c-3fc8e303fc95\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" Jul 15 21:10:38.174829 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.174751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37373edf-c1ae-4307-b65c-3fc8e303fc95-signing-key\") pod \"service-ca-79f68b9f4f-hfb97\" (UID: \"37373edf-c1ae-4307-b65c-3fc8e303fc95\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" Jul 15 21:10:38.174923 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.174904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fj7v\" (UniqueName: \"kubernetes.io/projected/37373edf-c1ae-4307-b65c-3fc8e303fc95-kube-api-access-6fj7v\") pod \"service-ca-79f68b9f4f-hfb97\" (UID: \"37373edf-c1ae-4307-b65c-3fc8e303fc95\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" Jul 15 21:10:38.175473 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.175453 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37373edf-c1ae-4307-b65c-3fc8e303fc95-signing-cabundle\") pod \"service-ca-79f68b9f4f-hfb97\" (UID: \"37373edf-c1ae-4307-b65c-3fc8e303fc95\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" Jul 15 21:10:38.177138 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.177119 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37373edf-c1ae-4307-b65c-3fc8e303fc95-signing-key\") pod \"service-ca-79f68b9f4f-hfb97\" (UID: \"37373edf-c1ae-4307-b65c-3fc8e303fc95\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" Jul 15 21:10:38.184276 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.184244 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fj7v\" (UniqueName: \"kubernetes.io/projected/37373edf-c1ae-4307-b65c-3fc8e303fc95-kube-api-access-6fj7v\") pod \"service-ca-79f68b9f4f-hfb97\" (UID: \"37373edf-c1ae-4307-b65c-3fc8e303fc95\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" Jul 15 21:10:38.328522 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.328437 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" Jul 15 21:10:38.460921 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.460888 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-hfb97"] Jul 15 21:10:38.463782 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:38.463757 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37373edf_c1ae_4307_b65c_3fc8e303fc95.slice/crio-654dd2facaba845d9c254348acec27fc97990140d13e4919e446a5507b737347 WatchSource:0}: Error finding container 654dd2facaba845d9c254348acec27fc97990140d13e4919e446a5507b737347: Status 404 returned error can't find the container with id 654dd2facaba845d9c254348acec27fc97990140d13e4919e446a5507b737347 Jul 15 21:10:38.533816 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.533790 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n49fs_54819573-6ef6-47f0-8aee-bb199f8f29b3/serve-healthcheck-canary/0.log" Jul 15 21:10:38.739787 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.739361 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-c9zm4" event={"ID":"4df820d3-ed13-47f3-a9c4-52b382cb0173","Type":"ContainerStarted","Data":"88e63c899523d4fdfc8394692ca1a358a6211a0876fb913841027edc9694b377"} Jul 15 21:10:38.740748 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.740723 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rlljz" event={"ID":"734a8d6b-1969-4f11-9b53-fcac166abe33","Type":"ContainerStarted","Data":"273da75ce1d1db67f2eaa765dc4efe9508480f83cd036639fdf463815f98b047"} Jul 15 21:10:38.742284 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.742262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" event={"ID":"37373edf-c1ae-4307-b65c-3fc8e303fc95","Type":"ContainerStarted","Data":"a96170523aace3023599fb0e9232145f9637554206d821c4a68382e84b0ec7e7"} Jul 15 21:10:38.742393 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.742301 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" event={"ID":"37373edf-c1ae-4307-b65c-3fc8e303fc95","Type":"ContainerStarted","Data":"654dd2facaba845d9c254348acec27fc97990140d13e4919e446a5507b737347"} Jul 15 21:10:38.759727 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:38.759543 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-c9zm4" podStartSLOduration=1.685322365 podStartE2EDuration="4.759524917s" totalImagesPullingTime="3.074202552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:38.759292644 +0000 UTC m=+59.947773166" watchObservedRunningTime="2026-07-15 21:10:38.759524917 +0000 UTC m=+59.948005440" Jul 15 21:10:39.488609 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:39.488564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:39.488999 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:39.488619 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:39.488999 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:39.488722 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:39.488999 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:39.488757 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:39.488999 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:39.488801 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls podName:fa4043d2-3da2-4780-b4bc-cea7277b018f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:43.488784101 +0000 UTC m=+64.677264600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rk9tw" (UID: "fa4043d2-3da2-4780-b4bc-cea7277b018f") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:39.488999 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:39.488817 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm podName:fa4043d2-3da2-4780-b4bc-cea7277b018f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:43.488810544 +0000 UTC m=+64.677291044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rk9tw" (UID: "fa4043d2-3da2-4780-b4bc-cea7277b018f") : configmap "kube-rbac-proxy" not found Jul 15 21:10:39.751975 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:39.751935 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rlljz" event={"ID":"734a8d6b-1969-4f11-9b53-fcac166abe33","Type":"ContainerStarted","Data":"8482a12ecfd522734838aac7cdace501cc43a3cdb8836a7753feacc86976feb0"} Jul 15 21:10:39.752179 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:39.751994 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rlljz" event={"ID":"734a8d6b-1969-4f11-9b53-fcac166abe33","Type":"ContainerStarted","Data":"00fe99b231bece5f78c4edc8816541d01a16d07126dfa5fe04dc3e83de0ab001"} Jul 15 21:10:39.774635 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:39.774570 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-hfb97" podStartSLOduration=2.77454714 podStartE2EDuration="2.77454714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:38.778383212 +0000 UTC m=+59.966863737" watchObservedRunningTime="2026-07-15 21:10:39.77454714 +0000 UTC m=+60.963027664" Jul 15 21:10:39.774835 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:39.774784 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rlljz" podStartSLOduration=1.58782483 podStartE2EDuration="2.774775732s" totalImagesPullingTime="1.186950902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:39.773288376 +0000 UTC m=+60.961768900" watchObservedRunningTime="2026-07-15 21:10:39.774775732 +0000 UTC m=+60.963256255" Jul 15 21:10:39.856218 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:39.856180 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:39.856412 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:39.856247 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:39.857114 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:39.857098 2578 scope.go:117] "RemoveContainer" containerID="2f31b032992299bd239739df1ff1351bc3e94eed6d211d167182da9111e16a45" Jul 15 21:10:39.857316 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:39.857294 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-bc8kx_openshift-console-operator(6426605a-7777-443e-9cd5-474ad2c118a2)\"" pod="openshift-console-operator/console-operator-7866497494-bc8kx" podUID="6426605a-7777-443e-9cd5-474ad2c118a2" Jul 15 21:10:40.633382 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:40.633354 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggffq" Jul 15 21:10:43.529827 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:43.529790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:43.529827 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:43.529833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:43.530273 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:43.529940 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 21:10:43.530273 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:43.529952 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 21:10:43.530273 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:43.530006 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls podName:fa4043d2-3da2-4780-b4bc-cea7277b018f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:51.529989634 +0000 UTC m=+72.718470135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rk9tw" (UID: "fa4043d2-3da2-4780-b4bc-cea7277b018f") : secret "insights-runtime-extractor-tls" not found Jul 15 21:10:43.530273 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:43.530022 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm podName:fa4043d2-3da2-4780-b4bc-cea7277b018f nodeName:}" failed. No retries permitted until 2026-07-15 21:10:51.530015718 +0000 UTC m=+72.718496218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rk9tw" (UID: "fa4043d2-3da2-4780-b4bc-cea7277b018f") : configmap "kube-rbac-proxy" not found Jul 15 21:10:44.034804 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.034761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:10:44.037675 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.037656 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 21:10:44.045339 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:44.045315 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 21:10:44.045420 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:44.045376 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs podName:e3f782c6-eee1-4867-b1c7-52b75c1bb2d6 nodeName:}" failed. No retries permitted until 2026-07-15 21:11:48.045360227 +0000 UTC m=+129.233840727 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs") pod "network-metrics-daemon-fxtxv" (UID: "e3f782c6-eee1-4867-b1c7-52b75c1bb2d6") : secret "metrics-daemon-secret" not found Jul 15 21:10:44.135698 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.135656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hd6p\" (UniqueName: \"kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p\") pod \"network-check-target-kwwkk\" (UID: \"3fa8856a-c739-4e0b-b917-bfb707308b68\") " pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:44.135871 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.135774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:44.138243 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.138223 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hd6p\" (UniqueName: \"kubernetes.io/projected/3fa8856a-c739-4e0b-b917-bfb707308b68-kube-api-access-6hd6p\") pod \"network-check-target-kwwkk\" (UID: \"3fa8856a-c739-4e0b-b917-bfb707308b68\") " pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:44.139365 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.139341 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 21:10:44.146297 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.146277 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jtv82\"" Jul 15 21:10:44.147864 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.147844 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf7611a-bc20-4785-85ef-3fa8ef337b76-original-pull-secret\") pod \"global-pull-secret-syncer-6k6wd\" (UID: \"7bf7611a-bc20-4785-85ef-3fa8ef337b76\") " pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:44.150542 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.150524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6k6wd" Jul 15 21:10:44.153014 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.152994 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:44.302871 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.302793 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6k6wd"] Jul 15 21:10:44.305380 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:44.305355 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf7611a_bc20_4785_85ef_3fa8ef337b76.slice/crio-0fc449a78c0a2b1db6aad178effedf6df60fa28d7e245fb897ab9b5ea211b456 WatchSource:0}: Error finding container 0fc449a78c0a2b1db6aad178effedf6df60fa28d7e245fb897ab9b5ea211b456: Status 404 returned error can't find the container with id 0fc449a78c0a2b1db6aad178effedf6df60fa28d7e245fb897ab9b5ea211b456 Jul 15 21:10:44.317414 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.317392 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kwwkk"] Jul 15 21:10:44.318891 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:44.318868 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa8856a_c739_4e0b_b917_bfb707308b68.slice/crio-d43bbc5ebb3a91eaec15b75eac1a412ec2010f98f1c79e29a4bf0c72e193599f WatchSource:0}: Error finding container d43bbc5ebb3a91eaec15b75eac1a412ec2010f98f1c79e29a4bf0c72e193599f: Status 404 returned error can't find the container with id d43bbc5ebb3a91eaec15b75eac1a412ec2010f98f1c79e29a4bf0c72e193599f Jul 15 21:10:44.438389 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.438355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-stjm7\" (UID: \"47fef52e-e97b-4baf-9da3-ec911d1995a8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:44.440965 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.440934 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/47fef52e-e97b-4baf-9da3-ec911d1995a8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-stjm7\" (UID: \"47fef52e-e97b-4baf-9da3-ec911d1995a8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:44.493508 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.493477 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5bsl5\"" Jul 15 21:10:44.498295 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.498279 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" Jul 15 21:10:44.539818 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.539778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:10:44.540259 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:44.539935 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:44.540259 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:44.540018 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls podName:69bd13d1-c703-4ab9-87f6-298e59f1ffac nodeName:}" failed. No retries permitted until 2026-07-15 21:11:00.539993613 +0000 UTC m=+81.728474130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-84hfx" (UID: "69bd13d1-c703-4ab9-87f6-298e59f1ffac") : secret "cluster-monitoring-operator-tls" not found Jul 15 21:10:44.641024 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.640979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:44.641024 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.641052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:44.641263 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:10:44.641212 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle podName:11455e3b-a5e4-4885-b34a-7726f892fa13 nodeName:}" failed. No retries permitted until 2026-07-15 21:11:00.641193554 +0000 UTC m=+81.829674054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle") pod "router-default-5bc5f88888-2px5d" (UID: "11455e3b-a5e4-4885-b34a-7726f892fa13") : configmap references non-existent config key: service-ca.crt Jul 15 21:10:44.643365 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.643336 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11455e3b-a5e4-4885-b34a-7726f892fa13-metrics-certs\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:10:44.646305 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.646281 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7"] Jul 15 21:10:44.769229 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.769192 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" event={"ID":"47fef52e-e97b-4baf-9da3-ec911d1995a8","Type":"ContainerStarted","Data":"67848a760c3596afb69aabdfd8521d28895aed674a07360e4b7a475017304fea"} Jul 15 21:10:44.771495 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.771461 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kwwkk" event={"ID":"3fa8856a-c739-4e0b-b917-bfb707308b68","Type":"ContainerStarted","Data":"1af21a18024481c3e862928ed67f6bafc83701e2377bb953f18626eb04c71409"} Jul 15 21:10:44.771664 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.771520 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kwwkk" event={"ID":"3fa8856a-c739-4e0b-b917-bfb707308b68","Type":"ContainerStarted","Data":"d43bbc5ebb3a91eaec15b75eac1a412ec2010f98f1c79e29a4bf0c72e193599f"} Jul 15 21:10:44.771664 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.771624 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:10:44.773077 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.773045 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6k6wd" event={"ID":"7bf7611a-bc20-4785-85ef-3fa8ef337b76","Type":"ContainerStarted","Data":"0fc449a78c0a2b1db6aad178effedf6df60fa28d7e245fb897ab9b5ea211b456"} Jul 15 21:10:44.799235 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:44.798975 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kwwkk" podStartSLOduration=64.79895362 podStartE2EDuration="1m4.79895362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:44.797431511 +0000 UTC m=+65.985912037" watchObservedRunningTime="2026-07-15 21:10:44.79895362 +0000 UTC m=+65.987434144" Jul 15 21:10:46.558541 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:46.558446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:46.558541 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:46.558495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:46.561571 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:46.561534 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21d9f46f-abef-498e-91ae-e0c813afa9ff-metrics-tls\") pod \"dns-default-2fgr9\" (UID: \"21d9f46f-abef-498e-91ae-e0c813afa9ff\") " pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:46.562301 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:46.562275 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls\") pod \"image-registry-5d7fdd8bbf-rnqj9\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:46.778139 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:46.778108 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r7n6n\"" Jul 15 21:10:46.785813 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:46.785779 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:46.791316 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:46.791266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" event={"ID":"47fef52e-e97b-4baf-9da3-ec911d1995a8","Type":"ContainerStarted","Data":"28bb8f4e4acd454d0b77c086bdfaa5c0bdcd275fe51ea71c6d23d324e369b41f"} Jul 15 21:10:46.800812 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:46.800742 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4b2pm\"" Jul 15 21:10:46.809165 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:46.809068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:47.021303 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:47.021222 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9"] Jul 15 21:10:47.026475 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:47.026441 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c971c1a_7fac_484d_bc79_65bef4b1e03f.slice/crio-43de170f590237f0ff3e1f594e78ec3e1210e3bf27fb9160c6a50a5e3694e6ec WatchSource:0}: Error finding container 43de170f590237f0ff3e1f594e78ec3e1210e3bf27fb9160c6a50a5e3694e6ec: Status 404 returned error can't find the container with id 43de170f590237f0ff3e1f594e78ec3e1210e3bf27fb9160c6a50a5e3694e6ec Jul 15 21:10:47.039252 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:47.039223 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2fgr9"] Jul 15 21:10:47.045398 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:47.045374 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d9f46f_abef_498e_91ae_e0c813afa9ff.slice/crio-9e5fb93edfd7e94d8bb37f8a11f8066a068d29bdcc6d975e9235a046372d08b0 WatchSource:0}: Error finding container 9e5fb93edfd7e94d8bb37f8a11f8066a068d29bdcc6d975e9235a046372d08b0: Status 404 returned error can't find the container with id 9e5fb93edfd7e94d8bb37f8a11f8066a068d29bdcc6d975e9235a046372d08b0 Jul 15 21:10:47.797404 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:47.797365 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" event={"ID":"8c971c1a-7fac-484d-bc79-65bef4b1e03f","Type":"ContainerStarted","Data":"58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6"} Jul 15 21:10:47.797848 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:47.797427 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" event={"ID":"8c971c1a-7fac-484d-bc79-65bef4b1e03f","Type":"ContainerStarted","Data":"43de170f590237f0ff3e1f594e78ec3e1210e3bf27fb9160c6a50a5e3694e6ec"} Jul 15 21:10:47.797848 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:47.797698 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:10:47.799088 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:47.799052 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2fgr9" event={"ID":"21d9f46f-abef-498e-91ae-e0c813afa9ff","Type":"ContainerStarted","Data":"9e5fb93edfd7e94d8bb37f8a11f8066a068d29bdcc6d975e9235a046372d08b0"} Jul 15 21:10:47.801342 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:47.801275 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" event={"ID":"47fef52e-e97b-4baf-9da3-ec911d1995a8","Type":"ContainerStarted","Data":"94a1f433343070ad481d441f984922f1107bfae0767a2604cbf90f0275de1301"} Jul 15 21:10:47.820267 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:47.820206 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" podStartSLOduration=67.820188397 podStartE2EDuration="1m7.820188397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:47.818651856 +0000 UTC m=+69.007132378" watchObservedRunningTime="2026-07-15 21:10:47.820188397 +0000 UTC m=+69.008668919" Jul 15 21:10:47.845864 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:47.845804 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-stjm7" podStartSLOduration=17.861250498 podStartE2EDuration="19.845787041s" totalImagesPullingTime="1.984536543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:47.844393481 +0000 UTC m=+69.032874006" watchObservedRunningTime="2026-07-15 21:10:47.845787041 +0000 UTC m=+69.034267562" Jul 15 21:10:49.810750 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:49.810654 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6k6wd" event={"ID":"7bf7611a-bc20-4785-85ef-3fa8ef337b76","Type":"ContainerStarted","Data":"bb1f2d9658e6d66f3ad36d03013e92de49e383a393a6cf6bc7553a46dc8752f4"} Jul 15 21:10:49.828361 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:49.828312 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6k6wd" podStartSLOduration=64.774675849 podStartE2EDuration="1m9.828295048s" totalImagesPullingTime="5.053619199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:49.827500081 +0000 UTC m=+71.015980727" watchObservedRunningTime="2026-07-15 21:10:49.828295048 +0000 UTC m=+71.016775570" Jul 15 21:10:50.815983 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:50.815879 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2fgr9" event={"ID":"21d9f46f-abef-498e-91ae-e0c813afa9ff","Type":"ContainerStarted","Data":"4bbf5733150ee8d74fa848ebacc4fc763083e7c405f348f285d52341b34562e9"} Jul 15 21:10:50.815983 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:50.815942 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2fgr9" event={"ID":"21d9f46f-abef-498e-91ae-e0c813afa9ff","Type":"ContainerStarted","Data":"8177544d166dddd3911fb5cf3a4647c914ad945b20303da23577e9d17cd091a4"} Jul 15 21:10:50.816458 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:50.816058 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2fgr9" Jul 15 21:10:50.838264 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:50.838206 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2fgr9" podStartSLOduration=33.486547388 podStartE2EDuration="36.838188681s" totalImagesPullingTime="3.351641293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:50.83819026 +0000 UTC m=+72.026670782" watchObservedRunningTime="2026-07-15 21:10:50.838188681 +0000 UTC m=+72.026669203" Jul 15 21:10:51.606167 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:51.606124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:51.606167 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:51.606166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:51.606697 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:51.606676 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa4043d2-3da2-4780-b4bc-cea7277b018f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:51.608543 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:51.608518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa4043d2-3da2-4780-b4bc-cea7277b018f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rk9tw\" (UID: \"fa4043d2-3da2-4780-b4bc-cea7277b018f\") " pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:51.667386 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:51.667355 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8zghz\"" Jul 15 21:10:51.675431 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:51.675408 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rk9tw" Jul 15 21:10:51.803153 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:51.803120 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rk9tw"] Jul 15 21:10:51.806180 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:10:51.806149 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4043d2_3da2_4780_b4bc_cea7277b018f.slice/crio-21a55af91fe40d3f0f2e01938b407eed8a4c712639362781a185c4423bdb352b WatchSource:0}: Error finding container 21a55af91fe40d3f0f2e01938b407eed8a4c712639362781a185c4423bdb352b: Status 404 returned error can't find the container with id 21a55af91fe40d3f0f2e01938b407eed8a4c712639362781a185c4423bdb352b Jul 15 21:10:51.820289 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:51.820260 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rk9tw" event={"ID":"fa4043d2-3da2-4780-b4bc-cea7277b018f","Type":"ContainerStarted","Data":"21a55af91fe40d3f0f2e01938b407eed8a4c712639362781a185c4423bdb352b"} Jul 15 21:10:55.337995 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:55.337950 2578 scope.go:117] "RemoveContainer" containerID="2f31b032992299bd239739df1ff1351bc3e94eed6d211d167182da9111e16a45" Jul 15 21:10:56.842965 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:56.842929 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rk9tw" event={"ID":"fa4043d2-3da2-4780-b4bc-cea7277b018f","Type":"ContainerStarted","Data":"8b2b4b09798cf6a4414ac3988210f707e02db31c8e5fa4b0639cb422c390e9b0"} Jul 15 21:10:56.844791 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:56.844771 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:10:56.844925 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:56.844825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bc8kx" event={"ID":"6426605a-7777-443e-9cd5-474ad2c118a2","Type":"ContainerStarted","Data":"5b11bdb736a1df5a0d5ae215e103ffdb984c548a9d05fa5218a8040792a465d3"} Jul 15 21:10:56.845162 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:56.845141 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:56.873678 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:56.873579 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-bc8kx" podStartSLOduration=23.813044693 podStartE2EDuration="27.87356278s" totalImagesPullingTime="4.060518087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:56.873320671 +0000 UTC m=+78.061801193" watchObservedRunningTime="2026-07-15 21:10:56.87356278 +0000 UTC m=+78.062043303" Jul 15 21:10:57.116971 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:57.116938 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-bc8kx" Jul 15 21:10:58.531837 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.531791 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq"] Jul 15 21:10:58.539764 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.539734 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms"] Jul 15 21:10:58.539946 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.539866 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:10:58.542445 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.542402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms" Jul 15 21:10:58.543504 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.543479 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 21:10:58.544612 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.544450 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 21:10:58.544738 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.544712 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 21:10:58.544811 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.544782 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2sx8j\"" Jul 15 21:10:58.544972 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.544948 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8"] Jul 15 21:10:58.549778 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.549725 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 15 21:10:58.552916 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.552891 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 15 21:10:58.555760 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.555489 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.557814 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.557792 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms"] Jul 15 21:10:58.559520 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.559426 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq"] Jul 15 21:10:58.561935 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.561897 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 15 21:10:58.562195 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.562175 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 15 21:10:58.562472 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.562455 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 15 21:10:58.562620 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.562603 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 15 21:10:58.568767 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.568745 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8"] Jul 15 21:10:58.643559 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.643532 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-2zv8c"] Jul 15 21:10:58.646918 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.646897 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-2zv8c" Jul 15 21:10:58.650007 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.649986 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g2vdk\"" Jul 15 21:10:58.652453 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.652433 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 21:10:58.655712 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.655689 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 21:10:58.667958 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.667910 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-2zv8c"] Jul 15 21:10:58.668256 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.668232 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/51918d49-aa57-4754-becc-64dc6e00ef7e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.668337 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.668286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51918d49-aa57-4754-becc-64dc6e00ef7e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.668405 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.668383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwkrt\" (UniqueName: \"kubernetes.io/projected/707e4cd8-5e67-4184-981e-a32952499362-kube-api-access-gwkrt\") pod \"klusterlet-addon-workmgr-8687bd79c-frxqq\" (UID: \"707e4cd8-5e67-4184-981e-a32952499362\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:10:58.668454 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.668423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/707e4cd8-5e67-4184-981e-a32952499362-klusterlet-config\") pod \"klusterlet-addon-workmgr-8687bd79c-frxqq\" (UID: \"707e4cd8-5e67-4184-981e-a32952499362\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:10:58.668508 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.668464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/51918d49-aa57-4754-becc-64dc6e00ef7e-ca\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.668508 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.668492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/51918d49-aa57-4754-becc-64dc6e00ef7e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.668616 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.668569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlkj4\" (UniqueName: \"kubernetes.io/projected/51918d49-aa57-4754-becc-64dc6e00ef7e-kube-api-access-xlkj4\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.668668 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.668640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad5c476-68c4-4df6-b017-025c7c66abe9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms\" (UID: \"1ad5c476-68c4-4df6-b017-025c7c66abe9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms" Jul 15 21:10:58.668715 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.668673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/51918d49-aa57-4754-becc-64dc6e00ef7e-hub\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.668715 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.668705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/707e4cd8-5e67-4184-981e-a32952499362-tmp\") pod \"klusterlet-addon-workmgr-8687bd79c-frxqq\" (UID: \"707e4cd8-5e67-4184-981e-a32952499362\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:10:58.668812 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.668733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns8j4\" (UniqueName: \"kubernetes.io/projected/1ad5c476-68c4-4df6-b017-025c7c66abe9-kube-api-access-ns8j4\") pod \"managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms\" (UID: \"1ad5c476-68c4-4df6-b017-025c7c66abe9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms" Jul 15 21:10:58.692950 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.692917 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-2d9fg"] Jul 15 21:10:58.695266 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.695248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-2d9fg" Jul 15 21:10:58.698862 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.698829 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 21:10:58.699060 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.699016 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bkfxz\"" Jul 15 21:10:58.699390 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.699370 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 21:10:58.720169 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.720129 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-2d9fg"] Jul 15 21:10:58.769630 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.769593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlkj4\" (UniqueName: \"kubernetes.io/projected/51918d49-aa57-4754-becc-64dc6e00ef7e-kube-api-access-xlkj4\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.769630 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.769634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a4f0349f-0422-43a6-a159-dc855b6708b3-nginx-conf\") pod \"networking-console-plugin-6cf856758c-2zv8c\" (UID: \"a4f0349f-0422-43a6-a159-dc855b6708b3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2zv8c" Jul 15 21:10:58.769868 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.769687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad5c476-68c4-4df6-b017-025c7c66abe9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms\" (UID: \"1ad5c476-68c4-4df6-b017-025c7c66abe9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms" Jul 15 21:10:58.769868 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.769715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/51918d49-aa57-4754-becc-64dc6e00ef7e-hub\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.769868 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.769740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/707e4cd8-5e67-4184-981e-a32952499362-tmp\") pod \"klusterlet-addon-workmgr-8687bd79c-frxqq\" (UID: \"707e4cd8-5e67-4184-981e-a32952499362\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:10:58.769868 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.769794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8j4\" (UniqueName: \"kubernetes.io/projected/1ad5c476-68c4-4df6-b017-025c7c66abe9-kube-api-access-ns8j4\") pod \"managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms\" (UID: \"1ad5c476-68c4-4df6-b017-025c7c66abe9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms" Jul 15 21:10:58.769868 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.769852 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/51918d49-aa57-4754-becc-64dc6e00ef7e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.770153 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.769891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51918d49-aa57-4754-becc-64dc6e00ef7e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.770153 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.769935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4f0349f-0422-43a6-a159-dc855b6708b3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2zv8c\" (UID: \"a4f0349f-0422-43a6-a159-dc855b6708b3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2zv8c" Jul 15 21:10:58.770153 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.769989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwkrt\" (UniqueName: \"kubernetes.io/projected/707e4cd8-5e67-4184-981e-a32952499362-kube-api-access-gwkrt\") pod \"klusterlet-addon-workmgr-8687bd79c-frxqq\" (UID: \"707e4cd8-5e67-4184-981e-a32952499362\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:10:58.770153 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.770022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/707e4cd8-5e67-4184-981e-a32952499362-klusterlet-config\") pod \"klusterlet-addon-workmgr-8687bd79c-frxqq\" (UID: \"707e4cd8-5e67-4184-981e-a32952499362\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:10:58.770153 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.770066 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/707e4cd8-5e67-4184-981e-a32952499362-tmp\") pod \"klusterlet-addon-workmgr-8687bd79c-frxqq\" (UID: \"707e4cd8-5e67-4184-981e-a32952499362\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:10:58.770153 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.770093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/51918d49-aa57-4754-becc-64dc6e00ef7e-ca\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.770153 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.770119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/51918d49-aa57-4754-becc-64dc6e00ef7e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.770911 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.770884 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/51918d49-aa57-4754-becc-64dc6e00ef7e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.773313 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.773266 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/51918d49-aa57-4754-becc-64dc6e00ef7e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.773592 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.773567 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/51918d49-aa57-4754-becc-64dc6e00ef7e-hub\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.773951 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.773929 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/51918d49-aa57-4754-becc-64dc6e00ef7e-ca\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.774111 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.774090 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad5c476-68c4-4df6-b017-025c7c66abe9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms\" (UID: \"1ad5c476-68c4-4df6-b017-025c7c66abe9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms" Jul 15 21:10:58.774275 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.774255 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51918d49-aa57-4754-becc-64dc6e00ef7e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.774630 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.774611 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/707e4cd8-5e67-4184-981e-a32952499362-klusterlet-config\") pod \"klusterlet-addon-workmgr-8687bd79c-frxqq\" (UID: \"707e4cd8-5e67-4184-981e-a32952499362\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:10:58.784711 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.784637 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns8j4\" (UniqueName: \"kubernetes.io/projected/1ad5c476-68c4-4df6-b017-025c7c66abe9-kube-api-access-ns8j4\") pod \"managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms\" (UID: \"1ad5c476-68c4-4df6-b017-025c7c66abe9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms" Jul 15 21:10:58.788602 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.788048 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwkrt\" (UniqueName: \"kubernetes.io/projected/707e4cd8-5e67-4184-981e-a32952499362-kube-api-access-gwkrt\") pod \"klusterlet-addon-workmgr-8687bd79c-frxqq\" (UID: \"707e4cd8-5e67-4184-981e-a32952499362\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:10:58.789679 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.789649 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlkj4\" (UniqueName: \"kubernetes.io/projected/51918d49-aa57-4754-becc-64dc6e00ef7e-kube-api-access-xlkj4\") pod \"cluster-proxy-proxy-agent-76ccfdc695-dpgg8\" (UID: \"51918d49-aa57-4754-becc-64dc6e00ef7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.854305 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.854275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:10:58.871384 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.871351 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms" Jul 15 21:10:58.871583 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.871563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbbcc\" (UniqueName: \"kubernetes.io/projected/5e8b6fac-9625-4e6c-b55a-f0c12857f5d9-kube-api-access-dbbcc\") pod \"downloads-68c9cbb497-2d9fg\" (UID: \"5e8b6fac-9625-4e6c-b55a-f0c12857f5d9\") " pod="openshift-console/downloads-68c9cbb497-2d9fg" Jul 15 21:10:58.871664 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.871594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4f0349f-0422-43a6-a159-dc855b6708b3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2zv8c\" (UID: \"a4f0349f-0422-43a6-a159-dc855b6708b3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2zv8c" Jul 15 21:10:58.871733 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.871665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a4f0349f-0422-43a6-a159-dc855b6708b3-nginx-conf\") pod \"networking-console-plugin-6cf856758c-2zv8c\" (UID: \"a4f0349f-0422-43a6-a159-dc855b6708b3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2zv8c" Jul 15 21:10:58.872390 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.872358 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a4f0349f-0422-43a6-a159-dc855b6708b3-nginx-conf\") pod \"networking-console-plugin-6cf856758c-2zv8c\" (UID: \"a4f0349f-0422-43a6-a159-dc855b6708b3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2zv8c" Jul 15 21:10:58.874299 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.874274 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4f0349f-0422-43a6-a159-dc855b6708b3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2zv8c\" (UID: \"a4f0349f-0422-43a6-a159-dc855b6708b3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2zv8c" Jul 15 21:10:58.877399 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.877374 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" Jul 15 21:10:58.964224 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.964187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-2zv8c" Jul 15 21:10:58.972803 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.972766 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbbcc\" (UniqueName: \"kubernetes.io/projected/5e8b6fac-9625-4e6c-b55a-f0c12857f5d9-kube-api-access-dbbcc\") pod \"downloads-68c9cbb497-2d9fg\" (UID: \"5e8b6fac-9625-4e6c-b55a-f0c12857f5d9\") " pod="openshift-console/downloads-68c9cbb497-2d9fg" Jul 15 21:10:58.999610 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:58.999580 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbbcc\" (UniqueName: \"kubernetes.io/projected/5e8b6fac-9625-4e6c-b55a-f0c12857f5d9-kube-api-access-dbbcc\") pod \"downloads-68c9cbb497-2d9fg\" (UID: \"5e8b6fac-9625-4e6c-b55a-f0c12857f5d9\") " pod="openshift-console/downloads-68c9cbb497-2d9fg" Jul 15 21:10:59.005284 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:10:59.005061 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-2d9fg" Jul 15 21:11:00.237889 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.237766 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq"] Jul 15 21:11:00.239751 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:11:00.239712 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707e4cd8_5e67_4184_981e_a32952499362.slice/crio-6ac0ed2e0f4462cf9681cf3b505fbd24eae6bc5b9f421e093a1636f875f6bcde WatchSource:0}: Error finding container 6ac0ed2e0f4462cf9681cf3b505fbd24eae6bc5b9f421e093a1636f875f6bcde: Status 404 returned error can't find the container with id 6ac0ed2e0f4462cf9681cf3b505fbd24eae6bc5b9f421e093a1636f875f6bcde Jul 15 21:11:00.382659 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.382601 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-2zv8c"] Jul 15 21:11:00.385952 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:11:00.385921 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f0349f_0422_43a6_a159_dc855b6708b3.slice/crio-e086ea66916d079343d7923238145db88cecb41a4328a9c5050304b49564ec6f WatchSource:0}: Error finding container e086ea66916d079343d7923238145db88cecb41a4328a9c5050304b49564ec6f: Status 404 returned error can't find the container with id e086ea66916d079343d7923238145db88cecb41a4328a9c5050304b49564ec6f Jul 15 21:11:00.389019 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.388997 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8"] Jul 15 21:11:00.391275 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:11:00.391250 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51918d49_aa57_4754_becc_64dc6e00ef7e.slice/crio-29cbbf6029a8d8a707b4e661a25f09e8fc2fd481abcc2feabdbf1f1c8ab12964 WatchSource:0}: Error finding container 29cbbf6029a8d8a707b4e661a25f09e8fc2fd481abcc2feabdbf1f1c8ab12964: Status 404 returned error can't find the container with id 29cbbf6029a8d8a707b4e661a25f09e8fc2fd481abcc2feabdbf1f1c8ab12964 Jul 15 21:11:00.587215 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.587176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:11:00.590024 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.589999 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69bd13d1-c703-4ab9-87f6-298e59f1ffac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-84hfx\" (UID: \"69bd13d1-c703-4ab9-87f6-298e59f1ffac\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:11:00.621170 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.621143 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-2d9fg"] Jul 15 21:11:00.622386 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.622313 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms"] Jul 15 21:11:00.623631 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:11:00.623607 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ad5c476_68c4_4df6_b017_025c7c66abe9.slice/crio-3abd4a4820073f9022b4fed10a16fe0033a15dff5ac5037a184dc7b606f41ecd WatchSource:0}: Error finding container 3abd4a4820073f9022b4fed10a16fe0033a15dff5ac5037a184dc7b606f41ecd: Status 404 returned error can't find the container with id 3abd4a4820073f9022b4fed10a16fe0033a15dff5ac5037a184dc7b606f41ecd Jul 15 21:11:00.624242 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:11:00.624178 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8b6fac_9625_4e6c_b55a_f0c12857f5d9.slice/crio-bd04740109bdc47eec179459f4c12b0db224dd354d8ef610fa41177507651c07 WatchSource:0}: Error finding container bd04740109bdc47eec179459f4c12b0db224dd354d8ef610fa41177507651c07: Status 404 returned error can't find the container with id bd04740109bdc47eec179459f4c12b0db224dd354d8ef610fa41177507651c07 Jul 15 21:11:00.687942 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.687857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:11:00.688462 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.688443 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11455e3b-a5e4-4885-b34a-7726f892fa13-service-ca-bundle\") pod \"router-default-5bc5f88888-2px5d\" (UID: \"11455e3b-a5e4-4885-b34a-7726f892fa13\") " pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:11:00.738254 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.738230 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d5nvr\"" Jul 15 21:11:00.745779 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.745757 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" Jul 15 21:11:00.795318 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.795293 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l9rh5\"" Jul 15 21:11:00.803126 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.803096 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:11:00.824142 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.823559 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2fgr9" Jul 15 21:11:00.877212 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.877175 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rk9tw" event={"ID":"fa4043d2-3da2-4780-b4bc-cea7277b018f","Type":"ContainerStarted","Data":"5f63adc8b0db00c059ea8f3cfdba1bf8c64e2f456f72a15e2d9f2a0e97824a39"} Jul 15 21:11:00.880179 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.880144 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms" event={"ID":"1ad5c476-68c4-4df6-b017-025c7c66abe9","Type":"ContainerStarted","Data":"3abd4a4820073f9022b4fed10a16fe0033a15dff5ac5037a184dc7b606f41ecd"} Jul 15 21:11:00.893836 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.893802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-2d9fg" event={"ID":"5e8b6fac-9625-4e6c-b55a-f0c12857f5d9","Type":"ContainerStarted","Data":"bd04740109bdc47eec179459f4c12b0db224dd354d8ef610fa41177507651c07"} Jul 15 21:11:00.896062 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.895967 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" event={"ID":"707e4cd8-5e67-4184-981e-a32952499362","Type":"ContainerStarted","Data":"6ac0ed2e0f4462cf9681cf3b505fbd24eae6bc5b9f421e093a1636f875f6bcde"} Jul 15 21:11:00.898240 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.898163 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-2zv8c" event={"ID":"a4f0349f-0422-43a6-a159-dc855b6708b3","Type":"ContainerStarted","Data":"e086ea66916d079343d7923238145db88cecb41a4328a9c5050304b49564ec6f"} Jul 15 21:11:00.900263 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.900205 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" event={"ID":"51918d49-aa57-4754-becc-64dc6e00ef7e","Type":"ContainerStarted","Data":"29cbbf6029a8d8a707b4e661a25f09e8fc2fd481abcc2feabdbf1f1c8ab12964"} Jul 15 21:11:00.949580 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:00.949309 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx"] Jul 15 21:11:00.952322 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:11:00.952281 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bd13d1_c703_4ab9_87f6_298e59f1ffac.slice/crio-4494f3bc94ae9c1c8c69c6e7c7648cee8ec58da749f38d4f5d6924a063c51d61 WatchSource:0}: Error finding container 4494f3bc94ae9c1c8c69c6e7c7648cee8ec58da749f38d4f5d6924a063c51d61: Status 404 returned error can't find the container with id 4494f3bc94ae9c1c8c69c6e7c7648cee8ec58da749f38d4f5d6924a063c51d61 Jul 15 21:11:01.027979 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:01.027920 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bc5f88888-2px5d"] Jul 15 21:11:01.031298 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:11:01.031258 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11455e3b_a5e4_4885_b34a_7726f892fa13.slice/crio-f76163283928c83874ba5e05fcefebeb6ae5ec5018c2aca7dc7a4c6822d6bd37 WatchSource:0}: Error finding container f76163283928c83874ba5e05fcefebeb6ae5ec5018c2aca7dc7a4c6822d6bd37: Status 404 returned error can't find the container with id f76163283928c83874ba5e05fcefebeb6ae5ec5018c2aca7dc7a4c6822d6bd37 Jul 15 21:11:01.915112 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:01.914891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" event={"ID":"69bd13d1-c703-4ab9-87f6-298e59f1ffac","Type":"ContainerStarted","Data":"4494f3bc94ae9c1c8c69c6e7c7648cee8ec58da749f38d4f5d6924a063c51d61"} Jul 15 21:11:01.920678 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:01.919861 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bc5f88888-2px5d" event={"ID":"11455e3b-a5e4-4885-b34a-7726f892fa13","Type":"ContainerStarted","Data":"7e8e53b03e195c0a0319d4fbfe80bede5cc91ff454b74a4779472418b1e92fc0"} Jul 15 21:11:01.920678 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:01.919917 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bc5f88888-2px5d" event={"ID":"11455e3b-a5e4-4885-b34a-7726f892fa13","Type":"ContainerStarted","Data":"f76163283928c83874ba5e05fcefebeb6ae5ec5018c2aca7dc7a4c6822d6bd37"} Jul 15 21:11:02.804191 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:02.803988 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:11:02.807350 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:02.807123 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:11:02.833730 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:02.832412 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5bc5f88888-2px5d" podStartSLOduration=34.832387371 podStartE2EDuration="34.832387371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:01.948474064 +0000 UTC m=+83.136954587" watchObservedRunningTime="2026-07-15 21:11:02.832387371 +0000 UTC m=+84.020867896" Jul 15 21:11:02.927448 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:02.927324 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:11:02.929568 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:02.929345 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5bc5f88888-2px5d" Jul 15 21:11:04.940367 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:04.940088 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-2zv8c" event={"ID":"a4f0349f-0422-43a6-a159-dc855b6708b3","Type":"ContainerStarted","Data":"904607c3db2631146494a1a6b725844aaacf532a8fd8daa5ddfce28f302e3f50"} Jul 15 21:11:04.962281 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:04.962219 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-2zv8c" podStartSLOduration=4.978194522 podStartE2EDuration="6.962197853s" totalImagesPullingTime="1.984003331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:04.961575666 +0000 UTC m=+86.150056189" watchObservedRunningTime="2026-07-15 21:11:04.962197853 +0000 UTC m=+86.150678375" Jul 15 21:11:06.791477 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:06.791433 2578 patch_prober.go:28] interesting pod/image-registry-5d7fdd8bbf-rnqj9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 21:11:06.791943 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:06.791501 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" podUID="8c971c1a-7fac-484d-bc79-65bef4b1e03f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 21:11:08.811017 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:08.810987 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:11:09.967237 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:09.966525 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" event={"ID":"51918d49-aa57-4754-becc-64dc6e00ef7e","Type":"ContainerStarted","Data":"69cdbdd5d161db98f13f2ac016732f1f2fc11009d02e55bbb1b704df4f63b572"} Jul 15 21:11:09.967237 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:09.966587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" event={"ID":"51918d49-aa57-4754-becc-64dc6e00ef7e","Type":"ContainerStarted","Data":"953ffeb5afddffc73351fb27ec73125bcd89da64c08dcb83c24932d8502f2d58"} Jul 15 21:11:09.967237 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:09.966604 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" event={"ID":"51918d49-aa57-4754-becc-64dc6e00ef7e","Type":"ContainerStarted","Data":"d11613674c0a884c691034dd6e1544a46c824ac53520e3c84569e4e66ecbc3bb"} Jul 15 21:11:09.971041 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:09.970985 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rk9tw" event={"ID":"fa4043d2-3da2-4780-b4bc-cea7277b018f","Type":"ContainerStarted","Data":"59606617a5934278ba33196d862e86531072f074659f92a919c8109d9f935ee3"} Jul 15 21:11:09.972817 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:09.972792 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms" event={"ID":"1ad5c476-68c4-4df6-b017-025c7c66abe9","Type":"ContainerStarted","Data":"0c48aa64b7a211d1e26c0fc1fb76bfba04aa1f3edbe03077c7911577fdd7d992"} Jul 15 21:11:09.975668 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:09.975244 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" event={"ID":"69bd13d1-c703-4ab9-87f6-298e59f1ffac","Type":"ContainerStarted","Data":"296e0b98fe4c13b68a0d12ee8b631d0939abccbedbb8c1664839adf1412d6eb2"} Jul 15 21:11:10.038980 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:10.038909 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76ccfdc695-dpgg8" podStartSLOduration=3.4507484489999998 podStartE2EDuration="12.038884008s" totalImagesPullingTime="8.588135559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:10.012465314 +0000 UTC m=+91.200945837" watchObservedRunningTime="2026-07-15 21:11:10.038884008 +0000 UTC m=+91.227364535" Jul 15 21:11:10.039416 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:10.039372 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rk9tw" podStartSLOduration=18.037791533 podStartE2EDuration="35.039356168s" totalImagesPullingTime="17.001564635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:10.037707175 +0000 UTC m=+91.226187701" watchObservedRunningTime="2026-07-15 21:11:10.039356168 +0000 UTC m=+91.227836693" Jul 15 21:11:10.091193 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:10.091140 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-84hfx" podStartSLOduration=34.084446872 podStartE2EDuration="42.091117929s" totalImagesPullingTime="8.006671057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:10.09026791 +0000 UTC m=+91.278748432" watchObservedRunningTime="2026-07-15 21:11:10.091117929 +0000 UTC m=+91.279598456" Jul 15 21:11:10.091758 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:10.091724 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dcc5c5b84-j92ms" podStartSLOduration=3.755109767 podStartE2EDuration="12.091712335s" totalImagesPullingTime="8.336602568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:10.064422177 +0000 UTC m=+91.252902701" watchObservedRunningTime="2026-07-15 21:11:10.091712335 +0000 UTC m=+91.280192909" Jul 15 21:11:15.782674 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:15.782644 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kwwkk" Jul 15 21:11:21.024595 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:21.024561 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-2d9fg" event={"ID":"5e8b6fac-9625-4e6c-b55a-f0c12857f5d9","Type":"ContainerStarted","Data":"d8e261333c5eb3186fc0b598e1654bf232740e6ff75c2921870c59da6fe97f63"} Jul 15 21:11:21.025065 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:21.024796 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-2d9fg" Jul 15 21:11:21.026262 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:21.026235 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" event={"ID":"707e4cd8-5e67-4184-981e-a32952499362","Type":"ContainerStarted","Data":"265d306fd57eaa816f9992cde3366c866261703eebe1cd65c8621e5ce847dc1c"} Jul 15 21:11:21.026445 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:21.026424 2578 patch_prober.go:28] interesting pod/downloads-68c9cbb497-2d9fg container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" start-of-body= Jul 15 21:11:21.026517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:21.026443 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:11:21.026517 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:21.026471 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-2d9fg" podUID="5e8b6fac-9625-4e6c-b55a-f0c12857f5d9" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" Jul 15 21:11:21.027807 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:21.027787 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" Jul 15 21:11:21.044996 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:21.044946 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-2d9fg" podStartSLOduration=2.804382328 podStartE2EDuration="23.044922414s" totalImagesPullingTime="20.240540086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:21.043162664 +0000 UTC m=+102.231643187" watchObservedRunningTime="2026-07-15 21:11:21.044922414 +0000 UTC m=+102.233402935" Jul 15 21:11:21.059721 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:21.059607 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8687bd79c-frxqq" podStartSLOduration=2.480957128 podStartE2EDuration="23.059587181s" totalImagesPullingTime="20.578630053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:21.0592338 +0000 UTC m=+102.247714322" watchObservedRunningTime="2026-07-15 21:11:21.059587181 +0000 UTC m=+102.248067703" Jul 15 21:11:22.044614 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.044573 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-2d9fg" Jul 15 21:11:22.174007 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.173967 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-94ntl"] Jul 15 21:11:22.205652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.205618 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.210077 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.210046 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 21:11:22.210406 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.210368 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 21:11:22.210619 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.210605 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6gx47\"" Jul 15 21:11:22.210955 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.210943 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 21:11:22.215227 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.211188 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 21:11:22.274744 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.274709 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9"] Jul 15 21:11:22.302934 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.302446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pmn2\" (UniqueName: \"kubernetes.io/projected/03ca135f-6378-4495-926e-8188c7f76738-kube-api-access-9pmn2\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.302934 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.302498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03ca135f-6378-4495-926e-8188c7f76738-root\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.302934 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.302525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-tls\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.302934 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.302557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03ca135f-6378-4495-926e-8188c7f76738-sys\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.302934 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.302606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-accelerators-collector-config\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.302934 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.302636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03ca135f-6378-4495-926e-8188c7f76738-metrics-client-ca\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.302934 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.302689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.302934 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.302717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-wtmp\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.302934 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.302756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-textfile\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.404109 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.404066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-accelerators-collector-config\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.404358 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.404343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03ca135f-6378-4495-926e-8188c7f76738-metrics-client-ca\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.405077 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.404807 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-accelerators-collector-config\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.405209 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.404940 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03ca135f-6378-4495-926e-8188c7f76738-metrics-client-ca\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.405294 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.405069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.405408 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.405392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-wtmp\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.405658 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.405645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-textfile\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.405792 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.405780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pmn2\" (UniqueName: \"kubernetes.io/projected/03ca135f-6378-4495-926e-8188c7f76738-kube-api-access-9pmn2\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.405893 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.405881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03ca135f-6378-4495-926e-8188c7f76738-root\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.405979 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.405968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-tls\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.406096 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.406084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03ca135f-6378-4495-926e-8188c7f76738-sys\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.406232 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.405896 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-textfile\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.406299 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.406280 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03ca135f-6378-4495-926e-8188c7f76738-root\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.406372 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:11:22.406358 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 21:11:22.406425 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:11:22.406414 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-tls podName:03ca135f-6378-4495-926e-8188c7f76738 nodeName:}" failed. No retries permitted until 2026-07-15 21:11:22.906397447 +0000 UTC m=+104.094877952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-tls") pod "node-exporter-94ntl" (UID: "03ca135f-6378-4495-926e-8188c7f76738") : secret "node-exporter-tls" not found Jul 15 21:11:22.406514 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.406501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03ca135f-6378-4495-926e-8188c7f76738-sys\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.406596 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.405592 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-wtmp\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.409001 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.408941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.419652 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.419598 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pmn2\" (UniqueName: \"kubernetes.io/projected/03ca135f-6378-4495-926e-8188c7f76738-kube-api-access-9pmn2\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.911306 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.911266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-tls\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:22.914298 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:22.914268 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03ca135f-6378-4495-926e-8188c7f76738-node-exporter-tls\") pod \"node-exporter-94ntl\" (UID: \"03ca135f-6378-4495-926e-8188c7f76738\") " pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:23.138520 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:23.138478 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-94ntl" Jul 15 21:11:23.186066 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:11:23.182499 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ca135f_6378_4495_926e_8188c7f76738.slice/crio-6cfe2c8abbaa2e81d8c33a287a7cc3e4aad8909b5892b4bbca024c178f331729 WatchSource:0}: Error finding container 6cfe2c8abbaa2e81d8c33a287a7cc3e4aad8909b5892b4bbca024c178f331729: Status 404 returned error can't find the container with id 6cfe2c8abbaa2e81d8c33a287a7cc3e4aad8909b5892b4bbca024c178f331729 Jul 15 21:11:24.043315 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:24.043279 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94ntl" event={"ID":"03ca135f-6378-4495-926e-8188c7f76738","Type":"ContainerStarted","Data":"6cfe2c8abbaa2e81d8c33a287a7cc3e4aad8909b5892b4bbca024c178f331729"} Jul 15 21:11:25.058246 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:25.058208 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94ntl" event={"ID":"03ca135f-6378-4495-926e-8188c7f76738","Type":"ContainerStarted","Data":"3467239d4dbfe9fa691e3752d6d99d144e5932317d31b4d7261f4e8ea3ffdc9c"} Jul 15 21:11:26.064770 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:26.064729 2578 generic.go:356] "Generic (PLEG): container finished" podID="03ca135f-6378-4495-926e-8188c7f76738" containerID="3467239d4dbfe9fa691e3752d6d99d144e5932317d31b4d7261f4e8ea3ffdc9c" exitCode=0 Jul 15 21:11:26.065269 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:26.064794 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94ntl" event={"ID":"03ca135f-6378-4495-926e-8188c7f76738","Type":"ContainerDied","Data":"3467239d4dbfe9fa691e3752d6d99d144e5932317d31b4d7261f4e8ea3ffdc9c"} Jul 15 21:11:27.073607 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:27.073561 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94ntl" event={"ID":"03ca135f-6378-4495-926e-8188c7f76738","Type":"ContainerStarted","Data":"ec9fb7dfb87764b93cc646f98bb7fb5ecbc7726b83189ed946c62d18e82552dc"} Jul 15 21:11:27.074129 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:27.073683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94ntl" event={"ID":"03ca135f-6378-4495-926e-8188c7f76738","Type":"ContainerStarted","Data":"89a4411d11c52a1378afc93047060e2879c31f782fb42965e51b2a8ef69af4fc"} Jul 15 21:11:27.096664 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:27.096606 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-94ntl" podStartSLOduration=3.284912127 podStartE2EDuration="5.096583759s" totalImagesPullingTime="1.681000798s" totalInitContainerRuntime="130.670834ms" isStatefulPod=true podCreationTimestamp="2026-07-15 21:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:27.094603858 +0000 UTC m=+108.283084383" watchObservedRunningTime="2026-07-15 21:11:27.096583759 +0000 UTC m=+108.285064281" Jul 15 21:11:47.304182 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.304136 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" podUID="8c971c1a-7fac-484d-bc79-65bef4b1e03f" containerName="registry" containerID="cri-o://58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6" gracePeriod=30 Jul 15 21:11:47.582157 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.582080 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:11:47.641205 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.641168 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c971c1a-7fac-484d-bc79-65bef4b1e03f-ca-trust-extracted\") pod \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " Jul 15 21:11:47.641205 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.641205 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8986\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-kube-api-access-f8986\") pod \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " Jul 15 21:11:47.641432 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.641221 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-bound-sa-token\") pod \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " Jul 15 21:11:47.641432 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.641241 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c971c1a-7fac-484d-bc79-65bef4b1e03f-trusted-ca\") pod \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " Jul 15 21:11:47.641432 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.641268 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c971c1a-7fac-484d-bc79-65bef4b1e03f-installation-pull-secrets\") pod \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " Jul 15 21:11:47.641432 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.641296 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls\") pod \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " Jul 15 21:11:47.641432 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.641339 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c971c1a-7fac-484d-bc79-65bef4b1e03f-image-registry-private-configuration\") pod \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " Jul 15 21:11:47.641432 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.641394 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-certificates\") pod \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\" (UID: \"8c971c1a-7fac-484d-bc79-65bef4b1e03f\") " Jul 15 21:11:47.642048 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.642007 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8c971c1a-7fac-484d-bc79-65bef4b1e03f" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:47.642184 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.642058 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c971c1a-7fac-484d-bc79-65bef4b1e03f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8c971c1a-7fac-484d-bc79-65bef4b1e03f" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:47.643937 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.643908 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8c971c1a-7fac-484d-bc79-65bef4b1e03f" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:11:47.644068 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.643914 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c971c1a-7fac-484d-bc79-65bef4b1e03f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8c971c1a-7fac-484d-bc79-65bef4b1e03f" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:11:47.644068 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.644012 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-kube-api-access-f8986" (OuterVolumeSpecName: "kube-api-access-f8986") pod "8c971c1a-7fac-484d-bc79-65bef4b1e03f" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f"). InnerVolumeSpecName "kube-api-access-f8986". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:11:47.644068 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.644046 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c971c1a-7fac-484d-bc79-65bef4b1e03f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8c971c1a-7fac-484d-bc79-65bef4b1e03f" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:11:47.644198 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.644133 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8c971c1a-7fac-484d-bc79-65bef4b1e03f" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:11:47.650777 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.650751 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c971c1a-7fac-484d-bc79-65bef4b1e03f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8c971c1a-7fac-484d-bc79-65bef4b1e03f" (UID: "8c971c1a-7fac-484d-bc79-65bef4b1e03f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:11:47.742696 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.742653 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c971c1a-7fac-484d-bc79-65bef4b1e03f-ca-trust-extracted\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:11:47.742696 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.742688 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8986\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-kube-api-access-f8986\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:11:47.742696 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.742701 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-bound-sa-token\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:11:47.742940 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.742713 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c971c1a-7fac-484d-bc79-65bef4b1e03f-trusted-ca\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:11:47.742940 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.742725 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c971c1a-7fac-484d-bc79-65bef4b1e03f-installation-pull-secrets\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:11:47.742940 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.742737 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-tls\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:11:47.742940 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.742750 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c971c1a-7fac-484d-bc79-65bef4b1e03f-image-registry-private-configuration\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:11:47.742940 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:47.742762 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c971c1a-7fac-484d-bc79-65bef4b1e03f-registry-certificates\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:11:48.045832 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.045780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:11:48.048084 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.048058 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f782c6-eee1-4867-b1c7-52b75c1bb2d6-metrics-certs\") pod \"network-metrics-daemon-fxtxv\" (UID: \"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6\") " pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:11:48.059419 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.059389 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xbx8z\"" Jul 15 21:11:48.067238 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.067220 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxtxv" Jul 15 21:11:48.165666 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.165625 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c971c1a-7fac-484d-bc79-65bef4b1e03f" containerID="58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6" exitCode=0 Jul 15 21:11:48.165848 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.165669 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" Jul 15 21:11:48.165848 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.165679 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" event={"ID":"8c971c1a-7fac-484d-bc79-65bef4b1e03f","Type":"ContainerDied","Data":"58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6"} Jul 15 21:11:48.165848 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.165730 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9" event={"ID":"8c971c1a-7fac-484d-bc79-65bef4b1e03f","Type":"ContainerDied","Data":"43de170f590237f0ff3e1f594e78ec3e1210e3bf27fb9160c6a50a5e3694e6ec"} Jul 15 21:11:48.165848 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.165756 2578 scope.go:117] "RemoveContainer" containerID="58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6" Jul 15 21:11:48.175936 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.175908 2578 scope.go:117] "RemoveContainer" containerID="58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6" Jul 15 21:11:48.176302 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:11:48.176278 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6\": container with ID starting with 58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6 not found: ID does not exist" containerID="58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6" Jul 15 21:11:48.176377 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.176312 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6"} err="failed to get container status \"58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6\": rpc error: code = NotFound desc = could not find container \"58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6\": container with ID starting with 58a3e4b1d274c04bb44d55b0f95f5c51dded30a23b812850e40367359413afa6 not found: ID does not exist" Jul 15 21:11:48.188614 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.188589 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9"] Jul 15 21:11:48.192695 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.192672 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d7fdd8bbf-rnqj9"] Jul 15 21:11:48.202463 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:48.202444 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fxtxv"] Jul 15 21:11:48.205089 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:11:48.205068 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f782c6_eee1_4867_b1c7_52b75c1bb2d6.slice/crio-59841f579f8f94388b8e09d9c1f09f10d00e9b1c6696c83e87a8a654d467fcbf WatchSource:0}: Error finding container 59841f579f8f94388b8e09d9c1f09f10d00e9b1c6696c83e87a8a654d467fcbf: Status 404 returned error can't find the container with id 59841f579f8f94388b8e09d9c1f09f10d00e9b1c6696c83e87a8a654d467fcbf Jul 15 21:11:49.173000 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:49.172963 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fxtxv" event={"ID":"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6","Type":"ContainerStarted","Data":"4c2d47fcaed9c9a82301f825de4c4b8c3e97668f3de1a3bc64d9dbad2395f13f"} Jul 15 21:11:49.173340 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:49.173017 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fxtxv" event={"ID":"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6","Type":"ContainerStarted","Data":"59841f579f8f94388b8e09d9c1f09f10d00e9b1c6696c83e87a8a654d467fcbf"} Jul 15 21:11:49.337560 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:49.337479 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c971c1a-7fac-484d-bc79-65bef4b1e03f" path="/var/lib/kubelet/pods/8c971c1a-7fac-484d-bc79-65bef4b1e03f/volumes" Jul 15 21:11:50.183619 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:50.183522 2578 generic.go:356] "Generic (PLEG): container finished" podID="d660a20e-f03a-44f9-b1c5-e94bb77d0e3e" containerID="1533c8c0232704f04ee0cd63f5d4683b4c5c241116e9ea6e4c772f2b07b7881f" exitCode=0 Jul 15 21:11:50.183619 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:50.183598 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" event={"ID":"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e","Type":"ContainerDied","Data":"1533c8c0232704f04ee0cd63f5d4683b4c5c241116e9ea6e4c772f2b07b7881f"} Jul 15 21:11:50.184127 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:50.184023 2578 scope.go:117] "RemoveContainer" containerID="1533c8c0232704f04ee0cd63f5d4683b4c5c241116e9ea6e4c772f2b07b7881f" Jul 15 21:11:50.185596 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:50.185568 2578 generic.go:356] "Generic (PLEG): container finished" podID="ba5075a3-2701-42ca-94a4-506afa04f56e" containerID="9a1cb1bc060dfd116130a151ef679801172efd6d510263dcd549387ceec98038" exitCode=0 Jul 15 21:11:50.185721 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:50.185637 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" event={"ID":"ba5075a3-2701-42ca-94a4-506afa04f56e","Type":"ContainerDied","Data":"9a1cb1bc060dfd116130a151ef679801172efd6d510263dcd549387ceec98038"} Jul 15 21:11:50.185995 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:50.185979 2578 scope.go:117] "RemoveContainer" containerID="9a1cb1bc060dfd116130a151ef679801172efd6d510263dcd549387ceec98038" Jul 15 21:11:50.187670 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:50.187647 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fxtxv" event={"ID":"e3f782c6-eee1-4867-b1c7-52b75c1bb2d6","Type":"ContainerStarted","Data":"33a2a50f285b08adcfda49f7d062a7da5a45b505af1744bab22584b14ae7c800"} Jul 15 21:11:50.222053 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:50.221990 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fxtxv" podStartSLOduration=129.408398858 podStartE2EDuration="2m10.221971758s" totalImagesPullingTime="813.5729ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:50.22026916 +0000 UTC m=+131.408749681" watchObservedRunningTime="2026-07-15 21:11:50.221971758 +0000 UTC m=+131.410452280" Jul 15 21:11:51.195864 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:51.195796 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6pnfg" event={"ID":"d660a20e-f03a-44f9-b1c5-e94bb77d0e3e","Type":"ContainerStarted","Data":"9e336fa983fb8ded742b21420b6ac6ce558288cfbbc34c5ed303c16c43b70615"} Jul 15 21:11:51.197982 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:11:51.197955 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wz2zh" event={"ID":"ba5075a3-2701-42ca-94a4-506afa04f56e","Type":"ContainerStarted","Data":"d2b6096ad3ca155cffc51bd6d2e8e1d51174857cab80e50b56d4eebd8011de45"} Jul 15 21:12:01.237265 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:12:01.237230 2578 generic.go:356] "Generic (PLEG): container finished" podID="de413493-569c-4559-a915-24f958922892" containerID="91a0000092354ad3969021da466620b82113694b3ad729afbc12881218b258f2" exitCode=0 Jul 15 21:12:01.237682 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:12:01.237317 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" event={"ID":"de413493-569c-4559-a915-24f958922892","Type":"ContainerDied","Data":"91a0000092354ad3969021da466620b82113694b3ad729afbc12881218b258f2"} Jul 15 21:12:01.237682 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:12:01.237663 2578 scope.go:117] "RemoveContainer" containerID="91a0000092354ad3969021da466620b82113694b3ad729afbc12881218b258f2" Jul 15 21:12:02.243525 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:12:02.243486 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-cbrf6" event={"ID":"de413493-569c-4559-a915-24f958922892","Type":"ContainerStarted","Data":"caf85dc26b0ec08189799196042eb623f4d1d2f62f4f732ab2a26ebfe9b29b94"} Jul 15 21:14:35.977762 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:35.977729 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k"] Jul 15 21:14:35.978190 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:35.978023 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c971c1a-7fac-484d-bc79-65bef4b1e03f" containerName="registry" Jul 15 21:14:35.978190 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:35.978051 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c971c1a-7fac-484d-bc79-65bef4b1e03f" containerName="registry" Jul 15 21:14:35.978190 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:35.978114 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c971c1a-7fac-484d-bc79-65bef4b1e03f" containerName="registry" Jul 15 21:14:35.980705 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:35.980686 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:35.983249 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:35.983219 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 21:14:35.983375 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:35.983332 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7nfqq\"" Jul 15 21:14:35.983658 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:35.983639 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 21:14:35.983806 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:35.983755 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 21:14:35.983983 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:35.983965 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 21:14:35.997506 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:35.997476 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k"] Jul 15 21:14:36.036927 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.036885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/778ac274-07e5-43f7-984e-2eb4f40462aa-manifests\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.036927 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.036932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/778ac274-07e5-43f7-984e-2eb4f40462aa-tmp\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.037174 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.036972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/778ac274-07e5-43f7-984e-2eb4f40462aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.037174 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.036993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/778ac274-07e5-43f7-984e-2eb4f40462aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.037174 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.037066 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj65p\" (UniqueName: \"kubernetes.io/projected/778ac274-07e5-43f7-984e-2eb4f40462aa-kube-api-access-pj65p\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.137982 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.137941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj65p\" (UniqueName: \"kubernetes.io/projected/778ac274-07e5-43f7-984e-2eb4f40462aa-kube-api-access-pj65p\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.138180 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.137995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/778ac274-07e5-43f7-984e-2eb4f40462aa-manifests\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.138180 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.138017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/778ac274-07e5-43f7-984e-2eb4f40462aa-tmp\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.138180 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.138098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/778ac274-07e5-43f7-984e-2eb4f40462aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.138180 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.138128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/778ac274-07e5-43f7-984e-2eb4f40462aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.138481 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.138460 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/778ac274-07e5-43f7-984e-2eb4f40462aa-manifests\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.140442 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.140412 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/778ac274-07e5-43f7-984e-2eb4f40462aa-tmp\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.140673 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.140655 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/778ac274-07e5-43f7-984e-2eb4f40462aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.140714 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.140686 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/778ac274-07e5-43f7-984e-2eb4f40462aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.146276 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.146253 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj65p\" (UniqueName: \"kubernetes.io/projected/778ac274-07e5-43f7-984e-2eb4f40462aa-kube-api-access-pj65p\") pod \"opendatahub-operator-controller-manager-5f656749fc-7758k\" (UID: \"778ac274-07e5-43f7-984e-2eb4f40462aa\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.292491 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.292395 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:36.430673 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.430645 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k"] Jul 15 21:14:36.433919 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:14:36.433893 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778ac274_07e5_43f7_984e_2eb4f40462aa.slice/crio-79c87441d4077c7180093b887581a73f02b3475b0820f9f8070868edee13c252 WatchSource:0}: Error finding container 79c87441d4077c7180093b887581a73f02b3475b0820f9f8070868edee13c252: Status 404 returned error can't find the container with id 79c87441d4077c7180093b887581a73f02b3475b0820f9f8070868edee13c252 Jul 15 21:14:36.851599 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:36.851564 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" event={"ID":"778ac274-07e5-43f7-984e-2eb4f40462aa","Type":"ContainerStarted","Data":"79c87441d4077c7180093b887581a73f02b3475b0820f9f8070868edee13c252"} Jul 15 21:14:39.374008 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:39.373968 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:14:39.374423 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:39.374383 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:14:39.378966 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:39.378941 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:14:39.379545 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:39.379520 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:14:39.385539 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:39.385519 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 21:14:39.866330 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:39.866294 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" event={"ID":"778ac274-07e5-43f7-984e-2eb4f40462aa","Type":"ContainerStarted","Data":"b8b4f7714440b4178de6bc50f8954e40904677dfa0eb65ec1a9b59ee02d3451c"} Jul 15 21:14:40.872474 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:40.872443 2578 generic.go:356] "Generic (PLEG): container finished" podID="778ac274-07e5-43f7-984e-2eb4f40462aa" containerID="b8b4f7714440b4178de6bc50f8954e40904677dfa0eb65ec1a9b59ee02d3451c" exitCode=0 Jul 15 21:14:40.872871 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:40.872480 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" event={"ID":"778ac274-07e5-43f7-984e-2eb4f40462aa","Type":"ContainerDied","Data":"b8b4f7714440b4178de6bc50f8954e40904677dfa0eb65ec1a9b59ee02d3451c"} Jul 15 21:14:40.873051 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:40.873011 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:14:41.878511 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:41.878475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" event={"ID":"778ac274-07e5-43f7-984e-2eb4f40462aa","Type":"ContainerStarted","Data":"1987794de7bb311f4881fe46cf27547eadceecd12ac51d4c85904134856d4c1e"} Jul 15 21:14:41.878918 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:41.878617 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:14:41.951759 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:41.951704 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" podStartSLOduration=2.555247683 podStartE2EDuration="6.951684741s" totalImagesPullingTime="3.323617777s" totalInitContainerRuntime="1.072819281s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:14:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:14:41.944958388 +0000 UTC m=+303.133438910" watchObservedRunningTime="2026-07-15 21:14:41.951684741 +0000 UTC m=+303.140165262" Jul 15 21:14:52.885955 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:14:52.885922 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-7758k" Jul 15 21:15:04.823373 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.823337 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg"] Jul 15 21:15:04.825861 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.825840 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:04.829131 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.829086 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zwtvz\"" Jul 15 21:15:04.829973 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.829949 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:15:04.830282 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.830267 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 21:15:04.830347 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.830325 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 21:15:04.830401 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.830355 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 21:15:04.831430 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.831412 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 21:15:04.850688 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.850655 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg"] Jul 15 21:15:04.883645 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.883611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/37659c91-79ad-4b06-8a88-8ddbb0796b53-metrics-cert\") pod \"lws-controller-manager-764bf7f9d4-lcbkg\" (UID: \"37659c91-79ad-4b06-8a88-8ddbb0796b53\") " pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:04.883825 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.883699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcdv6\" (UniqueName: \"kubernetes.io/projected/37659c91-79ad-4b06-8a88-8ddbb0796b53-kube-api-access-mcdv6\") pod \"lws-controller-manager-764bf7f9d4-lcbkg\" (UID: \"37659c91-79ad-4b06-8a88-8ddbb0796b53\") " pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:04.883825 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.883727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/37659c91-79ad-4b06-8a88-8ddbb0796b53-manager-config\") pod \"lws-controller-manager-764bf7f9d4-lcbkg\" (UID: \"37659c91-79ad-4b06-8a88-8ddbb0796b53\") " pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:04.883825 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.883750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37659c91-79ad-4b06-8a88-8ddbb0796b53-cert\") pod \"lws-controller-manager-764bf7f9d4-lcbkg\" (UID: \"37659c91-79ad-4b06-8a88-8ddbb0796b53\") " pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:04.985049 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.985006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcdv6\" (UniqueName: \"kubernetes.io/projected/37659c91-79ad-4b06-8a88-8ddbb0796b53-kube-api-access-mcdv6\") pod \"lws-controller-manager-764bf7f9d4-lcbkg\" (UID: \"37659c91-79ad-4b06-8a88-8ddbb0796b53\") " pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:04.985235 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.985069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/37659c91-79ad-4b06-8a88-8ddbb0796b53-manager-config\") pod \"lws-controller-manager-764bf7f9d4-lcbkg\" (UID: \"37659c91-79ad-4b06-8a88-8ddbb0796b53\") " pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:04.985305 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.985251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37659c91-79ad-4b06-8a88-8ddbb0796b53-cert\") pod \"lws-controller-manager-764bf7f9d4-lcbkg\" (UID: \"37659c91-79ad-4b06-8a88-8ddbb0796b53\") " pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:04.985408 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.985390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/37659c91-79ad-4b06-8a88-8ddbb0796b53-metrics-cert\") pod \"lws-controller-manager-764bf7f9d4-lcbkg\" (UID: \"37659c91-79ad-4b06-8a88-8ddbb0796b53\") " pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:04.985713 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.985694 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/37659c91-79ad-4b06-8a88-8ddbb0796b53-manager-config\") pod \"lws-controller-manager-764bf7f9d4-lcbkg\" (UID: \"37659c91-79ad-4b06-8a88-8ddbb0796b53\") " pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:04.987809 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.987780 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37659c91-79ad-4b06-8a88-8ddbb0796b53-cert\") pod \"lws-controller-manager-764bf7f9d4-lcbkg\" (UID: \"37659c91-79ad-4b06-8a88-8ddbb0796b53\") " pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:04.987917 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:04.987852 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/37659c91-79ad-4b06-8a88-8ddbb0796b53-metrics-cert\") pod \"lws-controller-manager-764bf7f9d4-lcbkg\" (UID: \"37659c91-79ad-4b06-8a88-8ddbb0796b53\") " pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:05.005110 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:05.005080 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcdv6\" (UniqueName: \"kubernetes.io/projected/37659c91-79ad-4b06-8a88-8ddbb0796b53-kube-api-access-mcdv6\") pod \"lws-controller-manager-764bf7f9d4-lcbkg\" (UID: \"37659c91-79ad-4b06-8a88-8ddbb0796b53\") " pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:05.136259 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:05.136222 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:05.290531 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:05.290498 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg"] Jul 15 21:15:05.294883 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:15:05.294848 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37659c91_79ad_4b06_8a88_8ddbb0796b53.slice/crio-10f896e237819309db3f112fb3f38349c5d7130d589e9f4493b84c9de895d181 WatchSource:0}: Error finding container 10f896e237819309db3f112fb3f38349c5d7130d589e9f4493b84c9de895d181: Status 404 returned error can't find the container with id 10f896e237819309db3f112fb3f38349c5d7130d589e9f4493b84c9de895d181 Jul 15 21:15:05.985361 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:05.985322 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" event={"ID":"37659c91-79ad-4b06-8a88-8ddbb0796b53","Type":"ContainerStarted","Data":"10f896e237819309db3f112fb3f38349c5d7130d589e9f4493b84c9de895d181"} Jul 15 21:15:09.005174 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:09.005133 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" event={"ID":"37659c91-79ad-4b06-8a88-8ddbb0796b53","Type":"ContainerStarted","Data":"04da353e3923229cb2635e7d769bb2ad04b1990a382753ecabdb3002653e6a4b"} Jul 15 21:15:09.005562 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:09.005265 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:09.034692 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:09.034637 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" podStartSLOduration=2.094432346 podStartE2EDuration="5.034618463s" totalImagesPullingTime="2.940186117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:09.034574561 +0000 UTC m=+330.223055083" watchObservedRunningTime="2026-07-15 21:15:09.034618463 +0000 UTC m=+330.223098985" Jul 15 21:15:20.012169 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:20.012137 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-764bf7f9d4-lcbkg" Jul 15 21:15:56.788468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:56.788388 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxtlj"] Jul 15 21:15:56.793198 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:56.793168 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" Jul 15 21:15:56.796163 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:56.796112 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 21:15:56.796523 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:56.796502 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zgkqf\"" Jul 15 21:15:56.803370 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:56.803339 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 21:15:56.807537 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:56.807510 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxtlj"] Jul 15 21:15:56.816535 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:56.816495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rtpf\" (UniqueName: \"kubernetes.io/projected/93f7f702-9c7f-47d3-8d6f-5003e1209ed7-kube-api-access-2rtpf\") pod \"kuadrant-operator-catalog-wxtlj\" (UID: \"93f7f702-9c7f-47d3-8d6f-5003e1209ed7\") " pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" Jul 15 21:15:56.917280 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:56.917240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rtpf\" (UniqueName: \"kubernetes.io/projected/93f7f702-9c7f-47d3-8d6f-5003e1209ed7-kube-api-access-2rtpf\") pod \"kuadrant-operator-catalog-wxtlj\" (UID: \"93f7f702-9c7f-47d3-8d6f-5003e1209ed7\") " pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" Jul 15 21:15:56.926406 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:56.926376 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rtpf\" (UniqueName: \"kubernetes.io/projected/93f7f702-9c7f-47d3-8d6f-5003e1209ed7-kube-api-access-2rtpf\") pod \"kuadrant-operator-catalog-wxtlj\" (UID: \"93f7f702-9c7f-47d3-8d6f-5003e1209ed7\") " pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" Jul 15 21:15:57.112464 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:57.112432 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" Jul 15 21:15:57.145421 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:57.145391 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxtlj"] Jul 15 21:15:57.250834 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:57.250739 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxtlj"] Jul 15 21:15:57.253576 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:15:57.253547 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f7f702_9c7f_47d3_8d6f_5003e1209ed7.slice/crio-0fd5865eb59534e888cbba1379b125c13f404ba656cad8c6f85f95fc78cd4abe WatchSource:0}: Error finding container 0fd5865eb59534e888cbba1379b125c13f404ba656cad8c6f85f95fc78cd4abe: Status 404 returned error can't find the container with id 0fd5865eb59534e888cbba1379b125c13f404ba656cad8c6f85f95fc78cd4abe Jul 15 21:15:57.355425 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:57.355388 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2r687"] Jul 15 21:15:57.359921 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:57.359901 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2r687" Jul 15 21:15:57.367925 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:57.367906 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2r687"] Jul 15 21:15:57.421151 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:57.421113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtfmg\" (UniqueName: \"kubernetes.io/projected/8378f36e-c96f-4fc2-a69c-905afd486d9e-kube-api-access-rtfmg\") pod \"kuadrant-operator-catalog-2r687\" (UID: \"8378f36e-c96f-4fc2-a69c-905afd486d9e\") " pod="kuadrant-system/kuadrant-operator-catalog-2r687" Jul 15 21:15:57.522609 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:57.522569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtfmg\" (UniqueName: \"kubernetes.io/projected/8378f36e-c96f-4fc2-a69c-905afd486d9e-kube-api-access-rtfmg\") pod \"kuadrant-operator-catalog-2r687\" (UID: \"8378f36e-c96f-4fc2-a69c-905afd486d9e\") " pod="kuadrant-system/kuadrant-operator-catalog-2r687" Jul 15 21:15:57.531864 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:57.531834 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtfmg\" (UniqueName: \"kubernetes.io/projected/8378f36e-c96f-4fc2-a69c-905afd486d9e-kube-api-access-rtfmg\") pod \"kuadrant-operator-catalog-2r687\" (UID: \"8378f36e-c96f-4fc2-a69c-905afd486d9e\") " pod="kuadrant-system/kuadrant-operator-catalog-2r687" Jul 15 21:15:57.669945 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:57.669860 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2r687" Jul 15 21:15:57.810595 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:57.810536 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2r687"] Jul 15 21:15:57.813191 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:15:57.813160 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8378f36e_c96f_4fc2_a69c_905afd486d9e.slice/crio-e7009d3a4c3c37185afb075a2e2c3301091516c570f2d804ea129010943b71aa WatchSource:0}: Error finding container e7009d3a4c3c37185afb075a2e2c3301091516c570f2d804ea129010943b71aa: Status 404 returned error can't find the container with id e7009d3a4c3c37185afb075a2e2c3301091516c570f2d804ea129010943b71aa Jul 15 21:15:58.226190 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:58.226156 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" event={"ID":"93f7f702-9c7f-47d3-8d6f-5003e1209ed7","Type":"ContainerStarted","Data":"0fd5865eb59534e888cbba1379b125c13f404ba656cad8c6f85f95fc78cd4abe"} Jul 15 21:15:58.227701 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:15:58.227653 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2r687" event={"ID":"8378f36e-c96f-4fc2-a69c-905afd486d9e","Type":"ContainerStarted","Data":"e7009d3a4c3c37185afb075a2e2c3301091516c570f2d804ea129010943b71aa"} Jul 15 21:16:00.239628 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:00.239587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2r687" event={"ID":"8378f36e-c96f-4fc2-a69c-905afd486d9e","Type":"ContainerStarted","Data":"f96031193b882fa7ddee9171d87d3443224e68e9b4f9d4215d759d96a51e729e"} Jul 15 21:16:00.240985 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:00.240960 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" event={"ID":"93f7f702-9c7f-47d3-8d6f-5003e1209ed7","Type":"ContainerStarted","Data":"30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da"} Jul 15 21:16:00.241109 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:00.240977 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" podUID="93f7f702-9c7f-47d3-8d6f-5003e1209ed7" containerName="registry-server" containerID="cri-o://30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da" gracePeriod=2 Jul 15 21:16:00.258755 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:00.258707 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2r687" podStartSLOduration=1.7378911000000001 podStartE2EDuration="3.258691002s" totalImagesPullingTime="1.520799902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:00.257153605 +0000 UTC m=+381.445634130" watchObservedRunningTime="2026-07-15 21:16:00.258691002 +0000 UTC m=+381.447171505" Jul 15 21:16:00.275263 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:00.275217 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" podStartSLOduration=2.195157152 podStartE2EDuration="4.275200905s" totalImagesPullingTime="2.080043753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:00.273670148 +0000 UTC m=+381.462150692" watchObservedRunningTime="2026-07-15 21:16:00.275200905 +0000 UTC m=+381.463681426" Jul 15 21:16:00.482996 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:00.482969 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" Jul 15 21:16:00.552937 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:00.552850 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rtpf\" (UniqueName: \"kubernetes.io/projected/93f7f702-9c7f-47d3-8d6f-5003e1209ed7-kube-api-access-2rtpf\") pod \"93f7f702-9c7f-47d3-8d6f-5003e1209ed7\" (UID: \"93f7f702-9c7f-47d3-8d6f-5003e1209ed7\") " Jul 15 21:16:00.555071 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:00.555022 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f7f702-9c7f-47d3-8d6f-5003e1209ed7-kube-api-access-2rtpf" (OuterVolumeSpecName: "kube-api-access-2rtpf") pod "93f7f702-9c7f-47d3-8d6f-5003e1209ed7" (UID: "93f7f702-9c7f-47d3-8d6f-5003e1209ed7"). InnerVolumeSpecName "kube-api-access-2rtpf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:16:00.653854 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:00.653810 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rtpf\" (UniqueName: \"kubernetes.io/projected/93f7f702-9c7f-47d3-8d6f-5003e1209ed7-kube-api-access-2rtpf\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:16:01.247018 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:01.246979 2578 generic.go:356] "Generic (PLEG): container finished" podID="93f7f702-9c7f-47d3-8d6f-5003e1209ed7" containerID="30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da" exitCode=0 Jul 15 21:16:01.247447 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:01.247071 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" Jul 15 21:16:01.247447 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:01.247074 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" event={"ID":"93f7f702-9c7f-47d3-8d6f-5003e1209ed7","Type":"ContainerDied","Data":"30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da"} Jul 15 21:16:01.247447 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:01.247156 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxtlj" event={"ID":"93f7f702-9c7f-47d3-8d6f-5003e1209ed7","Type":"ContainerDied","Data":"0fd5865eb59534e888cbba1379b125c13f404ba656cad8c6f85f95fc78cd4abe"} Jul 15 21:16:01.247447 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:01.247181 2578 scope.go:117] "RemoveContainer" containerID="30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da" Jul 15 21:16:01.256449 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:01.256431 2578 scope.go:117] "RemoveContainer" containerID="30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da" Jul 15 21:16:01.256674 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:16:01.256658 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da\": container with ID starting with 30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da not found: ID does not exist" containerID="30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da" Jul 15 21:16:01.256717 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:01.256682 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da"} err="failed to get container status \"30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da\": rpc error: code = NotFound desc = could not find container \"30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da\": container with ID starting with 30fe5373dce7e9e5732b6cf0fd9c97dcd0b575bcbcb27689fe688a59c9c234da not found: ID does not exist" Jul 15 21:16:01.271078 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:01.271045 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxtlj"] Jul 15 21:16:01.275609 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:01.275578 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxtlj"] Jul 15 21:16:01.337070 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:01.337017 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93f7f702-9c7f-47d3-8d6f-5003e1209ed7" path="/var/lib/kubelet/pods/93f7f702-9c7f-47d3-8d6f-5003e1209ed7/volumes" Jul 15 21:16:07.670284 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:07.670236 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2r687" Jul 15 21:16:07.670802 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:07.670308 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2r687" Jul 15 21:16:07.693108 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:07.693081 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2r687" Jul 15 21:16:08.298656 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:08.298629 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2r687" Jul 15 21:16:29.390716 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:29.390684 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-47q2k"] Jul 15 21:16:29.391138 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:29.391016 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f7f702-9c7f-47d3-8d6f-5003e1209ed7" containerName="registry-server" Jul 15 21:16:29.391138 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:29.391044 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f7f702-9c7f-47d3-8d6f-5003e1209ed7" containerName="registry-server" Jul 15 21:16:29.391138 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:29.391111 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f7f702-9c7f-47d3-8d6f-5003e1209ed7" containerName="registry-server" Jul 15 21:16:29.395197 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:29.395175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-47q2k" Jul 15 21:16:29.397956 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:29.397931 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9rd52\"" Jul 15 21:16:29.406492 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:29.406467 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-47q2k"] Jul 15 21:16:29.495722 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:29.495687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r472t\" (UniqueName: \"kubernetes.io/projected/2b8e21df-249a-433b-8f84-fba6b7d2a6fb-kube-api-access-r472t\") pod \"authorino-operator-75cc8d5cb7-47q2k\" (UID: \"2b8e21df-249a-433b-8f84-fba6b7d2a6fb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-47q2k" Jul 15 21:16:29.596848 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:29.596811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r472t\" (UniqueName: \"kubernetes.io/projected/2b8e21df-249a-433b-8f84-fba6b7d2a6fb-kube-api-access-r472t\") pod \"authorino-operator-75cc8d5cb7-47q2k\" (UID: \"2b8e21df-249a-433b-8f84-fba6b7d2a6fb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-47q2k" Jul 15 21:16:29.614924 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:29.614885 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r472t\" (UniqueName: \"kubernetes.io/projected/2b8e21df-249a-433b-8f84-fba6b7d2a6fb-kube-api-access-r472t\") pod \"authorino-operator-75cc8d5cb7-47q2k\" (UID: \"2b8e21df-249a-433b-8f84-fba6b7d2a6fb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-47q2k" Jul 15 21:16:29.705235 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:29.705141 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-47q2k" Jul 15 21:16:29.886909 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:29.886875 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-47q2k"] Jul 15 21:16:29.890684 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:16:29.890644 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8e21df_249a_433b_8f84_fba6b7d2a6fb.slice/crio-c665125dd46b8b2f7d02b2e2f94deffd1dc3647326a2f1eb1c65fa117b207527 WatchSource:0}: Error finding container c665125dd46b8b2f7d02b2e2f94deffd1dc3647326a2f1eb1c65fa117b207527: Status 404 returned error can't find the container with id c665125dd46b8b2f7d02b2e2f94deffd1dc3647326a2f1eb1c65fa117b207527 Jul 15 21:16:30.382937 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:30.382902 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-47q2k" event={"ID":"2b8e21df-249a-433b-8f84-fba6b7d2a6fb","Type":"ContainerStarted","Data":"c665125dd46b8b2f7d02b2e2f94deffd1dc3647326a2f1eb1c65fa117b207527"} Jul 15 21:16:33.405466 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:33.405426 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-47q2k" event={"ID":"2b8e21df-249a-433b-8f84-fba6b7d2a6fb","Type":"ContainerStarted","Data":"1c86059cd4eae3953b2869b935f4fb73d505f7a442f905cda45aff337c3017bf"} Jul 15 21:16:33.405902 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:33.405603 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-47q2k" Jul 15 21:16:43.134205 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.134137 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-47q2k" podStartSLOduration=11.275088239 podStartE2EDuration="14.134114826s" totalImagesPullingTime="2.859026587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:33.430052384 +0000 UTC m=+414.618532918" watchObservedRunningTime="2026-07-15 21:16:43.134114826 +0000 UTC m=+424.322595349" Jul 15 21:16:43.135536 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.135514 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7"] Jul 15 21:16:43.142408 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.142384 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" Jul 15 21:16:43.145370 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.145343 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 15 21:16:43.145509 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.145383 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 15 21:16:43.145509 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.145385 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2ggjl\"" Jul 15 21:16:43.148524 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.148475 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7"] Jul 15 21:16:43.216211 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.216176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a7d021da-e92e-4dc6-8ff3-8a6979a046fd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rcnd7\" (UID: \"a7d021da-e92e-4dc6-8ff3-8a6979a046fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" Jul 15 21:16:43.216389 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.216227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7d021da-e92e-4dc6-8ff3-8a6979a046fd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rcnd7\" (UID: \"a7d021da-e92e-4dc6-8ff3-8a6979a046fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" Jul 15 21:16:43.216389 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.216355 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fft5p\" (UniqueName: \"kubernetes.io/projected/a7d021da-e92e-4dc6-8ff3-8a6979a046fd-kube-api-access-fft5p\") pod \"kuadrant-console-plugin-66b5774985-rcnd7\" (UID: \"a7d021da-e92e-4dc6-8ff3-8a6979a046fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" Jul 15 21:16:43.317273 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.317237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fft5p\" (UniqueName: \"kubernetes.io/projected/a7d021da-e92e-4dc6-8ff3-8a6979a046fd-kube-api-access-fft5p\") pod \"kuadrant-console-plugin-66b5774985-rcnd7\" (UID: \"a7d021da-e92e-4dc6-8ff3-8a6979a046fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" Jul 15 21:16:43.317469 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.317299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a7d021da-e92e-4dc6-8ff3-8a6979a046fd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rcnd7\" (UID: \"a7d021da-e92e-4dc6-8ff3-8a6979a046fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" Jul 15 21:16:43.317469 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.317326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7d021da-e92e-4dc6-8ff3-8a6979a046fd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rcnd7\" (UID: \"a7d021da-e92e-4dc6-8ff3-8a6979a046fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" Jul 15 21:16:43.318022 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.317992 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a7d021da-e92e-4dc6-8ff3-8a6979a046fd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rcnd7\" (UID: \"a7d021da-e92e-4dc6-8ff3-8a6979a046fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" Jul 15 21:16:43.319703 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.319677 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7d021da-e92e-4dc6-8ff3-8a6979a046fd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rcnd7\" (UID: \"a7d021da-e92e-4dc6-8ff3-8a6979a046fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" Jul 15 21:16:43.327701 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.327669 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fft5p\" (UniqueName: \"kubernetes.io/projected/a7d021da-e92e-4dc6-8ff3-8a6979a046fd-kube-api-access-fft5p\") pod \"kuadrant-console-plugin-66b5774985-rcnd7\" (UID: \"a7d021da-e92e-4dc6-8ff3-8a6979a046fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" Jul 15 21:16:43.454099 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.454004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" Jul 15 21:16:43.593357 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:43.593309 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7"] Jul 15 21:16:43.595990 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:16:43.595956 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7d021da_e92e_4dc6_8ff3_8a6979a046fd.slice/crio-0c0f57906eba29c4cd96be3f2ed3b1e7b3b4fe8a8b2da378fbb247270d003e02 WatchSource:0}: Error finding container 0c0f57906eba29c4cd96be3f2ed3b1e7b3b4fe8a8b2da378fbb247270d003e02: Status 404 returned error can't find the container with id 0c0f57906eba29c4cd96be3f2ed3b1e7b3b4fe8a8b2da378fbb247270d003e02 Jul 15 21:16:44.412187 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:44.412153 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-47q2k" Jul 15 21:16:44.455738 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:44.455698 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" event={"ID":"a7d021da-e92e-4dc6-8ff3-8a6979a046fd","Type":"ContainerStarted","Data":"0c0f57906eba29c4cd96be3f2ed3b1e7b3b4fe8a8b2da378fbb247270d003e02"} Jul 15 21:16:53.549408 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:53.549373 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx"] Jul 15 21:16:53.570273 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:53.570189 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:16:53.570886 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:53.570698 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx"] Jul 15 21:16:53.574339 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:53.574314 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jm226\"" Jul 15 21:16:53.610371 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:53.610322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rflj2\" (UniqueName: \"kubernetes.io/projected/222a33e1-ffe7-4761-82e1-54a197bb24a3-kube-api-access-rflj2\") pod \"kuadrant-operator-controller-manager-86878c769f-tjcqx\" (UID: \"222a33e1-ffe7-4761-82e1-54a197bb24a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:16:53.610580 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:53.610411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/222a33e1-ffe7-4761-82e1-54a197bb24a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tjcqx\" (UID: \"222a33e1-ffe7-4761-82e1-54a197bb24a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:16:53.641243 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:53.641186 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx"] Jul 15 21:16:53.641597 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:16:53.641530 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-rflj2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" podUID="222a33e1-ffe7-4761-82e1-54a197bb24a3" Jul 15 21:16:53.644199 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:53.644133 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx"] Jul 15 21:16:53.711088 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:53.711053 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rflj2\" (UniqueName: \"kubernetes.io/projected/222a33e1-ffe7-4761-82e1-54a197bb24a3-kube-api-access-rflj2\") pod \"kuadrant-operator-controller-manager-86878c769f-tjcqx\" (UID: \"222a33e1-ffe7-4761-82e1-54a197bb24a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:16:53.711275 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:53.711121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/222a33e1-ffe7-4761-82e1-54a197bb24a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tjcqx\" (UID: \"222a33e1-ffe7-4761-82e1-54a197bb24a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:16:53.711621 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:53.711579 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/222a33e1-ffe7-4761-82e1-54a197bb24a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tjcqx\" (UID: \"222a33e1-ffe7-4761-82e1-54a197bb24a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:16:53.713450 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:16:53.713425 2578 projected.go:196] Error preparing data for projected volume kube-api-access-rflj2 for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-136-107.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-136-107.ec2.internal' and this object Jul 15 21:16:53.713552 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:16:53.713502 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/222a33e1-ffe7-4761-82e1-54a197bb24a3-kube-api-access-rflj2 podName:222a33e1-ffe7-4761-82e1-54a197bb24a3 nodeName:}" failed. No retries permitted until 2026-07-15 21:16:54.213480154 +0000 UTC m=+435.401960666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rflj2" (UniqueName: "kubernetes.io/projected/222a33e1-ffe7-4761-82e1-54a197bb24a3-kube-api-access-rflj2") pod "kuadrant-operator-controller-manager-86878c769f-tjcqx" (UID: "222a33e1-ffe7-4761-82e1-54a197bb24a3") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-136-107.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-136-107.ec2.internal' and this object Jul 15 21:16:54.216621 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:54.216578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rflj2\" (UniqueName: \"kubernetes.io/projected/222a33e1-ffe7-4761-82e1-54a197bb24a3-kube-api-access-rflj2\") pod \"kuadrant-operator-controller-manager-86878c769f-tjcqx\" (UID: \"222a33e1-ffe7-4761-82e1-54a197bb24a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:16:54.218983 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:16:54.218957 2578 projected.go:196] Error preparing data for projected volume kube-api-access-rflj2 for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-136-107.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-136-107.ec2.internal' and this object Jul 15 21:16:54.219137 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:16:54.219063 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/222a33e1-ffe7-4761-82e1-54a197bb24a3-kube-api-access-rflj2 podName:222a33e1-ffe7-4761-82e1-54a197bb24a3 nodeName:}" failed. No retries permitted until 2026-07-15 21:16:55.219045847 +0000 UTC m=+436.407526349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rflj2" (UniqueName: "kubernetes.io/projected/222a33e1-ffe7-4761-82e1-54a197bb24a3-kube-api-access-rflj2") pod "kuadrant-operator-controller-manager-86878c769f-tjcqx" (UID: "222a33e1-ffe7-4761-82e1-54a197bb24a3") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-136-107.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-136-107.ec2.internal' and this object Jul 15 21:16:54.512193 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:54.512112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:16:54.515065 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:16:54.515012 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-tjcqx\" is forbidden: User \"system:node:ip-10-0-136-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-107.ec2.internal' and this object" podUID="222a33e1-ffe7-4761-82e1-54a197bb24a3" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:16:54.534827 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:54.534783 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:16:54.537218 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:16:54.537179 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-tjcqx\" is forbidden: User \"system:node:ip-10-0-136-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-107.ec2.internal' and this object" podUID="222a33e1-ffe7-4761-82e1-54a197bb24a3" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:16:54.621461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:54.621425 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/222a33e1-ffe7-4761-82e1-54a197bb24a3-extensions-socket-volume\") pod \"222a33e1-ffe7-4761-82e1-54a197bb24a3\" (UID: \"222a33e1-ffe7-4761-82e1-54a197bb24a3\") " Jul 15 21:16:54.621902 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:54.621657 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rflj2\" (UniqueName: \"kubernetes.io/projected/222a33e1-ffe7-4761-82e1-54a197bb24a3-kube-api-access-rflj2\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:16:54.621902 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:54.621738 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/222a33e1-ffe7-4761-82e1-54a197bb24a3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "222a33e1-ffe7-4761-82e1-54a197bb24a3" (UID: "222a33e1-ffe7-4761-82e1-54a197bb24a3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:16:54.722745 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:54.722708 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/222a33e1-ffe7-4761-82e1-54a197bb24a3-extensions-socket-volume\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:16:55.338445 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:55.338404 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="222a33e1-ffe7-4761-82e1-54a197bb24a3" path="/var/lib/kubelet/pods/222a33e1-ffe7-4761-82e1-54a197bb24a3/volumes" Jul 15 21:16:55.516743 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:16:55.516705 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:16:55.522078 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:16:55.521989 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-tjcqx\" is forbidden: User \"system:node:ip-10-0-136-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-107.ec2.internal' and this object" podUID="222a33e1-ffe7-4761-82e1-54a197bb24a3" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tjcqx" Jul 15 21:17:06.580913 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:06.580813 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" event={"ID":"a7d021da-e92e-4dc6-8ff3-8a6979a046fd","Type":"ContainerStarted","Data":"8aac0d757bc188615e97cb83a998ec3fbb61d0d901db861fc6b21cdae090599e"} Jul 15 21:17:06.601548 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:06.601491 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rcnd7" podStartSLOduration=1.062289533 podStartE2EDuration="23.601472192s" totalImagesPullingTime="22.539182659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:06.599638117 +0000 UTC m=+447.788118630" watchObservedRunningTime="2026-07-15 21:17:06.601472192 +0000 UTC m=+447.789952713" Jul 15 21:17:24.196890 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.196842 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jjndn"] Jul 15 21:17:24.228551 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.228511 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jjndn"] Jul 15 21:17:24.228707 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.228641 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" Jul 15 21:17:24.239390 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.239366 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 15 21:17:24.291533 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.291501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bdd8e208-920a-418b-98c3-f240a07ed57d-config-file\") pod \"limitador-limitador-64c94fd64f-jjndn\" (UID: \"bdd8e208-920a-418b-98c3-f240a07ed57d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" Jul 15 21:17:24.291799 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.291578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g5z9\" (UniqueName: \"kubernetes.io/projected/bdd8e208-920a-418b-98c3-f240a07ed57d-kube-api-access-6g5z9\") pod \"limitador-limitador-64c94fd64f-jjndn\" (UID: \"bdd8e208-920a-418b-98c3-f240a07ed57d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" Jul 15 21:17:24.296207 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.296172 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jjndn"] Jul 15 21:17:24.392114 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.392080 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5z9\" (UniqueName: \"kubernetes.io/projected/bdd8e208-920a-418b-98c3-f240a07ed57d-kube-api-access-6g5z9\") pod \"limitador-limitador-64c94fd64f-jjndn\" (UID: \"bdd8e208-920a-418b-98c3-f240a07ed57d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" Jul 15 21:17:24.392290 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.392128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bdd8e208-920a-418b-98c3-f240a07ed57d-config-file\") pod \"limitador-limitador-64c94fd64f-jjndn\" (UID: \"bdd8e208-920a-418b-98c3-f240a07ed57d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" Jul 15 21:17:24.392815 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.392793 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bdd8e208-920a-418b-98c3-f240a07ed57d-config-file\") pod \"limitador-limitador-64c94fd64f-jjndn\" (UID: \"bdd8e208-920a-418b-98c3-f240a07ed57d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" Jul 15 21:17:24.399926 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.399905 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g5z9\" (UniqueName: \"kubernetes.io/projected/bdd8e208-920a-418b-98c3-f240a07ed57d-kube-api-access-6g5z9\") pod \"limitador-limitador-64c94fd64f-jjndn\" (UID: \"bdd8e208-920a-418b-98c3-f240a07ed57d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" Jul 15 21:17:24.540199 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.540117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" Jul 15 21:17:24.677809 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:24.677724 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jjndn"] Jul 15 21:17:24.680450 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:17:24.680420 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd8e208_920a_418b_98c3_f240a07ed57d.slice/crio-865c7bb1f18423970200e241e83cc6d7a0ade18cc9e9e0188030f1ec43ed158c WatchSource:0}: Error finding container 865c7bb1f18423970200e241e83cc6d7a0ade18cc9e9e0188030f1ec43ed158c: Status 404 returned error can't find the container with id 865c7bb1f18423970200e241e83cc6d7a0ade18cc9e9e0188030f1ec43ed158c Jul 15 21:17:25.667826 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:25.667789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" event={"ID":"bdd8e208-920a-418b-98c3-f240a07ed57d","Type":"ContainerStarted","Data":"865c7bb1f18423970200e241e83cc6d7a0ade18cc9e9e0188030f1ec43ed158c"} Jul 15 21:17:27.680428 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:27.680341 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" event={"ID":"bdd8e208-920a-418b-98c3-f240a07ed57d","Type":"ContainerStarted","Data":"c37ce44415d2009fc2dc11baf183e07f94c23ba126b20b9a56b7ed113b16922c"} Jul 15 21:17:27.680927 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:27.680468 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" Jul 15 21:17:27.705995 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:27.705942 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" podStartSLOduration=1.009794565 podStartE2EDuration="3.7059253s" totalImagesPullingTime="2.696130735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:27.704335961 +0000 UTC m=+468.892816517" watchObservedRunningTime="2026-07-15 21:17:27.7059253 +0000 UTC m=+468.894405858" Jul 15 21:17:38.687410 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:38.687377 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" Jul 15 21:17:39.186108 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.186073 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jjndn"] Jul 15 21:17:39.186321 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.186269 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" podUID="bdd8e208-920a-418b-98c3-f240a07ed57d" containerName="limitador" containerID="cri-o://c37ce44415d2009fc2dc11baf183e07f94c23ba126b20b9a56b7ed113b16922c" gracePeriod=30 Jul 15 21:17:39.737070 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.737020 2578 generic.go:356] "Generic (PLEG): container finished" podID="bdd8e208-920a-418b-98c3-f240a07ed57d" containerID="c37ce44415d2009fc2dc11baf183e07f94c23ba126b20b9a56b7ed113b16922c" exitCode=0 Jul 15 21:17:39.737408 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.737068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" event={"ID":"bdd8e208-920a-418b-98c3-f240a07ed57d","Type":"ContainerDied","Data":"c37ce44415d2009fc2dc11baf183e07f94c23ba126b20b9a56b7ed113b16922c"} Jul 15 21:17:39.737408 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.737119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" event={"ID":"bdd8e208-920a-418b-98c3-f240a07ed57d","Type":"ContainerDied","Data":"865c7bb1f18423970200e241e83cc6d7a0ade18cc9e9e0188030f1ec43ed158c"} Jul 15 21:17:39.737408 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.737141 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="865c7bb1f18423970200e241e83cc6d7a0ade18cc9e9e0188030f1ec43ed158c" Jul 15 21:17:39.749788 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.749724 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" Jul 15 21:17:39.800088 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.800023 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bdd8e208-920a-418b-98c3-f240a07ed57d-config-file\") pod \"bdd8e208-920a-418b-98c3-f240a07ed57d\" (UID: \"bdd8e208-920a-418b-98c3-f240a07ed57d\") " Jul 15 21:17:39.800343 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.800103 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g5z9\" (UniqueName: \"kubernetes.io/projected/bdd8e208-920a-418b-98c3-f240a07ed57d-kube-api-access-6g5z9\") pod \"bdd8e208-920a-418b-98c3-f240a07ed57d\" (UID: \"bdd8e208-920a-418b-98c3-f240a07ed57d\") " Jul 15 21:17:39.800491 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.800466 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdd8e208-920a-418b-98c3-f240a07ed57d-config-file" (OuterVolumeSpecName: "config-file") pod "bdd8e208-920a-418b-98c3-f240a07ed57d" (UID: "bdd8e208-920a-418b-98c3-f240a07ed57d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:17:39.802303 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.802269 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdd8e208-920a-418b-98c3-f240a07ed57d-kube-api-access-6g5z9" (OuterVolumeSpecName: "kube-api-access-6g5z9") pod "bdd8e208-920a-418b-98c3-f240a07ed57d" (UID: "bdd8e208-920a-418b-98c3-f240a07ed57d"). InnerVolumeSpecName "kube-api-access-6g5z9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:39.901305 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.901266 2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bdd8e208-920a-418b-98c3-f240a07ed57d-config-file\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:17:39.901305 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:39.901298 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g5z9\" (UniqueName: \"kubernetes.io/projected/bdd8e208-920a-418b-98c3-f240a07ed57d-kube-api-access-6g5z9\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:17:40.744795 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:40.744755 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jjndn" Jul 15 21:17:40.773151 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:40.773115 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jjndn"] Jul 15 21:17:40.778874 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:40.778841 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jjndn"] Jul 15 21:17:41.336975 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:41.336935 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdd8e208-920a-418b-98c3-f240a07ed57d" path="/var/lib/kubelet/pods/bdd8e208-920a-418b-98c3-f240a07ed57d/volumes" Jul 15 21:17:45.758446 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.758407 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jcf29"] Jul 15 21:17:45.758918 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.758897 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdd8e208-920a-418b-98c3-f240a07ed57d" containerName="limitador" Jul 15 21:17:45.758963 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.758923 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd8e208-920a-418b-98c3-f240a07ed57d" containerName="limitador" Jul 15 21:17:45.759087 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.759072 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdd8e208-920a-418b-98c3-f240a07ed57d" containerName="limitador" Jul 15 21:17:45.762399 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.762376 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" Jul 15 21:17:45.765248 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.765223 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 21:17:45.765402 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.765340 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 21:17:45.765669 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.765636 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 15 21:17:45.765985 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.765958 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-s92kq\"" Jul 15 21:17:45.768456 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.768426 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jcf29"] Jul 15 21:17:45.851038 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.850991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjcjb\" (UniqueName: \"kubernetes.io/projected/2dbaff5a-fb49-416e-b781-f3356d6d9a8e-kube-api-access-hjcjb\") pod \"postgres-69fb4594cf-jcf29\" (UID: \"2dbaff5a-fb49-416e-b781-f3356d6d9a8e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" Jul 15 21:17:45.851214 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.851103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2dbaff5a-fb49-416e-b781-f3356d6d9a8e-data\") pod \"postgres-69fb4594cf-jcf29\" (UID: \"2dbaff5a-fb49-416e-b781-f3356d6d9a8e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" Jul 15 21:17:45.952395 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.952356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjcjb\" (UniqueName: \"kubernetes.io/projected/2dbaff5a-fb49-416e-b781-f3356d6d9a8e-kube-api-access-hjcjb\") pod \"postgres-69fb4594cf-jcf29\" (UID: \"2dbaff5a-fb49-416e-b781-f3356d6d9a8e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" Jul 15 21:17:45.952395 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.952403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2dbaff5a-fb49-416e-b781-f3356d6d9a8e-data\") pod \"postgres-69fb4594cf-jcf29\" (UID: \"2dbaff5a-fb49-416e-b781-f3356d6d9a8e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" Jul 15 21:17:45.952770 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.952753 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2dbaff5a-fb49-416e-b781-f3356d6d9a8e-data\") pod \"postgres-69fb4594cf-jcf29\" (UID: \"2dbaff5a-fb49-416e-b781-f3356d6d9a8e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" Jul 15 21:17:45.962130 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:45.962095 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjcjb\" (UniqueName: \"kubernetes.io/projected/2dbaff5a-fb49-416e-b781-f3356d6d9a8e-kube-api-access-hjcjb\") pod \"postgres-69fb4594cf-jcf29\" (UID: \"2dbaff5a-fb49-416e-b781-f3356d6d9a8e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" Jul 15 21:17:46.074404 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:46.074279 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" Jul 15 21:17:46.214465 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:46.214439 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jcf29"] Jul 15 21:17:46.216669 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:17:46.216630 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dbaff5a_fb49_416e_b781_f3356d6d9a8e.slice/crio-4b3a6aed83134e9c1d5544f8bd116a95d12c1e2b7ff5c6c08c86da59b9f1260f WatchSource:0}: Error finding container 4b3a6aed83134e9c1d5544f8bd116a95d12c1e2b7ff5c6c08c86da59b9f1260f: Status 404 returned error can't find the container with id 4b3a6aed83134e9c1d5544f8bd116a95d12c1e2b7ff5c6c08c86da59b9f1260f Jul 15 21:17:46.779141 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:46.779096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" event={"ID":"2dbaff5a-fb49-416e-b781-f3356d6d9a8e","Type":"ContainerStarted","Data":"4b3a6aed83134e9c1d5544f8bd116a95d12c1e2b7ff5c6c08c86da59b9f1260f"} Jul 15 21:17:51.808270 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:51.808226 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" event={"ID":"2dbaff5a-fb49-416e-b781-f3356d6d9a8e","Type":"ContainerStarted","Data":"dfe3d72d24adcaee63ba1da000bfa2f6a1709ff3c2eb7a2f3b196ca1e601105e"} Jul 15 21:17:51.808677 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:51.808314 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" Jul 15 21:17:51.826431 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:51.826380 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" podStartSLOduration=1.77251329 podStartE2EDuration="6.826360797s" totalImagesPullingTime="5.053847507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:51.824780214 +0000 UTC m=+493.013260746" watchObservedRunningTime="2026-07-15 21:17:51.826360797 +0000 UTC m=+493.014841348" Jul 15 21:17:57.842839 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:17:57.842810 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcf29" Jul 15 21:18:05.322675 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.322637 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f4cf4fcbb-glqsh"] Jul 15 21:18:05.325146 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.325117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:05.327901 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.327877 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 21:18:05.328070 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.327945 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 21:18:05.328070 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.327959 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vzzxc\"" Jul 15 21:18:05.338892 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.338858 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f4cf4fcbb-glqsh"] Jul 15 21:18:05.422705 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.422660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7e59381-800d-43b7-9f27-ed4701785a00-webhook-cert\") pod \"maas-controller-f4cf4fcbb-glqsh\" (UID: \"c7e59381-800d-43b7-9f27-ed4701785a00\") " pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:05.422889 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.422741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9t7m\" (UniqueName: \"kubernetes.io/projected/c7e59381-800d-43b7-9f27-ed4701785a00-kube-api-access-k9t7m\") pod \"maas-controller-f4cf4fcbb-glqsh\" (UID: \"c7e59381-800d-43b7-9f27-ed4701785a00\") " pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:05.507139 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.507107 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69496855bc-2dxr7"] Jul 15 21:18:05.509600 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.509577 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:18:05.520373 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.520347 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69496855bc-2dxr7"] Jul 15 21:18:05.523328 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.523302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9t7m\" (UniqueName: \"kubernetes.io/projected/c7e59381-800d-43b7-9f27-ed4701785a00-kube-api-access-k9t7m\") pod \"maas-controller-f4cf4fcbb-glqsh\" (UID: \"c7e59381-800d-43b7-9f27-ed4701785a00\") " pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:05.523429 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.523374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7e59381-800d-43b7-9f27-ed4701785a00-webhook-cert\") pod \"maas-controller-f4cf4fcbb-glqsh\" (UID: \"c7e59381-800d-43b7-9f27-ed4701785a00\") " pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:05.523565 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:18:05.523544 2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 15 21:18:05.523631 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:18:05.523620 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7e59381-800d-43b7-9f27-ed4701785a00-webhook-cert podName:c7e59381-800d-43b7-9f27-ed4701785a00 nodeName:}" failed. No retries permitted until 2026-07-15 21:18:06.023599173 +0000 UTC m=+507.212079690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c7e59381-800d-43b7-9f27-ed4701785a00-webhook-cert") pod "maas-controller-f4cf4fcbb-glqsh" (UID: "c7e59381-800d-43b7-9f27-ed4701785a00") : secret "maas-controller-webhook-cert" not found Jul 15 21:18:05.532374 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.532339 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9t7m\" (UniqueName: \"kubernetes.io/projected/c7e59381-800d-43b7-9f27-ed4701785a00-kube-api-access-k9t7m\") pod \"maas-controller-f4cf4fcbb-glqsh\" (UID: \"c7e59381-800d-43b7-9f27-ed4701785a00\") " pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:05.624231 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.624196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db8964b8-1040-4217-a8e6-ce5055833dd7-webhook-cert\") pod \"maas-controller-69496855bc-2dxr7\" (UID: \"db8964b8-1040-4217-a8e6-ce5055833dd7\") " pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:18:05.624413 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.624257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zknzg\" (UniqueName: \"kubernetes.io/projected/db8964b8-1040-4217-a8e6-ce5055833dd7-kube-api-access-zknzg\") pod \"maas-controller-69496855bc-2dxr7\" (UID: \"db8964b8-1040-4217-a8e6-ce5055833dd7\") " pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:18:05.724779 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.724734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db8964b8-1040-4217-a8e6-ce5055833dd7-webhook-cert\") pod \"maas-controller-69496855bc-2dxr7\" (UID: \"db8964b8-1040-4217-a8e6-ce5055833dd7\") " pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:18:05.724982 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.724804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zknzg\" (UniqueName: \"kubernetes.io/projected/db8964b8-1040-4217-a8e6-ce5055833dd7-kube-api-access-zknzg\") pod \"maas-controller-69496855bc-2dxr7\" (UID: \"db8964b8-1040-4217-a8e6-ce5055833dd7\") " pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:18:05.724982 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:18:05.724888 2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 15 21:18:05.724982 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:18:05.724961 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db8964b8-1040-4217-a8e6-ce5055833dd7-webhook-cert podName:db8964b8-1040-4217-a8e6-ce5055833dd7 nodeName:}" failed. No retries permitted until 2026-07-15 21:18:06.22494391 +0000 UTC m=+507.413424410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/db8964b8-1040-4217-a8e6-ce5055833dd7-webhook-cert") pod "maas-controller-69496855bc-2dxr7" (UID: "db8964b8-1040-4217-a8e6-ce5055833dd7") : secret "maas-controller-webhook-cert" not found Jul 15 21:18:05.736016 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:05.735988 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zknzg\" (UniqueName: \"kubernetes.io/projected/db8964b8-1040-4217-a8e6-ce5055833dd7-kube-api-access-zknzg\") pod \"maas-controller-69496855bc-2dxr7\" (UID: \"db8964b8-1040-4217-a8e6-ce5055833dd7\") " pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:18:06.027840 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:06.027743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7e59381-800d-43b7-9f27-ed4701785a00-webhook-cert\") pod \"maas-controller-f4cf4fcbb-glqsh\" (UID: \"c7e59381-800d-43b7-9f27-ed4701785a00\") " pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:06.030256 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:06.030208 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7e59381-800d-43b7-9f27-ed4701785a00-webhook-cert\") pod \"maas-controller-f4cf4fcbb-glqsh\" (UID: \"c7e59381-800d-43b7-9f27-ed4701785a00\") " pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:06.229075 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:06.229017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db8964b8-1040-4217-a8e6-ce5055833dd7-webhook-cert\") pod \"maas-controller-69496855bc-2dxr7\" (UID: \"db8964b8-1040-4217-a8e6-ce5055833dd7\") " pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:18:06.231747 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:06.231720 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db8964b8-1040-4217-a8e6-ce5055833dd7-webhook-cert\") pod \"maas-controller-69496855bc-2dxr7\" (UID: \"db8964b8-1040-4217-a8e6-ce5055833dd7\") " pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:18:06.237511 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:06.237487 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:06.420581 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:06.420544 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:18:06.557363 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:06.557258 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69496855bc-2dxr7"] Jul 15 21:18:06.560665 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:18:06.560626 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb8964b8_1040_4217_a8e6_ce5055833dd7.slice/crio-bd518141178bde8335d6daaef11f8d9af5f41fca56289a5ee45a1a173d41e1ab WatchSource:0}: Error finding container bd518141178bde8335d6daaef11f8d9af5f41fca56289a5ee45a1a173d41e1ab: Status 404 returned error can't find the container with id bd518141178bde8335d6daaef11f8d9af5f41fca56289a5ee45a1a173d41e1ab Jul 15 21:18:06.583550 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:06.583527 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f4cf4fcbb-glqsh"] Jul 15 21:18:06.585889 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:18:06.585860 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e59381_800d_43b7_9f27_ed4701785a00.slice/crio-510f70839e6c183874c89a02fefc44bffaf7d88e320b2c2bed5c904280c35e00 WatchSource:0}: Error finding container 510f70839e6c183874c89a02fefc44bffaf7d88e320b2c2bed5c904280c35e00: Status 404 returned error can't find the container with id 510f70839e6c183874c89a02fefc44bffaf7d88e320b2c2bed5c904280c35e00 Jul 15 21:18:06.882795 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:06.882755 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" event={"ID":"c7e59381-800d-43b7-9f27-ed4701785a00","Type":"ContainerStarted","Data":"510f70839e6c183874c89a02fefc44bffaf7d88e320b2c2bed5c904280c35e00"} Jul 15 21:18:06.883911 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:06.883885 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69496855bc-2dxr7" event={"ID":"db8964b8-1040-4217-a8e6-ce5055833dd7","Type":"ContainerStarted","Data":"bd518141178bde8335d6daaef11f8d9af5f41fca56289a5ee45a1a173d41e1ab"} Jul 15 21:18:09.903244 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:09.903209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" event={"ID":"c7e59381-800d-43b7-9f27-ed4701785a00","Type":"ContainerStarted","Data":"140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac"} Jul 15 21:18:09.903671 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:09.903323 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:09.904805 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:09.904775 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69496855bc-2dxr7" event={"ID":"db8964b8-1040-4217-a8e6-ce5055833dd7","Type":"ContainerStarted","Data":"5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0"} Jul 15 21:18:09.904933 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:09.904823 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:18:09.934335 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:09.934281 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" podStartSLOduration=2.311012457 podStartE2EDuration="4.93426659s" totalImagesPullingTime="2.623254133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:09.930270992 +0000 UTC m=+511.118751514" watchObservedRunningTime="2026-07-15 21:18:09.93426659 +0000 UTC m=+511.122747113" Jul 15 21:18:09.969482 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:09.969426 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69496855bc-2dxr7" podStartSLOduration=2.309794238 podStartE2EDuration="4.969409979s" totalImagesPullingTime="2.659615741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:09.966131379 +0000 UTC m=+511.154611901" watchObservedRunningTime="2026-07-15 21:18:09.969409979 +0000 UTC m=+511.157890534" Jul 15 21:18:20.911088 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:20.911057 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:20.911473 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:20.911136 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:18:20.973633 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:20.973591 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f4cf4fcbb-glqsh"] Jul 15 21:18:20.973871 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:20.973814 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" podUID="c7e59381-800d-43b7-9f27-ed4701785a00" containerName="manager" containerID="cri-o://140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac" gracePeriod=30 Jul 15 21:18:21.221431 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.221403 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:21.365696 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.365660 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9t7m\" (UniqueName: \"kubernetes.io/projected/c7e59381-800d-43b7-9f27-ed4701785a00-kube-api-access-k9t7m\") pod \"c7e59381-800d-43b7-9f27-ed4701785a00\" (UID: \"c7e59381-800d-43b7-9f27-ed4701785a00\") " Jul 15 21:18:21.365867 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.365759 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7e59381-800d-43b7-9f27-ed4701785a00-webhook-cert\") pod \"c7e59381-800d-43b7-9f27-ed4701785a00\" (UID: \"c7e59381-800d-43b7-9f27-ed4701785a00\") " Jul 15 21:18:21.367920 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.367886 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7e59381-800d-43b7-9f27-ed4701785a00-kube-api-access-k9t7m" (OuterVolumeSpecName: "kube-api-access-k9t7m") pod "c7e59381-800d-43b7-9f27-ed4701785a00" (UID: "c7e59381-800d-43b7-9f27-ed4701785a00"). InnerVolumeSpecName "kube-api-access-k9t7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:18:21.367920 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.367886 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7e59381-800d-43b7-9f27-ed4701785a00-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c7e59381-800d-43b7-9f27-ed4701785a00" (UID: "c7e59381-800d-43b7-9f27-ed4701785a00"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:18:21.467201 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.467103 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7e59381-800d-43b7-9f27-ed4701785a00-webhook-cert\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:18:21.467201 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.467141 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9t7m\" (UniqueName: \"kubernetes.io/projected/c7e59381-800d-43b7-9f27-ed4701785a00-kube-api-access-k9t7m\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:18:21.958889 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.958847 2578 generic.go:356] "Generic (PLEG): container finished" podID="c7e59381-800d-43b7-9f27-ed4701785a00" containerID="140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac" exitCode=0 Jul 15 21:18:21.959321 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.958898 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" Jul 15 21:18:21.959321 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.958939 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" event={"ID":"c7e59381-800d-43b7-9f27-ed4701785a00","Type":"ContainerDied","Data":"140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac"} Jul 15 21:18:21.959321 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.959004 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f4cf4fcbb-glqsh" event={"ID":"c7e59381-800d-43b7-9f27-ed4701785a00","Type":"ContainerDied","Data":"510f70839e6c183874c89a02fefc44bffaf7d88e320b2c2bed5c904280c35e00"} Jul 15 21:18:21.959321 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.959042 2578 scope.go:117] "RemoveContainer" containerID="140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac" Jul 15 21:18:21.967960 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.967936 2578 scope.go:117] "RemoveContainer" containerID="140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac" Jul 15 21:18:21.968290 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:18:21.968270 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac\": container with ID starting with 140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac not found: ID does not exist" containerID="140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac" Jul 15 21:18:21.968370 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.968295 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac"} err="failed to get container status \"140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac\": rpc error: code = NotFound desc = could not find container \"140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac\": container with ID starting with 140ceb6c4ecffc35128fe9b0ea0c1f3a63ce275c84e8f919e75e17868fc017ac not found: ID does not exist" Jul 15 21:18:21.979982 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.979944 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f4cf4fcbb-glqsh"] Jul 15 21:18:21.984099 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:21.984072 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f4cf4fcbb-glqsh"] Jul 15 21:18:23.336940 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:23.336907 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7e59381-800d-43b7-9f27-ed4701785a00" path="/var/lib/kubelet/pods/c7e59381-800d-43b7-9f27-ed4701785a00/volumes" Jul 15 21:18:40.886630 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:40.886591 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx"] Jul 15 21:18:40.887058 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:40.886941 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7e59381-800d-43b7-9f27-ed4701785a00" containerName="manager" Jul 15 21:18:40.887058 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:40.886952 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7e59381-800d-43b7-9f27-ed4701785a00" containerName="manager" Jul 15 21:18:40.887058 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:40.887022 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7e59381-800d-43b7-9f27-ed4701785a00" containerName="manager" Jul 15 21:18:40.891223 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:40.891203 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:40.893739 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:40.893719 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 15 21:18:40.894324 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:40.894307 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qtwch\"" Jul 15 21:18:40.902277 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:40.902252 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx"] Jul 15 21:18:40.926017 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:40.925981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08eca79b-4249-4f5a-94cb-a9bbd745de8b-openshift-service-ca\") pod \"maas-api-b94f58bbd-xsbxx\" (UID: \"08eca79b-4249-4f5a-94cb-a9bbd745de8b\") " pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:40.926193 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:40.926040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbrnk\" (UniqueName: \"kubernetes.io/projected/08eca79b-4249-4f5a-94cb-a9bbd745de8b-kube-api-access-kbrnk\") pod \"maas-api-b94f58bbd-xsbxx\" (UID: \"08eca79b-4249-4f5a-94cb-a9bbd745de8b\") " pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:40.926193 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:40.926070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08eca79b-4249-4f5a-94cb-a9bbd745de8b-maas-api-tls\") pod \"maas-api-b94f58bbd-xsbxx\" (UID: \"08eca79b-4249-4f5a-94cb-a9bbd745de8b\") " pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:41.026979 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.026941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbrnk\" (UniqueName: \"kubernetes.io/projected/08eca79b-4249-4f5a-94cb-a9bbd745de8b-kube-api-access-kbrnk\") pod \"maas-api-b94f58bbd-xsbxx\" (UID: \"08eca79b-4249-4f5a-94cb-a9bbd745de8b\") " pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:41.027204 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.026994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08eca79b-4249-4f5a-94cb-a9bbd745de8b-maas-api-tls\") pod \"maas-api-b94f58bbd-xsbxx\" (UID: \"08eca79b-4249-4f5a-94cb-a9bbd745de8b\") " pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:41.027204 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.027124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08eca79b-4249-4f5a-94cb-a9bbd745de8b-openshift-service-ca\") pod \"maas-api-b94f58bbd-xsbxx\" (UID: \"08eca79b-4249-4f5a-94cb-a9bbd745de8b\") " pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:41.027798 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.027775 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08eca79b-4249-4f5a-94cb-a9bbd745de8b-openshift-service-ca\") pod \"maas-api-b94f58bbd-xsbxx\" (UID: \"08eca79b-4249-4f5a-94cb-a9bbd745de8b\") " pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:41.029522 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.029500 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08eca79b-4249-4f5a-94cb-a9bbd745de8b-maas-api-tls\") pod \"maas-api-b94f58bbd-xsbxx\" (UID: \"08eca79b-4249-4f5a-94cb-a9bbd745de8b\") " pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:41.035989 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.035968 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbrnk\" (UniqueName: \"kubernetes.io/projected/08eca79b-4249-4f5a-94cb-a9bbd745de8b-kube-api-access-kbrnk\") pod \"maas-api-b94f58bbd-xsbxx\" (UID: \"08eca79b-4249-4f5a-94cb-a9bbd745de8b\") " pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:41.202170 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.202079 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:41.350603 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.350490 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx"] Jul 15 21:18:41.353097 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:18:41.353068 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08eca79b_4249_4f5a_94cb_a9bbd745de8b.slice/crio-aa829d6ca456dde213cabcb36990bdc045483983041fbc2bd9249fe7fd65bcd6 WatchSource:0}: Error finding container aa829d6ca456dde213cabcb36990bdc045483983041fbc2bd9249fe7fd65bcd6: Status 404 returned error can't find the container with id aa829d6ca456dde213cabcb36990bdc045483983041fbc2bd9249fe7fd65bcd6 Jul 15 21:18:41.378972 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.378934 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-4mm56"] Jul 15 21:18:41.383526 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.383491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" Jul 15 21:18:41.385704 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.385681 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pslj9\"" Jul 15 21:18:41.385839 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.385685 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 21:18:41.393633 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.393605 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-4mm56"] Jul 15 21:18:41.430208 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.430170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-4mm56\" (UID: \"9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" Jul 15 21:18:41.430380 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.430274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwt5z\" (UniqueName: \"kubernetes.io/projected/9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6-kube-api-access-nwt5z\") pod \"payload-processing-f9b8d9b9b-4mm56\" (UID: \"9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" Jul 15 21:18:41.531478 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.531393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwt5z\" (UniqueName: \"kubernetes.io/projected/9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6-kube-api-access-nwt5z\") pod \"payload-processing-f9b8d9b9b-4mm56\" (UID: \"9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" Jul 15 21:18:41.531478 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.531435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-4mm56\" (UID: \"9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" Jul 15 21:18:41.532388 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.532361 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-4mm56\" (UID: \"9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" Jul 15 21:18:41.543917 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.543875 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwt5z\" (UniqueName: \"kubernetes.io/projected/9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6-kube-api-access-nwt5z\") pod \"payload-processing-f9b8d9b9b-4mm56\" (UID: \"9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" Jul 15 21:18:41.695922 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.695872 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" Jul 15 21:18:41.854555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:41.854521 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-4mm56"] Jul 15 21:18:41.858281 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:18:41.858252 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8cf72e_cf70_4a37_a4ab_a0f8fa6a81e6.slice/crio-7548c827de1fc67b23b08427c1206385ae43a0c4c4e94b2310fc38b4c99a2520 WatchSource:0}: Error finding container 7548c827de1fc67b23b08427c1206385ae43a0c4c4e94b2310fc38b4c99a2520: Status 404 returned error can't find the container with id 7548c827de1fc67b23b08427c1206385ae43a0c4c4e94b2310fc38b4c99a2520 Jul 15 21:18:42.051585 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:42.051547 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" event={"ID":"9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6","Type":"ContainerStarted","Data":"7548c827de1fc67b23b08427c1206385ae43a0c4c4e94b2310fc38b4c99a2520"} Jul 15 21:18:42.052752 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:42.052683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" event={"ID":"08eca79b-4249-4f5a-94cb-a9bbd745de8b","Type":"ContainerStarted","Data":"aa829d6ca456dde213cabcb36990bdc045483983041fbc2bd9249fe7fd65bcd6"} Jul 15 21:18:44.063391 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:44.063343 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" event={"ID":"9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6","Type":"ContainerStarted","Data":"c7972a386f3b60e647e5fd8612e494b7508cd7dbb8fbbff20102960f5563fdf0"} Jul 15 21:18:44.063835 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:44.063414 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" Jul 15 21:18:44.064926 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:44.064900 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" event={"ID":"08eca79b-4249-4f5a-94cb-a9bbd745de8b","Type":"ContainerStarted","Data":"55bba5eff401ca6fc959878573eef139f7de150eb13d6a4ee1a6d992f6c82eb9"} Jul 15 21:18:44.065049 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:44.064963 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:44.079732 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:44.079644 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" podStartSLOduration=1.560166192 podStartE2EDuration="3.07962735s" totalImagesPullingTime="1.519461158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:44.07923811 +0000 UTC m=+545.267718632" watchObservedRunningTime="2026-07-15 21:18:44.07962735 +0000 UTC m=+545.268107853" Jul 15 21:18:44.097865 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:44.097813 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" podStartSLOduration=2.075171975 podStartE2EDuration="4.097797579s" totalImagesPullingTime="2.022625604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:44.096317678 +0000 UTC m=+545.284798200" watchObservedRunningTime="2026-07-15 21:18:44.097797579 +0000 UTC m=+545.286278101" Jul 15 21:18:50.075146 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:50.075110 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b94f58bbd-xsbxx" Jul 15 21:18:55.071957 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:18:55.071924 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mm56" Jul 15 21:19:07.232233 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.232199 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w"] Jul 15 21:19:07.235711 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.235688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.239498 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.238694 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 21:19:07.239498 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.238711 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 21:19:07.239681 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.239585 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 15 21:19:07.241213 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.239830 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jz2qs\"" Jul 15 21:19:07.254959 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.254930 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w"] Jul 15 21:19:07.358974 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.358936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e7443b3-4a06-4afc-8a33-224f703b470a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.359146 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.358977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hx2l\" (UniqueName: \"kubernetes.io/projected/3e7443b3-4a06-4afc-8a33-224f703b470a-kube-api-access-5hx2l\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.359146 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.359005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e7443b3-4a06-4afc-8a33-224f703b470a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.359146 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.359070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e7443b3-4a06-4afc-8a33-224f703b470a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.359146 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.359090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e7443b3-4a06-4afc-8a33-224f703b470a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.359290 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.359158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e7443b3-4a06-4afc-8a33-224f703b470a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.460105 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.460065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e7443b3-4a06-4afc-8a33-224f703b470a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.460105 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.460106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hx2l\" (UniqueName: \"kubernetes.io/projected/3e7443b3-4a06-4afc-8a33-224f703b470a-kube-api-access-5hx2l\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.460357 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.460128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e7443b3-4a06-4afc-8a33-224f703b470a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.460357 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.460147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e7443b3-4a06-4afc-8a33-224f703b470a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.460357 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.460164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e7443b3-4a06-4afc-8a33-224f703b470a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.460357 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.460212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e7443b3-4a06-4afc-8a33-224f703b470a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.460589 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.460564 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e7443b3-4a06-4afc-8a33-224f703b470a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.460650 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.460628 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e7443b3-4a06-4afc-8a33-224f703b470a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.460705 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.460651 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e7443b3-4a06-4afc-8a33-224f703b470a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.462527 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.462497 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e7443b3-4a06-4afc-8a33-224f703b470a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.462817 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.462800 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e7443b3-4a06-4afc-8a33-224f703b470a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.468788 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.468764 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hx2l\" (UniqueName: \"kubernetes.io/projected/3e7443b3-4a06-4afc-8a33-224f703b470a-kube-api-access-5hx2l\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w\" (UID: \"3e7443b3-4a06-4afc-8a33-224f703b470a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.549100 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.548968 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:07.693724 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:07.693697 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w"] Jul 15 21:19:07.695779 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:19:07.695750 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7443b3_4a06_4afc_8a33_224f703b470a.slice/crio-9930e1e72292b84ebe19f5f5cbd09c57d77853cf7331111852e6e1d612ee3fda WatchSource:0}: Error finding container 9930e1e72292b84ebe19f5f5cbd09c57d77853cf7331111852e6e1d612ee3fda: Status 404 returned error can't find the container with id 9930e1e72292b84ebe19f5f5cbd09c57d77853cf7331111852e6e1d612ee3fda Jul 15 21:19:08.189619 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:08.189574 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" event={"ID":"3e7443b3-4a06-4afc-8a33-224f703b470a","Type":"ContainerStarted","Data":"9930e1e72292b84ebe19f5f5cbd09c57d77853cf7331111852e6e1d612ee3fda"} Jul 15 21:19:09.196468 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:09.196424 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" event={"ID":"3e7443b3-4a06-4afc-8a33-224f703b470a","Type":"ContainerStarted","Data":"f40be6c061bda40c404078490a0f48fb7bfd2f8ef827b90ab3742096b1d2f62f"} Jul 15 21:19:09.216059 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:09.215981 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" podStartSLOduration=1.20523814 podStartE2EDuration="2.215965482s" totalImagesPullingTime="1.010727342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:19:09.213904617 +0000 UTC m=+570.402385138" watchObservedRunningTime="2026-07-15 21:19:09.215965482 +0000 UTC m=+570.404446003" Jul 15 21:19:17.550080 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:17.550020 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:17.550611 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:17.550105 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:17.562689 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:17.562660 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:18.251327 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:18.251296 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w" Jul 15 21:19:39.402798 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:39.402681 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:19:39.414742 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:39.404020 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:19:39.414742 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:39.407662 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:19:39.414742 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:39.409043 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:19:49.026643 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.026602 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg"] Jul 15 21:19:49.030867 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.030842 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.033822 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.033794 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 21:19:49.043610 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.043585 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg"] Jul 15 21:19:49.121464 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.121409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd6944d2-08a2-4a18-8161-2509f315f4a7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.121677 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.121485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd6944d2-08a2-4a18-8161-2509f315f4a7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.121677 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.121565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd6944d2-08a2-4a18-8161-2509f315f4a7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.121677 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.121603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd6944d2-08a2-4a18-8161-2509f315f4a7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.121677 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.121629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkmwq\" (UniqueName: \"kubernetes.io/projected/bd6944d2-08a2-4a18-8161-2509f315f4a7-kube-api-access-qkmwq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.121677 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.121664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd6944d2-08a2-4a18-8161-2509f315f4a7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.222700 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.222647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd6944d2-08a2-4a18-8161-2509f315f4a7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.222913 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.222734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd6944d2-08a2-4a18-8161-2509f315f4a7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.222913 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.222771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd6944d2-08a2-4a18-8161-2509f315f4a7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.222913 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.222794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd6944d2-08a2-4a18-8161-2509f315f4a7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.222913 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.222821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkmwq\" (UniqueName: \"kubernetes.io/projected/bd6944d2-08a2-4a18-8161-2509f315f4a7-kube-api-access-qkmwq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.223142 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.222956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd6944d2-08a2-4a18-8161-2509f315f4a7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.223360 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.223324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd6944d2-08a2-4a18-8161-2509f315f4a7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.223445 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.223378 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd6944d2-08a2-4a18-8161-2509f315f4a7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.223445 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.223408 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd6944d2-08a2-4a18-8161-2509f315f4a7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.225141 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.225118 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd6944d2-08a2-4a18-8161-2509f315f4a7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.225416 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.225397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd6944d2-08a2-4a18-8161-2509f315f4a7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.234006 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.233979 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkmwq\" (UniqueName: \"kubernetes.io/projected/bd6944d2-08a2-4a18-8161-2509f315f4a7-kube-api-access-qkmwq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg\" (UID: \"bd6944d2-08a2-4a18-8161-2509f315f4a7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.341061 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.340956 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:49.488766 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.488732 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg"] Jul 15 21:19:49.490978 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:19:49.490948 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd6944d2_08a2_4a18_8161_2509f315f4a7.slice/crio-f20dc3b2da8a452f8d436762f171bbd0cb3968f38707d6a2ae543ab5ebd30e05 WatchSource:0}: Error finding container f20dc3b2da8a452f8d436762f171bbd0cb3968f38707d6a2ae543ab5ebd30e05: Status 404 returned error can't find the container with id f20dc3b2da8a452f8d436762f171bbd0cb3968f38707d6a2ae543ab5ebd30e05 Jul 15 21:19:49.492450 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:49.492426 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:19:50.393201 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:50.393158 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" event={"ID":"bd6944d2-08a2-4a18-8161-2509f315f4a7","Type":"ContainerStarted","Data":"6d6a2d68cda83a177fbf6ce99c6dcc9a248ce7f800262cd759616fa66882aebe"} Jul 15 21:19:50.393612 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:50.393224 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" event={"ID":"bd6944d2-08a2-4a18-8161-2509f315f4a7","Type":"ContainerStarted","Data":"f20dc3b2da8a452f8d436762f171bbd0cb3968f38707d6a2ae543ab5ebd30e05"} Jul 15 21:19:50.416348 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:50.416281 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" podStartSLOduration=1.210492219 podStartE2EDuration="1.416262822s" totalImagesPullingTime="205.770603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:19:50.415370609 +0000 UTC m=+611.603851131" watchObservedRunningTime="2026-07-15 21:19:50.416262822 +0000 UTC m=+611.604743350" Jul 15 21:19:59.341195 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:59.341162 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:59.341569 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:59.341217 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:59.353591 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:59.353561 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:19:59.445434 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:19:59.445405 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg" Jul 15 21:23:08.422920 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:08.422826 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69496855bc-2dxr7"] Jul 15 21:23:08.423518 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:08.423095 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-69496855bc-2dxr7" podUID="db8964b8-1040-4217-a8e6-ce5055833dd7" containerName="manager" containerID="cri-o://5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0" gracePeriod=30 Jul 15 21:23:08.681346 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:08.681286 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:23:08.794406 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:08.794364 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db8964b8-1040-4217-a8e6-ce5055833dd7-webhook-cert\") pod \"db8964b8-1040-4217-a8e6-ce5055833dd7\" (UID: \"db8964b8-1040-4217-a8e6-ce5055833dd7\") " Jul 15 21:23:08.794590 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:08.794573 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zknzg\" (UniqueName: \"kubernetes.io/projected/db8964b8-1040-4217-a8e6-ce5055833dd7-kube-api-access-zknzg\") pod \"db8964b8-1040-4217-a8e6-ce5055833dd7\" (UID: \"db8964b8-1040-4217-a8e6-ce5055833dd7\") " Jul 15 21:23:08.796555 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:08.796526 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db8964b8-1040-4217-a8e6-ce5055833dd7-kube-api-access-zknzg" (OuterVolumeSpecName: "kube-api-access-zknzg") pod "db8964b8-1040-4217-a8e6-ce5055833dd7" (UID: "db8964b8-1040-4217-a8e6-ce5055833dd7"). InnerVolumeSpecName "kube-api-access-zknzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:23:08.796660 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:08.796564 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db8964b8-1040-4217-a8e6-ce5055833dd7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "db8964b8-1040-4217-a8e6-ce5055833dd7" (UID: "db8964b8-1040-4217-a8e6-ce5055833dd7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:23:08.895225 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:08.895188 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zknzg\" (UniqueName: \"kubernetes.io/projected/db8964b8-1040-4217-a8e6-ce5055833dd7-kube-api-access-zknzg\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:23:08.895225 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:08.895218 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db8964b8-1040-4217-a8e6-ce5055833dd7-webhook-cert\") on node \"ip-10-0-136-107.ec2.internal\" DevicePath \"\"" Jul 15 21:23:09.341056 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:09.339260 2578 generic.go:356] "Generic (PLEG): container finished" podID="db8964b8-1040-4217-a8e6-ce5055833dd7" containerID="5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0" exitCode=0 Jul 15 21:23:09.341056 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:09.339365 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69496855bc-2dxr7" event={"ID":"db8964b8-1040-4217-a8e6-ce5055833dd7","Type":"ContainerDied","Data":"5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0"} Jul 15 21:23:09.341056 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:09.339460 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69496855bc-2dxr7" event={"ID":"db8964b8-1040-4217-a8e6-ce5055833dd7","Type":"ContainerDied","Data":"bd518141178bde8335d6daaef11f8d9af5f41fca56289a5ee45a1a173d41e1ab"} Jul 15 21:23:09.341056 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:09.339503 2578 scope.go:117] "RemoveContainer" containerID="5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0" Jul 15 21:23:09.341056 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:09.339574 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69496855bc-2dxr7" Jul 15 21:23:09.357592 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:09.357572 2578 scope.go:117] "RemoveContainer" containerID="5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0" Jul 15 21:23:09.357866 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:23:09.357848 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0\": container with ID starting with 5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0 not found: ID does not exist" containerID="5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0" Jul 15 21:23:09.357910 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:09.357875 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0"} err="failed to get container status \"5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0\": rpc error: code = NotFound desc = could not find container \"5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0\": container with ID starting with 5f4684af9c02e09b73bcf733852db2c18129a9ed65d75a3515db60db0db779f0 not found: ID does not exist" Jul 15 21:23:09.366084 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:09.366057 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69496855bc-2dxr7"] Jul 15 21:23:09.371294 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:09.371268 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69496855bc-2dxr7"] Jul 15 21:23:10.174085 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.174045 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69496855bc-bqbjb"] Jul 15 21:23:10.174447 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.174389 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db8964b8-1040-4217-a8e6-ce5055833dd7" containerName="manager" Jul 15 21:23:10.174447 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.174400 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db8964b8-1040-4217-a8e6-ce5055833dd7" containerName="manager" Jul 15 21:23:10.174533 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.174492 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db8964b8-1040-4217-a8e6-ce5055833dd7" containerName="manager" Jul 15 21:23:10.179072 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.179024 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69496855bc-bqbjb" Jul 15 21:23:10.182754 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.182732 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 21:23:10.182911 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.182752 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vzzxc\"" Jul 15 21:23:10.182911 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.182786 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 21:23:10.187826 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.187798 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69496855bc-bqbjb"] Jul 15 21:23:10.307943 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.307902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09a21830-68f5-4cd7-bc49-5334f52dec67-webhook-cert\") pod \"maas-controller-69496855bc-bqbjb\" (UID: \"09a21830-68f5-4cd7-bc49-5334f52dec67\") " pod="opendatahub/maas-controller-69496855bc-bqbjb" Jul 15 21:23:10.308141 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.307959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkqcb\" (UniqueName: \"kubernetes.io/projected/09a21830-68f5-4cd7-bc49-5334f52dec67-kube-api-access-fkqcb\") pod \"maas-controller-69496855bc-bqbjb\" (UID: \"09a21830-68f5-4cd7-bc49-5334f52dec67\") " pod="opendatahub/maas-controller-69496855bc-bqbjb" Jul 15 21:23:10.409257 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.409223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09a21830-68f5-4cd7-bc49-5334f52dec67-webhook-cert\") pod \"maas-controller-69496855bc-bqbjb\" (UID: \"09a21830-68f5-4cd7-bc49-5334f52dec67\") " pod="opendatahub/maas-controller-69496855bc-bqbjb" Jul 15 21:23:10.409449 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.409375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqcb\" (UniqueName: \"kubernetes.io/projected/09a21830-68f5-4cd7-bc49-5334f52dec67-kube-api-access-fkqcb\") pod \"maas-controller-69496855bc-bqbjb\" (UID: \"09a21830-68f5-4cd7-bc49-5334f52dec67\") " pod="opendatahub/maas-controller-69496855bc-bqbjb" Jul 15 21:23:10.411701 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.411676 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09a21830-68f5-4cd7-bc49-5334f52dec67-webhook-cert\") pod \"maas-controller-69496855bc-bqbjb\" (UID: \"09a21830-68f5-4cd7-bc49-5334f52dec67\") " pod="opendatahub/maas-controller-69496855bc-bqbjb" Jul 15 21:23:10.417853 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.417828 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkqcb\" (UniqueName: \"kubernetes.io/projected/09a21830-68f5-4cd7-bc49-5334f52dec67-kube-api-access-fkqcb\") pod \"maas-controller-69496855bc-bqbjb\" (UID: \"09a21830-68f5-4cd7-bc49-5334f52dec67\") " pod="opendatahub/maas-controller-69496855bc-bqbjb" Jul 15 21:23:10.490186 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.490091 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69496855bc-bqbjb" Jul 15 21:23:10.635511 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:10.635480 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69496855bc-bqbjb"] Jul 15 21:23:10.638495 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:23:10.638463 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a21830_68f5_4cd7_bc49_5334f52dec67.slice/crio-8b0af93dd0ce11bdd9dda1f5127274b4e464fb6894f7cd2c04a5e71592242f5e WatchSource:0}: Error finding container 8b0af93dd0ce11bdd9dda1f5127274b4e464fb6894f7cd2c04a5e71592242f5e: Status 404 returned error can't find the container with id 8b0af93dd0ce11bdd9dda1f5127274b4e464fb6894f7cd2c04a5e71592242f5e Jul 15 21:23:11.337917 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:11.337886 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db8964b8-1040-4217-a8e6-ce5055833dd7" path="/var/lib/kubelet/pods/db8964b8-1040-4217-a8e6-ce5055833dd7/volumes" Jul 15 21:23:11.353463 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:11.353428 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69496855bc-bqbjb" event={"ID":"09a21830-68f5-4cd7-bc49-5334f52dec67","Type":"ContainerStarted","Data":"8b0af93dd0ce11bdd9dda1f5127274b4e464fb6894f7cd2c04a5e71592242f5e"} Jul 15 21:23:12.359918 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:12.359888 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69496855bc-bqbjb" event={"ID":"09a21830-68f5-4cd7-bc49-5334f52dec67","Type":"ContainerStarted","Data":"8e121bcd2955bf18a36e00595c34328524673b406414b9f33b61fe80c9d68e2d"} Jul 15 21:23:12.360400 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:12.359941 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69496855bc-bqbjb" Jul 15 21:23:12.379702 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:12.379651 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69496855bc-bqbjb" podStartSLOduration=1.679774871 podStartE2EDuration="2.379632117s" totalImagesPullingTime="699.857246ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:23:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:23:12.378163269 +0000 UTC m=+813.566643793" watchObservedRunningTime="2026-07-15 21:23:12.379632117 +0000 UTC m=+813.568112638" Jul 15 21:23:23.366827 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:23.366791 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69496855bc-bqbjb" Jul 15 21:23:39.273206 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:23:39.273172 2578 scope.go:117] "RemoveContainer" containerID="c37ce44415d2009fc2dc11baf183e07f94c23ba126b20b9a56b7ed113b16922c" Jul 15 21:24:39.433994 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:24:39.433832 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:24:39.440082 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:24:39.435781 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:24:39.440082 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:24:39.439302 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:24:39.441262 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:24:39.441241 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:29:39.463255 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:29:39.463151 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:29:39.466328 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:29:39.465707 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:29:39.468424 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:29:39.468401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:29:39.470510 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:29:39.470490 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:34:39.492520 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:34:39.492406 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:34:39.496210 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:34:39.496177 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:34:39.497675 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:34:39.497655 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:34:39.501066 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:34:39.501045 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:35:24.256494 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.256457 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb"] Jul 15 21:35:24.260560 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.260540 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:24.263763 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.263726 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ca080678-serving-cert\"" Jul 15 21:35:24.271997 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.271870 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb"] Jul 15 21:35:24.333776 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.333695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd-maas-api-tls\") pod \"maas-api-e2e-ait-ca080678-76947f7946-47dlb\" (UID: \"aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:24.333776 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.333734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd-openshift-service-ca\") pod \"maas-api-e2e-ait-ca080678-76947f7946-47dlb\" (UID: \"aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:24.333776 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.333765 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svb7\" (UniqueName: \"kubernetes.io/projected/aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd-kube-api-access-2svb7\") pod \"maas-api-e2e-ait-ca080678-76947f7946-47dlb\" (UID: \"aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:24.434837 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.434802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd-maas-api-tls\") pod \"maas-api-e2e-ait-ca080678-76947f7946-47dlb\" (UID: \"aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:24.435086 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.434900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd-openshift-service-ca\") pod \"maas-api-e2e-ait-ca080678-76947f7946-47dlb\" (UID: \"aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:24.435086 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.435012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svb7\" (UniqueName: \"kubernetes.io/projected/aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd-kube-api-access-2svb7\") pod \"maas-api-e2e-ait-ca080678-76947f7946-47dlb\" (UID: \"aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:24.435873 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.435834 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd-openshift-service-ca\") pod \"maas-api-e2e-ait-ca080678-76947f7946-47dlb\" (UID: \"aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:24.437866 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.437844 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd-maas-api-tls\") pod \"maas-api-e2e-ait-ca080678-76947f7946-47dlb\" (UID: \"aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:24.445331 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.445307 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svb7\" (UniqueName: \"kubernetes.io/projected/aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd-kube-api-access-2svb7\") pod \"maas-api-e2e-ait-ca080678-76947f7946-47dlb\" (UID: \"aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:24.574083 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.574052 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:24.713317 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.713281 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb"] Jul 15 21:35:24.715684 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:35:24.715655 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaceaf4ae_8a9c_4ffb_bbb9_1c5140d214dd.slice/crio-d9b10f3e0f23b9eea716bf93347fd12728e87e6ee58e757fdf2e488d2d7243cf WatchSource:0}: Error finding container d9b10f3e0f23b9eea716bf93347fd12728e87e6ee58e757fdf2e488d2d7243cf: Status 404 returned error can't find the container with id d9b10f3e0f23b9eea716bf93347fd12728e87e6ee58e757fdf2e488d2d7243cf Jul 15 21:35:24.717198 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.717178 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:35:24.811835 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:24.811794 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" event={"ID":"aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd","Type":"ContainerStarted","Data":"d9b10f3e0f23b9eea716bf93347fd12728e87e6ee58e757fdf2e488d2d7243cf"} Jul 15 21:35:25.818199 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:25.818107 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" event={"ID":"aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd","Type":"ContainerStarted","Data":"6c72bcf6fc6b0b9d2064a169848b8b3c9be26a52f09de8d61f91f2d6d47b89f1"} Jul 15 21:35:25.818584 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:25.818224 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:25.838085 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:25.837997 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" podStartSLOduration=0.991876759 podStartE2EDuration="1.837980968s" totalImagesPullingTime="846.104209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:25.837101177 +0000 UTC m=+1547.025581711" watchObservedRunningTime="2026-07-15 21:35:25.837980968 +0000 UTC m=+1547.026461489" Jul 15 21:35:31.828300 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:31.828267 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ca080678-76947f7946-47dlb" Jul 15 21:35:37.484596 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:37.484515 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb"] Jul 15 21:35:37.488701 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:37.488679 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:37.491348 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:37.491319 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c871ea22-serving-cert\"" Jul 15 21:35:37.503911 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:37.503882 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb"] Jul 15 21:35:37.556474 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:37.556432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888-maas-api-tls\") pod \"maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb\" (UID: \"2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:37.556627 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:37.556489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlq8p\" (UniqueName: \"kubernetes.io/projected/2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888-kube-api-access-xlq8p\") pod \"maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb\" (UID: \"2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:37.556704 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:37.556646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888-openshift-service-ca\") pod \"maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb\" (UID: \"2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:37.657737 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:37.657689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888-openshift-service-ca\") pod \"maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb\" (UID: \"2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:37.657914 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:37.657776 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888-maas-api-tls\") pod \"maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb\" (UID: \"2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:37.657914 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:37.657811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlq8p\" (UniqueName: \"kubernetes.io/projected/2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888-kube-api-access-xlq8p\") pod \"maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb\" (UID: \"2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:37.658004 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:35:37.657931 2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-serving-cert: secret "maas-api-e2e-migrate-c871ea22-serving-cert" not found Jul 15 21:35:37.658062 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:35:37.658003 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888-maas-api-tls podName:2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888 nodeName:}" failed. No retries permitted until 2026-07-15 21:35:38.157986963 +0000 UTC m=+1559.346467463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888-maas-api-tls") pod "maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" (UID: "2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888") : secret "maas-api-e2e-migrate-c871ea22-serving-cert" not found Jul 15 21:35:37.658380 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:37.658360 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888-openshift-service-ca\") pod \"maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb\" (UID: \"2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:37.672852 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:37.672821 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlq8p\" (UniqueName: \"kubernetes.io/projected/2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888-kube-api-access-xlq8p\") pod \"maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb\" (UID: \"2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:38.162362 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:38.162321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888-maas-api-tls\") pod \"maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb\" (UID: \"2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:38.164798 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:38.164770 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888-maas-api-tls\") pod \"maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb\" (UID: \"2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:38.400191 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:38.400156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:38.540515 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:38.540364 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb"] Jul 15 21:35:38.542694 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:35:38.542651 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af2b1f8_0ff6_45a3_92a8_bb0ec0f5d888.slice/crio-0390349e88dcb837970c14682462b145dfa2aaff914625a6250c02b7660a2d7f WatchSource:0}: Error finding container 0390349e88dcb837970c14682462b145dfa2aaff914625a6250c02b7660a2d7f: Status 404 returned error can't find the container with id 0390349e88dcb837970c14682462b145dfa2aaff914625a6250c02b7660a2d7f Jul 15 21:35:38.880580 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:38.880547 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" event={"ID":"2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888","Type":"ContainerStarted","Data":"0390349e88dcb837970c14682462b145dfa2aaff914625a6250c02b7660a2d7f"} Jul 15 21:35:39.886981 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:39.886939 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" event={"ID":"2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888","Type":"ContainerStarted","Data":"d80ee207c7236d2a5ee634b3e246aac0ebe9e4f909576c19805ef9b7a309d9bc"} Jul 15 21:35:39.887376 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:39.887017 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:39.907288 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:39.907238 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" podStartSLOduration=2.511318593 podStartE2EDuration="2.907220228s" totalImagesPullingTime="395.901635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:39.904777649 +0000 UTC m=+1561.093258171" watchObservedRunningTime="2026-07-15 21:35:39.907220228 +0000 UTC m=+1561.095700750" Jul 15 21:35:45.897176 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:45.897145 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb" Jul 15 21:35:49.808133 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.808044 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8"] Jul 15 21:35:49.812639 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.812617 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:35:49.815276 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.815250 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-281d9c60-serving-cert\"" Jul 15 21:35:49.823664 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.823633 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8"] Jul 15 21:35:49.869231 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.869180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f519479-79e3-4d28-85f1-5c0fd89c8f99-openshift-service-ca\") pod \"maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8\" (UID: \"9f519479-79e3-4d28-85f1-5c0fd89c8f99\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:35:49.869416 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.869244 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f519479-79e3-4d28-85f1-5c0fd89c8f99-maas-api-tls\") pod \"maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8\" (UID: \"9f519479-79e3-4d28-85f1-5c0fd89c8f99\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:35:49.869416 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.869352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8lcv\" (UniqueName: \"kubernetes.io/projected/9f519479-79e3-4d28-85f1-5c0fd89c8f99-kube-api-access-c8lcv\") pod \"maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8\" (UID: \"9f519479-79e3-4d28-85f1-5c0fd89c8f99\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:35:49.970191 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.970150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8lcv\" (UniqueName: \"kubernetes.io/projected/9f519479-79e3-4d28-85f1-5c0fd89c8f99-kube-api-access-c8lcv\") pod \"maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8\" (UID: \"9f519479-79e3-4d28-85f1-5c0fd89c8f99\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:35:49.970393 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.970298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f519479-79e3-4d28-85f1-5c0fd89c8f99-openshift-service-ca\") pod \"maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8\" (UID: \"9f519479-79e3-4d28-85f1-5c0fd89c8f99\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:35:49.970393 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.970335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f519479-79e3-4d28-85f1-5c0fd89c8f99-maas-api-tls\") pod \"maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8\" (UID: \"9f519479-79e3-4d28-85f1-5c0fd89c8f99\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:35:49.970945 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.970920 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f519479-79e3-4d28-85f1-5c0fd89c8f99-openshift-service-ca\") pod \"maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8\" (UID: \"9f519479-79e3-4d28-85f1-5c0fd89c8f99\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:35:49.973047 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.973005 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f519479-79e3-4d28-85f1-5c0fd89c8f99-maas-api-tls\") pod \"maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8\" (UID: \"9f519479-79e3-4d28-85f1-5c0fd89c8f99\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:35:49.983912 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:49.983885 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8lcv\" (UniqueName: \"kubernetes.io/projected/9f519479-79e3-4d28-85f1-5c0fd89c8f99-kube-api-access-c8lcv\") pod \"maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8\" (UID: \"9f519479-79e3-4d28-85f1-5c0fd89c8f99\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:35:50.125201 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:50.125157 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:35:50.276360 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:50.276326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8"] Jul 15 21:35:50.279639 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:35:50.279608 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f519479_79e3_4d28_85f1_5c0fd89c8f99.slice/crio-9ab92de58736ef64c480eb9705a71315c5783de43e752598ea98054639eca827 WatchSource:0}: Error finding container 9ab92de58736ef64c480eb9705a71315c5783de43e752598ea98054639eca827: Status 404 returned error can't find the container with id 9ab92de58736ef64c480eb9705a71315c5783de43e752598ea98054639eca827 Jul 15 21:35:50.937428 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:50.937393 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" event={"ID":"9f519479-79e3-4d28-85f1-5c0fd89c8f99","Type":"ContainerStarted","Data":"9ab92de58736ef64c480eb9705a71315c5783de43e752598ea98054639eca827"} Jul 15 21:35:51.944128 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:51.944090 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" event={"ID":"9f519479-79e3-4d28-85f1-5c0fd89c8f99","Type":"ContainerStarted","Data":"6c566c11f63ec478af0d89f81c9e3975bdaab698f3d8d008f74a6c778f3c52ff"} Jul 15 21:35:51.944557 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:51.944247 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:35:51.962115 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:51.962062 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" podStartSLOduration=2.14757308 podStartE2EDuration="2.962045227s" totalImagesPullingTime="814.472147ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:51.961059568 +0000 UTC m=+1573.149540086" watchObservedRunningTime="2026-07-15 21:35:51.962045227 +0000 UTC m=+1573.150525739" Jul 15 21:35:57.954861 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:35:57.954830 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8" Jul 15 21:37:40.112911 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.112862 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7"] Jul 15 21:37:40.116728 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.116707 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:40.118928 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.118905 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f6e0ed38-serving-cert\"" Jul 15 21:37:40.128813 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.128767 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7"] Jul 15 21:37:40.265294 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.265250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntg82\" (UniqueName: \"kubernetes.io/projected/9bfc0b06-ff77-4b32-871b-cd76a1b01f82-kube-api-access-ntg82\") pod \"maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7\" (UID: \"9bfc0b06-ff77-4b32-871b-cd76a1b01f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:40.265476 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.265305 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bfc0b06-ff77-4b32-871b-cd76a1b01f82-openshift-service-ca\") pod \"maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7\" (UID: \"9bfc0b06-ff77-4b32-871b-cd76a1b01f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:40.265520 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.265489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bfc0b06-ff77-4b32-871b-cd76a1b01f82-maas-api-tls\") pod \"maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7\" (UID: \"9bfc0b06-ff77-4b32-871b-cd76a1b01f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:40.366650 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.366547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bfc0b06-ff77-4b32-871b-cd76a1b01f82-maas-api-tls\") pod \"maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7\" (UID: \"9bfc0b06-ff77-4b32-871b-cd76a1b01f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:40.366650 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.366609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntg82\" (UniqueName: \"kubernetes.io/projected/9bfc0b06-ff77-4b32-871b-cd76a1b01f82-kube-api-access-ntg82\") pod \"maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7\" (UID: \"9bfc0b06-ff77-4b32-871b-cd76a1b01f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:40.366650 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.366638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bfc0b06-ff77-4b32-871b-cd76a1b01f82-openshift-service-ca\") pod \"maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7\" (UID: \"9bfc0b06-ff77-4b32-871b-cd76a1b01f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:40.366940 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:37:40.366729 2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-serving-cert: secret "maas-api-e2e-mt-f6e0ed38-serving-cert" not found Jul 15 21:37:40.366940 ip-10-0-136-107 kubenswrapper[2578]: E0715 21:37:40.366807 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bfc0b06-ff77-4b32-871b-cd76a1b01f82-maas-api-tls podName:9bfc0b06-ff77-4b32-871b-cd76a1b01f82 nodeName:}" failed. No retries permitted until 2026-07-15 21:37:40.866787188 +0000 UTC m=+1682.055267687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9bfc0b06-ff77-4b32-871b-cd76a1b01f82-maas-api-tls") pod "maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" (UID: "9bfc0b06-ff77-4b32-871b-cd76a1b01f82") : secret "maas-api-e2e-mt-f6e0ed38-serving-cert" not found Jul 15 21:37:40.367343 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.367324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bfc0b06-ff77-4b32-871b-cd76a1b01f82-openshift-service-ca\") pod \"maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7\" (UID: \"9bfc0b06-ff77-4b32-871b-cd76a1b01f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:40.375868 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.375844 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntg82\" (UniqueName: \"kubernetes.io/projected/9bfc0b06-ff77-4b32-871b-cd76a1b01f82-kube-api-access-ntg82\") pod \"maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7\" (UID: \"9bfc0b06-ff77-4b32-871b-cd76a1b01f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:40.871952 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.871919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bfc0b06-ff77-4b32-871b-cd76a1b01f82-maas-api-tls\") pod \"maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7\" (UID: \"9bfc0b06-ff77-4b32-871b-cd76a1b01f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:40.874507 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:40.874482 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bfc0b06-ff77-4b32-871b-cd76a1b01f82-maas-api-tls\") pod \"maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7\" (UID: \"9bfc0b06-ff77-4b32-871b-cd76a1b01f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:41.027437 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:41.027401 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:41.173415 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:41.173390 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7"] Jul 15 21:37:41.175884 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:37:41.175852 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfc0b06_ff77_4b32_871b_cd76a1b01f82.slice/crio-2308c6d02a59a3b42cad44fcf063c6318ad0dd66d8374215e07c2bfafb98f098 WatchSource:0}: Error finding container 2308c6d02a59a3b42cad44fcf063c6318ad0dd66d8374215e07c2bfafb98f098: Status 404 returned error can't find the container with id 2308c6d02a59a3b42cad44fcf063c6318ad0dd66d8374215e07c2bfafb98f098 Jul 15 21:37:41.481961 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:41.481878 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" event={"ID":"9bfc0b06-ff77-4b32-871b-cd76a1b01f82","Type":"ContainerStarted","Data":"2308c6d02a59a3b42cad44fcf063c6318ad0dd66d8374215e07c2bfafb98f098"} Jul 15 21:37:42.488556 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:42.488517 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" event={"ID":"9bfc0b06-ff77-4b32-871b-cd76a1b01f82","Type":"ContainerStarted","Data":"08441b4e2f1756125220791258dfb3de6bf4bfad61bb2fe2ef224aa669182caf"} Jul 15 21:37:42.488948 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:42.488581 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:37:42.508949 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:42.508899 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" podStartSLOduration=2.000542213 podStartE2EDuration="2.508871335s" totalImagesPullingTime="508.329122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:37:42.506707138 +0000 UTC m=+1683.695187672" watchObservedRunningTime="2026-07-15 21:37:42.508871335 +0000 UTC m=+1683.697351915" Jul 15 21:37:48.498581 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:37:48.498550 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7" Jul 15 21:39:16.381104 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.381068 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf"] Jul 15 21:39:16.384776 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.384752 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:16.387141 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.387114 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-da1123-serving-cert\"" Jul 15 21:39:16.398516 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.398487 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf"] Jul 15 21:39:16.556479 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.556433 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21b5e57-a958-4223-9807-8f47c17f88a8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf\" (UID: \"b21b5e57-a958-4223-9807-8f47c17f88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:16.556658 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.556506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vwmt\" (UniqueName: \"kubernetes.io/projected/b21b5e57-a958-4223-9807-8f47c17f88a8-kube-api-access-9vwmt\") pod \"maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf\" (UID: \"b21b5e57-a958-4223-9807-8f47c17f88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:16.556658 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.556569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b21b5e57-a958-4223-9807-8f47c17f88a8-maas-api-tls\") pod \"maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf\" (UID: \"b21b5e57-a958-4223-9807-8f47c17f88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:16.657398 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.657303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21b5e57-a958-4223-9807-8f47c17f88a8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf\" (UID: \"b21b5e57-a958-4223-9807-8f47c17f88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:16.657398 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.657374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vwmt\" (UniqueName: \"kubernetes.io/projected/b21b5e57-a958-4223-9807-8f47c17f88a8-kube-api-access-9vwmt\") pod \"maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf\" (UID: \"b21b5e57-a958-4223-9807-8f47c17f88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:16.657622 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.657432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b21b5e57-a958-4223-9807-8f47c17f88a8-maas-api-tls\") pod \"maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf\" (UID: \"b21b5e57-a958-4223-9807-8f47c17f88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:16.658109 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.658088 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21b5e57-a958-4223-9807-8f47c17f88a8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf\" (UID: \"b21b5e57-a958-4223-9807-8f47c17f88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:16.659888 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.659865 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b21b5e57-a958-4223-9807-8f47c17f88a8-maas-api-tls\") pod \"maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf\" (UID: \"b21b5e57-a958-4223-9807-8f47c17f88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:16.666386 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.666359 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vwmt\" (UniqueName: \"kubernetes.io/projected/b21b5e57-a958-4223-9807-8f47c17f88a8-kube-api-access-9vwmt\") pod \"maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf\" (UID: \"b21b5e57-a958-4223-9807-8f47c17f88a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:16.695972 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.695936 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:16.846531 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.846504 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf"] Jul 15 21:39:16.848678 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:39:16.848645 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb21b5e57_a958_4223_9807_8f47c17f88a8.slice/crio-4aa350e987aac1ddd5a6edbd147cd53d43b77998baf80af0ceee626c0e52b7d3 WatchSource:0}: Error finding container 4aa350e987aac1ddd5a6edbd147cd53d43b77998baf80af0ceee626c0e52b7d3: Status 404 returned error can't find the container with id 4aa350e987aac1ddd5a6edbd147cd53d43b77998baf80af0ceee626c0e52b7d3 Jul 15 21:39:16.944160 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:16.944064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" event={"ID":"b21b5e57-a958-4223-9807-8f47c17f88a8","Type":"ContainerStarted","Data":"4aa350e987aac1ddd5a6edbd147cd53d43b77998baf80af0ceee626c0e52b7d3"} Jul 15 21:39:17.950894 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:17.950858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" event={"ID":"b21b5e57-a958-4223-9807-8f47c17f88a8","Type":"ContainerStarted","Data":"34dd08a89ba05508a75508f173c310110cd7833f8962f644a25c8fd24a5da139"} Jul 15 21:39:17.951294 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:17.950949 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:17.969391 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:17.969343 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" podStartSLOduration=1.525086896 podStartE2EDuration="1.969325896s" totalImagesPullingTime="444.239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:17.967716712 +0000 UTC m=+1779.156197234" watchObservedRunningTime="2026-07-15 21:39:17.969325896 +0000 UTC m=+1779.157806417" Jul 15 21:39:23.960886 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:23.960855 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf" Jul 15 21:39:24.463075 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.463017 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc"] Jul 15 21:39:24.466836 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.466804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:24.469454 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.469432 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-9625f6-serving-cert\"" Jul 15 21:39:24.486430 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.486389 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc"] Jul 15 21:39:24.531395 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.531357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc\" (UID: \"9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:24.531544 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.531422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gdfg\" (UniqueName: \"kubernetes.io/projected/9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df-kube-api-access-8gdfg\") pod \"maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc\" (UID: \"9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:24.531544 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.531496 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df-maas-api-tls\") pod \"maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc\" (UID: \"9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:24.632700 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.632644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df-maas-api-tls\") pod \"maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc\" (UID: \"9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:24.632700 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.632714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc\" (UID: \"9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:24.632925 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.632751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gdfg\" (UniqueName: \"kubernetes.io/projected/9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df-kube-api-access-8gdfg\") pod \"maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc\" (UID: \"9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:24.633491 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.633463 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc\" (UID: \"9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:24.635265 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.635248 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df-maas-api-tls\") pod \"maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc\" (UID: \"9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:24.641475 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.641455 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gdfg\" (UniqueName: \"kubernetes.io/projected/9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df-kube-api-access-8gdfg\") pod \"maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc\" (UID: \"9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:24.777237 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.777137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:24.922778 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.922749 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc"] Jul 15 21:39:24.925206 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:39:24.925173 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d50f3d7_1b8c_42fa_9fc2_307dcdfca6df.slice/crio-b567ec1281a4c5a298c04ea23b6db481b2ddd39347079f41d4918ef5fcba248a WatchSource:0}: Error finding container b567ec1281a4c5a298c04ea23b6db481b2ddd39347079f41d4918ef5fcba248a: Status 404 returned error can't find the container with id b567ec1281a4c5a298c04ea23b6db481b2ddd39347079f41d4918ef5fcba248a Jul 15 21:39:24.984663 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:24.984625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" event={"ID":"9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df","Type":"ContainerStarted","Data":"b567ec1281a4c5a298c04ea23b6db481b2ddd39347079f41d4918ef5fcba248a"} Jul 15 21:39:25.991362 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:25.991327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" event={"ID":"9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df","Type":"ContainerStarted","Data":"576adf7d1caf400defed6e69fd39c90fe3efef0a0a716e0d9cc613e8b32c2c74"} Jul 15 21:39:25.991753 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:25.991441 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:26.010599 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:26.010549 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" podStartSLOduration=1.58874927 podStartE2EDuration="2.010531239s" totalImagesPullingTime="421.781969ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:26.008675916 +0000 UTC m=+1787.197156472" watchObservedRunningTime="2026-07-15 21:39:26.010531239 +0000 UTC m=+1787.199011760" Jul 15 21:39:32.003363 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:32.003292 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc" Jul 15 21:39:39.523439 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:39.523324 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:39:39.543773 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:39.534741 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:39:39.543773 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:39.535692 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:39:39.543773 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:39:39.539971 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:41:15.005705 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.005667 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4"] Jul 15 21:41:15.009281 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.009257 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:41:15.011824 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.011803 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-94c8e7-serving-cert\"" Jul 15 21:41:15.023373 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.023343 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4"] Jul 15 21:41:15.054774 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.054735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wzrj\" (UniqueName: \"kubernetes.io/projected/4c7b6668-5a9f-486d-9e81-a91fe4f5b704-kube-api-access-6wzrj\") pod \"maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4\" (UID: \"4c7b6668-5a9f-486d-9e81-a91fe4f5b704\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:41:15.054971 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.054808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7b6668-5a9f-486d-9e81-a91fe4f5b704-openshift-service-ca\") pod \"maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4\" (UID: \"4c7b6668-5a9f-486d-9e81-a91fe4f5b704\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:41:15.054971 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.054842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c7b6668-5a9f-486d-9e81-a91fe4f5b704-maas-api-tls\") pod \"maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4\" (UID: \"4c7b6668-5a9f-486d-9e81-a91fe4f5b704\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:41:15.156011 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.155975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wzrj\" (UniqueName: \"kubernetes.io/projected/4c7b6668-5a9f-486d-9e81-a91fe4f5b704-kube-api-access-6wzrj\") pod \"maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4\" (UID: \"4c7b6668-5a9f-486d-9e81-a91fe4f5b704\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:41:15.156240 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.156063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7b6668-5a9f-486d-9e81-a91fe4f5b704-openshift-service-ca\") pod \"maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4\" (UID: \"4c7b6668-5a9f-486d-9e81-a91fe4f5b704\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:41:15.156240 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.156099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c7b6668-5a9f-486d-9e81-a91fe4f5b704-maas-api-tls\") pod \"maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4\" (UID: \"4c7b6668-5a9f-486d-9e81-a91fe4f5b704\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:41:15.156700 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.156680 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7b6668-5a9f-486d-9e81-a91fe4f5b704-openshift-service-ca\") pod \"maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4\" (UID: \"4c7b6668-5a9f-486d-9e81-a91fe4f5b704\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:41:15.158560 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.158539 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c7b6668-5a9f-486d-9e81-a91fe4f5b704-maas-api-tls\") pod \"maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4\" (UID: \"4c7b6668-5a9f-486d-9e81-a91fe4f5b704\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:41:15.166157 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.166132 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wzrj\" (UniqueName: \"kubernetes.io/projected/4c7b6668-5a9f-486d-9e81-a91fe4f5b704-kube-api-access-6wzrj\") pod \"maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4\" (UID: \"4c7b6668-5a9f-486d-9e81-a91fe4f5b704\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:41:15.320935 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.320844 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:41:15.470225 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.470070 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4"] Jul 15 21:41:15.473232 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:41:15.473204 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7b6668_5a9f_486d_9e81_a91fe4f5b704.slice/crio-fd34c6ecd2a33afbf2d6f6a68b0d66b0cebd1fc327e362cdc71421861f825e08 WatchSource:0}: Error finding container fd34c6ecd2a33afbf2d6f6a68b0d66b0cebd1fc327e362cdc71421861f825e08: Status 404 returned error can't find the container with id fd34c6ecd2a33afbf2d6f6a68b0d66b0cebd1fc327e362cdc71421861f825e08 Jul 15 21:41:15.474596 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.474577 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:41:15.542298 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:15.542265 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" event={"ID":"4c7b6668-5a9f-486d-9e81-a91fe4f5b704","Type":"ContainerStarted","Data":"fd34c6ecd2a33afbf2d6f6a68b0d66b0cebd1fc327e362cdc71421861f825e08"} Jul 15 21:41:16.549505 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:16.549457 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" event={"ID":"4c7b6668-5a9f-486d-9e81-a91fe4f5b704","Type":"ContainerStarted","Data":"9b371dc14a18fef247a36ed68026edc61b4346dac62e89fc85ae9b5cf115ba64"} Jul 15 21:41:16.549958 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:16.549521 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:41:16.570687 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:16.570631 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" podStartSLOduration=1.9488938660000001 podStartE2EDuration="2.570607169s" totalImagesPullingTime="621.713303ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:41:16.569504857 +0000 UTC m=+1897.757985381" watchObservedRunningTime="2026-07-15 21:41:16.570607169 +0000 UTC m=+1897.759087692" Jul 15 21:41:22.560466 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:41:22.560431 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4" Jul 15 21:44:39.564310 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:44:39.564198 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:44:39.569128 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:44:39.569108 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:44:39.570601 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:44:39.570580 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:44:39.575687 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:44:39.575669 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggffq_cead259e-135e-46c5-9f12-9b473470c523/ovn-acl-logging/0.log" Jul 15 21:48:28.551242 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:28.551210 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69496855bc-bqbjb_09a21830-68f5-4cd7-bc49-5334f52dec67/manager/0.log" Jul 15 21:48:28.914697 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:28.914668 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f656749fc-7758k_778ac274-07e5-43f7-984e-2eb4f40462aa/copy-manifests/0.log" Jul 15 21:48:28.928757 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:28.928728 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f656749fc-7758k_778ac274-07e5-43f7-984e-2eb4f40462aa/manager/0.log" Jul 15 21:48:29.590888 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:29.590859 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-b94f58bbd-xsbxx_08eca79b-4249-4f5a-94cb-a9bbd745de8b/maas-api/0.log" Jul 15 21:48:29.705966 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:29.705938 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-ait-ca080678-76947f7946-47dlb_aceaf4ae-8a9c-4ffb-bbb9-1c5140d214dd/maas-api/0.log" Jul 15 21:48:29.819506 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:29.819474 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-a-94c8e7-74d8c8c5b9-t7gt4_4c7b6668-5a9f-486d-9e81-a91fe4f5b704/maas-api/0.log" Jul 15 21:48:30.055416 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:30.055372 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-derive-281d9c60-7d657b49cc-mk4k8_9f519479-79e3-4d28-85f1-5c0fd89c8f99/maas-api/0.log" Jul 15 21:48:30.167400 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:30.167367 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-a-da1123-678dfcd79b-fnhlf_b21b5e57-a958-4223-9807-8f47c17f88a8/maas-api/0.log" Jul 15 21:48:30.286823 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:30.286780 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-b-9625f6-6576d89b6c-vlrtc_9d50f3d7-1b8c-42fa-9fc2-307dcdfca6df/maas-api/0.log" Jul 15 21:48:30.407198 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:30.407159 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-migrate-c871ea22-5bd5f6fdc-vmlgb_2af2b1f8-0ff6-45a3-92a8-bb0ec0f5d888/maas-api/0.log" Jul 15 21:48:30.520795 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:30.520762 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-mt-f6e0ed38-66b66f5d8f-v49l7_9bfc0b06-ff77-4b32-871b-cd76a1b01f82/maas-api/0.log" Jul 15 21:48:32.200736 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:32.200643 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-jcf29_2dbaff5a-fb49-416e-b781-f3356d6d9a8e/postgres/0.log" Jul 15 21:48:33.643869 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:33.643825 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-47q2k_2b8e21df-249a-433b-8f84-fba6b7d2a6fb/manager/0.log" Jul 15 21:48:33.870499 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:33.870470 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rcnd7_a7d021da-e92e-4dc6-8ff3-8a6979a046fd/kuadrant-console-plugin/0.log" Jul 15 21:48:34.000485 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:34.000378 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2r687_8378f36e-c96f-4fc2-a69c-905afd486d9e/registry-server/0.log" Jul 15 21:48:35.481876 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:35.481844 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-4mm56_9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6/payload-processing/0.log" Jul 15 21:48:35.603593 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:35.603547 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc5f88888-2px5d_11455e3b-a5e4-4885-b34a-7726f892fa13/router/0.log" Jul 15 21:48:35.950081 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:35.950052 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-tdn5w_3e7443b3-4a06-4afc-8a33-224f703b470a/main/0.log" Jul 15 21:48:36.292666 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:36.292545 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkrksg_bd6944d2-08a2-4a18-8161-2509f315f4a7/main/0.log" Jul 15 21:48:45.174315 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:45.174277 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6k6wd_7bf7611a-bc20-4785-85ef-3fa8ef337b76/global-pull-secret-syncer/0.log" Jul 15 21:48:45.332850 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:45.332824 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-blczl_4d27faf9-6e82-4607-a427-5b391a57e548/konnectivity-agent/0.log" Jul 15 21:48:45.386456 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:45.386412 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-107.ec2.internal_0ee02da604e394d7a77bd64a803f84f9/haproxy/0.log" Jul 15 21:48:50.829595 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:50.829555 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-47q2k_2b8e21df-249a-433b-8f84-fba6b7d2a6fb/manager/0.log" Jul 15 21:48:50.887438 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:50.887410 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rcnd7_a7d021da-e92e-4dc6-8ff3-8a6979a046fd/kuadrant-console-plugin/0.log" Jul 15 21:48:50.927240 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:50.927213 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2r687_8378f36e-c96f-4fc2-a69c-905afd486d9e/registry-server/0.log" Jul 15 21:48:53.081877 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:53.081829 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-84hfx_69bd13d1-c703-4ab9-87f6-298e59f1ffac/cluster-monitoring-operator/0.log" Jul 15 21:48:53.342308 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:53.342227 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94ntl_03ca135f-6378-4495-926e-8188c7f76738/node-exporter/0.log" Jul 15 21:48:53.369080 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:53.369048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94ntl_03ca135f-6378-4495-926e-8188c7f76738/kube-rbac-proxy/0.log" Jul 15 21:48:53.390396 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:53.390373 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94ntl_03ca135f-6378-4495-926e-8188c7f76738/init-textfile/0.log" Jul 15 21:48:55.176754 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.176727 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-2zv8c_a4f0349f-0422-43a6-a159-dc855b6708b3/networking-console-plugin/0.log" Jul 15 21:48:55.283420 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.283385 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk"] Jul 15 21:48:55.287239 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.287215 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.289456 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.289436 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2496\"/\"kube-root-ca.crt\"" Jul 15 21:48:55.290469 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.290447 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v2496\"/\"default-dockercfg-czhdx\"" Jul 15 21:48:55.290579 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.290518 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2496\"/\"openshift-service-ca.crt\"" Jul 15 21:48:55.297597 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.297569 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk"] Jul 15 21:48:55.459983 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.459892 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn85t\" (UniqueName: \"kubernetes.io/projected/f32457f8-f710-420a-a82f-d1ff08e4ac5c-kube-api-access-nn85t\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.459983 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.459966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f32457f8-f710-420a-a82f-d1ff08e4ac5c-sys\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.460202 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.460110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f32457f8-f710-420a-a82f-d1ff08e4ac5c-podres\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.460202 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.460169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f32457f8-f710-420a-a82f-d1ff08e4ac5c-lib-modules\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.460274 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.460212 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f32457f8-f710-420a-a82f-d1ff08e4ac5c-proc\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.561123 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.561090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f32457f8-f710-420a-a82f-d1ff08e4ac5c-sys\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.561285 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.561132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f32457f8-f710-420a-a82f-d1ff08e4ac5c-podres\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.561285 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.561185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f32457f8-f710-420a-a82f-d1ff08e4ac5c-lib-modules\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.561285 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.561204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f32457f8-f710-420a-a82f-d1ff08e4ac5c-proc\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.561285 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.561214 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f32457f8-f710-420a-a82f-d1ff08e4ac5c-sys\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.561285 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.561279 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f32457f8-f710-420a-a82f-d1ff08e4ac5c-proc\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.561447 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.561303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn85t\" (UniqueName: \"kubernetes.io/projected/f32457f8-f710-420a-a82f-d1ff08e4ac5c-kube-api-access-nn85t\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.561447 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.561331 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f32457f8-f710-420a-a82f-d1ff08e4ac5c-podres\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.561447 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.561345 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f32457f8-f710-420a-a82f-d1ff08e4ac5c-lib-modules\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.569244 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.569223 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn85t\" (UniqueName: \"kubernetes.io/projected/f32457f8-f710-420a-a82f-d1ff08e4ac5c-kube-api-access-nn85t\") pod \"perf-node-gather-daemonset-cz6gk\" (UID: \"f32457f8-f710-420a-a82f-d1ff08e4ac5c\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.598382 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.598332 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.739808 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.739783 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk"] Jul 15 21:48:55.742518 ip-10-0-136-107 kubenswrapper[2578]: W0715 21:48:55.742482 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf32457f8_f710_420a_a82f_d1ff08e4ac5c.slice/crio-33adfe201702103ed653ee654da6ca5e9992f1dc4eaa56e1d560e672335199da WatchSource:0}: Error finding container 33adfe201702103ed653ee654da6ca5e9992f1dc4eaa56e1d560e672335199da: Status 404 returned error can't find the container with id 33adfe201702103ed653ee654da6ca5e9992f1dc4eaa56e1d560e672335199da Jul 15 21:48:55.840908 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.840877 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/1.log" Jul 15 21:48:55.845545 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.845525 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bc8kx_6426605a-7777-443e-9cd5-474ad2c118a2/console-operator/2.log" Jul 15 21:48:55.851980 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.851952 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" event={"ID":"f32457f8-f710-420a-a82f-d1ff08e4ac5c","Type":"ContainerStarted","Data":"f904ddc2955fa2ac6dbce68afa4e007c4ad1121218083f56f77ccfd08aef7777"} Jul 15 21:48:55.852097 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.851993 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" event={"ID":"f32457f8-f710-420a-a82f-d1ff08e4ac5c","Type":"ContainerStarted","Data":"33adfe201702103ed653ee654da6ca5e9992f1dc4eaa56e1d560e672335199da"} Jul 15 21:48:55.852097 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.852083 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:48:55.870316 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:55.870267 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" podStartSLOduration=0.870252071 podStartE2EDuration="870.252071ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:48:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:48:55.868389363 +0000 UTC m=+2357.056869886" watchObservedRunningTime="2026-07-15 21:48:55.870252071 +0000 UTC m=+2357.058732593" Jul 15 21:48:56.367250 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:56.367220 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-2d9fg_5e8b6fac-9625-4e6c-b55a-f0c12857f5d9/download-server/0.log" Jul 15 21:48:56.938437 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:56.938405 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-lvb26_c6c1958d-9088-4d84-8dee-81facd159ee8/volume-data-source-validator/0.log" Jul 15 21:48:57.911596 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:57.911565 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2fgr9_21d9f46f-abef-498e-91ae-e0c813afa9ff/dns/0.log" Jul 15 21:48:57.933906 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:57.933876 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2fgr9_21d9f46f-abef-498e-91ae-e0c813afa9ff/kube-rbac-proxy/0.log" Jul 15 21:48:58.077436 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:58.077407 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s5mqn_ce9a409f-624e-4213-bc69-c760ed247c6c/dns-node-resolver/0.log" Jul 15 21:48:58.697127 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:58.697088 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wfbd7_fb855b08-480a-4ab2-a350-13c13522a436/node-ca/0.log" Jul 15 21:48:59.890571 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:59.890538 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-4mm56_9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6/payload-processing/0.log" Jul 15 21:48:59.916054 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:48:59.916006 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc5f88888-2px5d_11455e3b-a5e4-4885-b34a-7726f892fa13/router/0.log" Jul 15 21:49:00.580870 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:00.580837 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n49fs_54819573-6ef6-47f0-8aee-bb199f8f29b3/serve-healthcheck-canary/0.log" Jul 15 21:49:01.087534 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:01.087498 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-6pnfg_d660a20e-f03a-44f9-b1c5-e94bb77d0e3e/insights-operator/0.log" Jul 15 21:49:01.088235 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:01.088220 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-6pnfg_d660a20e-f03a-44f9-b1c5-e94bb77d0e3e/insights-operator/1.log" Jul 15 21:49:01.244489 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:01.244454 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rk9tw_fa4043d2-3da2-4780-b4bc-cea7277b018f/kube-rbac-proxy/0.log" Jul 15 21:49:01.264620 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:01.264590 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rk9tw_fa4043d2-3da2-4780-b4bc-cea7277b018f/exporter/0.log" Jul 15 21:49:01.285316 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:01.285287 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rk9tw_fa4043d2-3da2-4780-b4bc-cea7277b018f/extractor/0.log" Jul 15 21:49:01.867271 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:01.867245 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-cz6gk" Jul 15 21:49:03.568799 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:03.568760 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69496855bc-bqbjb_09a21830-68f5-4cd7-bc49-5334f52dec67/manager/0.log" Jul 15 21:49:03.724551 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:03.724517 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f656749fc-7758k_778ac274-07e5-43f7-984e-2eb4f40462aa/manager/0.log" Jul 15 21:49:03.740442 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:03.740417 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f656749fc-7758k_778ac274-07e5-43f7-984e-2eb4f40462aa/copy-manifests/0.log" Jul 15 21:49:05.350705 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:05.350673 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-764bf7f9d4-lcbkg_37659c91-79ad-4b06-8a88-8ddbb0796b53/manager/0.log" Jul 15 21:49:05.990188 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:05.990153 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-4mm56_9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6/payload-processing/0.log" Jul 15 21:49:06.001882 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:06.001852 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc5f88888-2px5d_11455e3b-a5e4-4885-b34a-7726f892fa13/router/0.log" Jul 15 21:49:07.347461 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:07.347376 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-4mm56_9a8cf72e-cf70-4a37-a4ab-a0f8fa6a81e6/payload-processing/0.log" Jul 15 21:49:07.360012 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:07.359986 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc5f88888-2px5d_11455e3b-a5e4-4885-b34a-7726f892fa13/router/0.log" Jul 15 21:49:10.247451 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:10.247418 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-rlljz_734a8d6b-1969-4f11-9b53-fcac166abe33/migrator/0.log" Jul 15 21:49:10.266126 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:10.266091 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-rlljz_734a8d6b-1969-4f11-9b53-fcac166abe33/graceful-termination/0.log" Jul 15 21:49:10.595096 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:10.595005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-cbrf6_de413493-569c-4559-a915-24f958922892/kube-storage-version-migrator-operator/1.log" Jul 15 21:49:10.595877 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:10.595851 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-cbrf6_de413493-569c-4559-a915-24f958922892/kube-storage-version-migrator-operator/0.log" Jul 15 21:49:11.693783 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:11.693756 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcn9l_be24de37-d807-4d7f-9e19-ea9d7cf2caa4/kube-multus-additional-cni-plugins/0.log" Jul 15 21:49:11.715315 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:11.715287 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcn9l_be24de37-d807-4d7f-9e19-ea9d7cf2caa4/egress-router-binary-copy/0.log" Jul 15 21:49:11.734942 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:11.734916 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcn9l_be24de37-d807-4d7f-9e19-ea9d7cf2caa4/cni-plugins/0.log" Jul 15 21:49:11.754904 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:11.754877 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcn9l_be24de37-d807-4d7f-9e19-ea9d7cf2caa4/bond-cni-plugin/0.log" Jul 15 21:49:11.775604 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:11.775576 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcn9l_be24de37-d807-4d7f-9e19-ea9d7cf2caa4/routeoverride-cni/0.log" Jul 15 21:49:11.795588 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:11.795559 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcn9l_be24de37-d807-4d7f-9e19-ea9d7cf2caa4/whereabouts-cni-bincopy/0.log" Jul 15 21:49:11.814875 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:11.814843 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcn9l_be24de37-d807-4d7f-9e19-ea9d7cf2caa4/whereabouts-cni/0.log" Jul 15 21:49:12.001125 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:12.001024 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j9f5x_fe1b65c7-3653-4f4e-a2c2-5b9fb5f101fb/kube-multus/0.log" Jul 15 21:49:12.123789 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:12.123758 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fxtxv_e3f782c6-eee1-4867-b1c7-52b75c1bb2d6/network-metrics-daemon/0.log" Jul 15 21:49:12.141246 ip-10-0-136-107 kubenswrapper[2578]: I0715 21:49:12.141219 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fxtxv_e3f782c6-eee1-4867-b1c7-52b75c1bb2d6/kube-rbac-proxy/0.log"