Jul 24 03:59:47.634273 ip-10-0-129-87 systemd[1]: Starting Kubernetes Kubelet... Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.088423 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094456 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094470 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094474 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094477 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094481 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094484 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094487 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094490 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:59:48.102374 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094493 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094496 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094498 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094501 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094504 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094507 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094509 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094513 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094518 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094522 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094525 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094527 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094533 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094536 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094539 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094541 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094544 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094547 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094550 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094552 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:59:48.116429 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094556 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094558 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094561 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094564 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094567 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094572 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094576 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094579 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094582 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094585 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094588 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094590 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094593 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094596 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094598 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094601 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094604 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094606 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094609 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:59:48.119336 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094612 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094615 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094617 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094620 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094623 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094626 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094629 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094632 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094634 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094636 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094639 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094641 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094644 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094647 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094650 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094653 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094656 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094659 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094662 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094664 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:59:48.120841 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094666 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094669 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094672 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094675 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094677 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094680 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094682 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094685 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094688 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094691 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094693 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094696 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094698 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094700 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094704 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094707 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094709 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094712 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094715 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:59:48.123451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094719 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094722 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094725 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094728 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094731 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094734 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094738 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094740 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094743 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094746 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094748 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094751 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.094754 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095565 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095576 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095579 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095582 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095585 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095589 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:59:48.168440 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095592 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095594 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095597 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095600 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095602 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095605 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095608 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095611 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095614 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095616 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095619 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095622 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095635 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095638 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095641 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095644 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095646 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095649 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095652 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095655 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:59:48.170660 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095658 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:59:48.170321 ip-10-0-129-87 systemd[1]: Started Kubernetes Kubelet. Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095661 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095664 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095667 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095669 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095672 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095674 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095677 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095679 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095682 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095684 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095687 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095689 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095692 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095694 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095697 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095699 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095702 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095705 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095707 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:59:48.173389 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095712 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095717 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095720 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095722 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095725 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095735 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095738 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095741 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095743 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095748 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095751 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095753 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095756 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095761 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095765 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095768 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095771 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095774 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095776 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:59:48.189542 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095778 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095781 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095784 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095786 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095789 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095791 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095794 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095796 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095799 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095801 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095804 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095806 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095809 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095811 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095814 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095816 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095819 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095822 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095824 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095828 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:59:48.204534 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095832 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095835 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095841 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095844 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095847 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095850 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095853 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095856 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095859 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095862 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095865 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095868 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095870 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.095873 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096325 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096331 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096334 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096337 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096339 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:59:48.207380 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096342 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096345 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096348 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096351 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096355 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096358 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096361 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096364 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096367 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096370 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096373 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096376 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096379 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096382 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096384 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096392 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096396 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096399 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096401 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096404 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:59:48.222451 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096407 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096411 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096414 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096417 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096420 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096423 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096426 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096429 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096432 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096435 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096438 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096440 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096443 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096446 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096448 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096451 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096454 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096457 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096460 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096463 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:59:48.375959 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096466 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096468 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096471 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096474 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096477 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096480 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096482 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096487 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096490 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096492 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096495 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096498 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096500 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096503 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096506 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096508 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096511 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096514 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096516 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:59:48.395781 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096520 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096522 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096525 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096527 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096530 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096533 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096535 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096538 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096540 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096543 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096545 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096548 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096550 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096553 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096555 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096558 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096560 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096563 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096566 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:59:48.396635 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096569 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096572 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096575 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096578 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096580 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096583 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096585 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096588 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096590 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096593 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096596 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096598 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096601 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096603 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096606 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.096609 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096687 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096695 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096702 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096706 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096711 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 03:59:48.397486 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096714 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096718 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096723 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096726 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096729 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096732 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096737 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096740 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096743 2578 flags.go:64] FLAG: --cgroup-root="" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096746 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096749 2578 flags.go:64] FLAG: --client-ca-file="" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096752 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096757 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096762 2578 flags.go:64] FLAG: --cluster-domain="" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096765 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096768 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096772 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096775 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096779 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096782 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096785 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096789 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096792 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096795 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 03:59:48.398323 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096798 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096803 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096806 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096810 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096813 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096816 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096819 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096823 2578 flags.go:64] FLAG: --enable-server="true" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096826 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096830 2578 flags.go:64] FLAG: --event-burst="100" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096833 2578 flags.go:64] FLAG: --event-qps="50" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096836 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096839 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096843 2578 flags.go:64] FLAG: --eviction-hard="" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096847 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096850 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096853 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096856 2578 flags.go:64] FLAG: --eviction-soft="" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096859 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096862 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096866 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096869 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096872 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096875 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096879 2578 flags.go:64] FLAG: --feature-gates="" Jul 24 03:59:48.399599 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096883 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096886 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096889 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096892 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096895 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096898 2578 flags.go:64] FLAG: --help="false" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096901 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096904 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096909 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096912 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096915 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096918 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096921 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096925 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096927 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096931 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096933 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096937 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096939 2578 flags.go:64] FLAG: --kube-reserved="" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096942 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096945 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096948 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096951 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096953 2578 flags.go:64] FLAG: --lock-file="" Jul 24 03:59:48.400640 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096956 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096959 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096977 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096984 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096987 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096991 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096994 2578 flags.go:64] FLAG: --logging-format="text" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.096997 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097000 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097003 2578 flags.go:64] FLAG: --manifest-url="" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097006 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097010 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097013 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097017 2578 flags.go:64] FLAG: --max-pods="110" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097020 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097023 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097027 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097030 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097033 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097036 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097039 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097048 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097051 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097054 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 03:59:48.402900 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097057 2578 flags.go:64] FLAG: --pod-cidr="" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097060 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097066 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097069 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097072 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097075 2578 flags.go:64] FLAG: --port="10250" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097079 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097081 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05d72d36f0e501dd4" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097085 2578 flags.go:64] FLAG: --qos-reserved="" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097088 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097091 2578 flags.go:64] FLAG: --register-node="true" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097093 2578 flags.go:64] FLAG: --register-with-taints="" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097099 2578 flags.go:64] FLAG: --registry-burst="10" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097102 2578 flags.go:64] FLAG: --registry-qps="5" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097106 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097109 2578 flags.go:64] FLAG: --reserved-memory="" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097113 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097116 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097119 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097121 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097124 2578 flags.go:64] FLAG: --runonce="false" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097127 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097130 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097133 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097137 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 03:59:48.404650 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097140 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097143 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097146 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097149 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097152 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097154 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097157 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097160 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097163 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097166 2578 flags.go:64] FLAG: --system-cgroups="" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097169 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097174 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097177 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097180 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097184 2578 flags.go:64] FLAG: --tls-min-version="" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097187 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097190 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097193 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097195 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097200 2578 flags.go:64] FLAG: --v="2" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097204 2578 flags.go:64] FLAG: --version="false" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097208 2578 flags.go:64] FLAG: --vmodule="" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097212 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.097216 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097333 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:59:48.407402 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097337 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097340 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097343 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097346 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097349 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097351 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097356 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097359 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097362 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097365 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097367 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097370 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097372 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097375 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097378 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097381 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097383 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097386 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097388 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097391 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:59:48.409950 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097394 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097397 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097399 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097402 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097405 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097410 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097414 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097417 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097420 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097423 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097426 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097429 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097432 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097434 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097437 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097440 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097442 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097445 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097449 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:59:48.412683 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097452 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097454 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097457 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097460 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097462 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097465 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097467 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097470 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097472 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097475 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097477 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097480 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097483 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097485 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097488 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097490 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097493 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097495 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097498 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097503 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:59:48.414942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097505 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097508 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097510 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097513 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097516 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097519 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097522 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097524 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097527 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097530 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097532 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097536 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097539 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097541 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097544 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097546 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097549 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097552 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097554 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097557 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:59:48.417942 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097559 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097562 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097564 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097567 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097570 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097572 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097576 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097579 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097582 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097585 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097587 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097591 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097594 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097596 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097599 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097601 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097604 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097607 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:59:48.418707 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.097611 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.098405 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.106059 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.106076 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.106096 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.106102 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106156 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106161 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106165 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106168 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106171 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106175 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106178 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106181 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:59:48.419747 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106184 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106187 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106191 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106193 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106196 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106199 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106202 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106204 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106207 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106211 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106215 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106218 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106221 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106224 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106227 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106230 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106233 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106236 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106239 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106242 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:59:48.420353 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106245 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106249 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106253 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106257 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106260 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106263 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106266 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106269 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106272 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106275 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106278 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106280 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106283 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106286 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106288 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106291 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106293 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106296 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106299 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:59:48.421376 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106301 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106304 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106306 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106309 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106312 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106314 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106318 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106321 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106325 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106327 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106330 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106333 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106336 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106338 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106341 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106344 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106346 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106349 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106352 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:59:48.421991 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106354 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106357 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106360 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106363 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106366 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106368 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106371 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106373 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106376 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106379 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106382 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106384 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106387 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106390 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106392 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106395 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106398 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106400 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106403 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106405 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106408 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:59:48.423502 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106410 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106413 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106415 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106418 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106420 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106423 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106425 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106428 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106430 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106433 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106436 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106439 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.106444 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106565 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106570 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:59:48.424171 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106574 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106577 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106580 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106583 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106586 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106589 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106591 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106594 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106599 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106602 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106604 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106607 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106610 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106612 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106615 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106618 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106622 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106624 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106627 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:59:48.424659 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106630 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106633 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106636 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106639 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106641 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106644 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106647 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106649 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106652 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106654 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106657 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106659 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106665 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106667 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106670 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106673 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106675 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106678 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106680 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106683 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:59:48.425235 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106686 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106689 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106692 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106694 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106697 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106699 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106702 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106705 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106707 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106710 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106713 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106715 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106718 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106720 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106722 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106725 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106728 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106731 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106733 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106735 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:59:48.519054 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106738 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106741 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106743 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106746 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106750 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106753 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106755 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106758 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106760 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106763 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106765 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106768 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106771 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106774 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106776 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106780 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106784 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106787 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106790 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:59:48.519778 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106793 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106795 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106798 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106800 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106803 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106806 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106808 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106811 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106813 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106816 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106819 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106822 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106824 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106827 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106829 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106832 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106834 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106839 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:59:48.522013 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:48.106841 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:59:48.522739 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.106846 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 03:59:48.522739 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.106952 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 03:59:48.522739 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.109426 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 03:59:48.522739 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.111166 2578 server.go:1019] "Starting client certificate rotation" Jul 24 03:59:48.522739 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.111266 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 03:59:48.522739 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.111294 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 03:59:48.522739 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.115710 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 03:59:48.522739 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.117998 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 03:59:48.522739 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.130468 2578 log.go:25] "Validated CRI v1 runtime API" Jul 24 03:59:48.522739 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.132999 2578 log.go:25] "Validated CRI v1 image API" Jul 24 03:59:48.522739 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.133794 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 03:59:48.522739 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.139892 2578 fs.go:135] Filesystem UUIDs: map[6b751755-fb90-44d2-baf9-9b385d04fc13:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d8e88a0f-8435-478f-8220-458f05c03de4:/dev/nvme0n1p4] Jul 24 03:59:48.524610 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.139913 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 03:59:48.525012 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.145358 2578 manager.go:216] Machine: {Timestamp:2026-07-24 03:59:48.143892093 +0000 UTC m=+0.377591757 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099673 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2139aecdb798720936e8821071b384 SystemUUID:ec2139ae-cdb7-9872-0936-e8821071b384 BootID:e2f7f4cf-facf-48ef-a81d-e0a021245c5c Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d6:8a:cb:f9:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d6:8a:cb:f9:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:36:3a:7c:b3:34 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 03:59:48.525012 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.145462 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 03:59:48.525012 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.145548 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 03:59:48.525012 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.148860 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 03:59:48.525012 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.148888 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 03:59:48.525012 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.149788 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 03:59:48.525012 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.149808 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 03:59:48.525012 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.149831 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.150623 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.152122 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.152650 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.157393 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.157508 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.157535 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.157545 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.157560 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.157569 2578 kubelet.go:398] "Adding apiserver pod source" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.157578 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.157921 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.157939 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.160286 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.162265 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.162293 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.164196 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.164219 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.164232 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.164241 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.164257 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.164263 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.164272 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.164278 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.164288 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.164297 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.164326 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.164332 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.165350 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.165385 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.168716 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.168848 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.168887 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.169335 2578 server.go:1268] "Started kubelet" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.169434 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.169432 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.169779 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.171578 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.172642 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 03:59:48.526872 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.175286 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.175087 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-87.ec2.internal.18c51dcbbaa670c7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-87.ec2.internal,UID:ip-10-0-129-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-87.ec2.internal,},FirstTimestamp:2026-07-24 03:59:48.169306311 +0000 UTC m=+0.403005973,LastTimestamp:2026-07-24 03:59:48.169306311 +0000 UTC m=+0.403005973,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-87.ec2.internal,}" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.183126 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.183146 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.183197 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.183996 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.184009 2578 factory.go:55] Registering systemd factory Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.184030 2578 factory.go:223] Registration of the systemd container factory successfully Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.184166 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.184181 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.184300 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.184306 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.184429 2578 factory.go:153] Registering CRI-O factory Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.184443 2578 factory.go:223] Registration of the crio container factory successfully Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.184494 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.184518 2578 factory.go:103] Registering Raw factory Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.184534 2578 manager.go:1196] Started watching for new ooms in manager Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.185089 2578 manager.go:349] Starting recovery of all containers Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.185478 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.185577 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.196795 2578 manager.go:354] Recovery completed Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.201260 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.201885 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q9nrc" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.203050 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.203078 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.203088 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.203686 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.203696 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.203714 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.203748 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.204430 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.204459 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:59:48.528377 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.204472 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.207391 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q9nrc" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.209296 2578 policy_none.go:49] "None policy: Start" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.209316 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.209332 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.211023 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-87.ec2.internal.18c51dcbbca98662 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-87.ec2.internal,UID:ip-10-0-129-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-87.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-87.ec2.internal,},FirstTimestamp:2026-07-24 03:59:48.203062882 +0000 UTC m=+0.436762544,LastTimestamp:2026-07-24 03:59:48.203062882 +0000 UTC m=+0.436762544,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-87.ec2.internal,}" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.211443 2578 policy_none.go:47] "Start" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.214354 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-87.ec2.internal.18c51dcbbca9d5b5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-87.ec2.internal,UID:ip-10-0-129-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-87.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-87.ec2.internal,},FirstTimestamp:2026-07-24 03:59:48.203083189 +0000 UTC m=+0.436782853,LastTimestamp:2026-07-24 03:59:48.203083189 +0000 UTC m=+0.436782853,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-87.ec2.internal,}" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.252919 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.254131 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.254166 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.254186 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.254223 2578 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.256596 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.257584 2578 manager.go:337] "Starting Device Plugin manager" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.257620 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.257632 2578 server.go:87] "Starting device plugin registration server" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.257899 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.257910 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.258022 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.258107 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.258116 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.258582 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.258637 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.355123 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal"] Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.355245 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:59:48.532176 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.357623 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.357663 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.357677 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.358828 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.359714 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.359742 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.359755 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.359785 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.360123 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.360253 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.360282 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.360840 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.360874 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.360884 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.360895 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.360897 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.360910 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.363182 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.363208 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.363913 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.363938 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.363950 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.368377 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.368393 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-87.ec2.internal\": node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.385766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f7e8cdd0c9e683123e995ae57bab829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal\" (UID: \"2f7e8cdd0c9e683123e995ae57bab829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.385948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f7e8cdd0c9e683123e995ae57bab829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal\" (UID: \"2f7e8cdd0c9e683123e995ae57bab829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.386048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4818398c4598e46d283eeb2e2a1a7ab-config\") pod \"kube-apiserver-proxy-ip-10-0-129-87.ec2.internal\" (UID: \"a4818398c4598e46d283eeb2e2a1a7ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.389860 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:48.533304 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.435865 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-87.ec2.internal\" not found" node="ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.536693 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.440544 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-87.ec2.internal\" not found" node="ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.536693 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.487059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f7e8cdd0c9e683123e995ae57bab829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal\" (UID: \"2f7e8cdd0c9e683123e995ae57bab829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.536693 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.487098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f7e8cdd0c9e683123e995ae57bab829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal\" (UID: \"2f7e8cdd0c9e683123e995ae57bab829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.536693 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.487144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4818398c4598e46d283eeb2e2a1a7ab-config\") pod \"kube-apiserver-proxy-ip-10-0-129-87.ec2.internal\" (UID: \"a4818398c4598e46d283eeb2e2a1a7ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.536693 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.487159 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f7e8cdd0c9e683123e995ae57bab829-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal\" (UID: \"2f7e8cdd0c9e683123e995ae57bab829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.536693 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.487203 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4818398c4598e46d283eeb2e2a1a7ab-config\") pod \"kube-apiserver-proxy-ip-10-0-129-87.ec2.internal\" (UID: \"a4818398c4598e46d283eeb2e2a1a7ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.536693 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.487248 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f7e8cdd0c9e683123e995ae57bab829-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal\" (UID: \"2f7e8cdd0c9e683123e995ae57bab829\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.536693 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.490141 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:48.659052 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.590649 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:48.780007 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.691391 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:48.780007 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.740561 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.780007 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:48.744977 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" Jul 24 03:59:48.880394 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.792349 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:48.984766 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.892895 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:48.993370 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:48.993346 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:49.081494 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.081458 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:59:49.094067 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:49.094026 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:49.110384 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.110360 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 03:59:49.110865 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.110501 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 03:59:49.110865 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.110565 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 03:59:49.195010 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:49.194978 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:49.214607 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.214564 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 03:54:48 +0000 UTC" deadline="2028-04-21 01:04:21.653506512 +0000 UTC" Jul 24 03:59:49.214607 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.214602 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15285h4m32.438907775s" Jul 24 03:59:49.274165 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.274076 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:59:49.275487 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.275465 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:59:49.275597 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.275505 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:59:49.275597 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.275521 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:59:49.295160 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:49.295124 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:49.395714 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:49.395679 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:49.495827 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:49.495791 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:49.499698 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.499679 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:59:49.558934 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:49.558249 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4818398c4598e46d283eeb2e2a1a7ab.slice/crio-88a508fe30e5727e8d172ab0258a63ee2d75be8a7d4d3dd2ad39b4ee22693527 WatchSource:0}: Error finding container 88a508fe30e5727e8d172ab0258a63ee2d75be8a7d4d3dd2ad39b4ee22693527: Status 404 returned error can't find the container with id 88a508fe30e5727e8d172ab0258a63ee2d75be8a7d4d3dd2ad39b4ee22693527 Jul 24 03:59:49.558934 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:49.558565 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f7e8cdd0c9e683123e995ae57bab829.slice/crio-34a241757f8b5fc1454aed7d7394a0856aa6e67ade468ce4fb11810f6abb31e9 WatchSource:0}: Error finding container 34a241757f8b5fc1454aed7d7394a0856aa6e67ade468ce4fb11810f6abb31e9: Status 404 returned error can't find the container with id 34a241757f8b5fc1454aed7d7394a0856aa6e67ade468ce4fb11810f6abb31e9 Jul 24 03:59:49.564773 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.564743 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 03:59:49.596437 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:49.596403 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-87.ec2.internal\" not found" Jul 24 03:59:49.694805 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.694779 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:59:49.784382 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.784338 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" Jul 24 03:59:49.797765 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.797689 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 03:59:49.798866 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.798848 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" Jul 24 03:59:49.808208 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:49.808184 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 03:59:50.161551 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.161455 2578 apiserver.go:52] "Watching apiserver" Jul 24 03:59:50.168914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.168854 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 03:59:50.170620 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.170585 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-qt8ht","kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h","openshift-dns/node-resolver-vgwxn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal","openshift-multus/multus-additional-cni-plugins-2slfs","openshift-multus/multus-x79bw","openshift-multus/network-metrics-daemon-fn8hw","kube-system/global-pull-secret-syncer-drhnf","openshift-cluster-node-tuning-operator/tuned-x7fgg","openshift-image-registry/node-ca-nqgm4","openshift-network-diagnostics/network-check-target-mqtjx","openshift-network-operator/iptables-alerter-pg6r9","openshift-ovn-kubernetes/ovnkube-node-pdjz5"] Jul 24 03:59:50.173488 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.173461 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.176192 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.176026 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:59:50.176322 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.176196 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pg6r9" Jul 24 03:59:50.176402 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.176381 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 03:59:50.176612 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.176591 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9lwdt\"" Jul 24 03:59:50.178330 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.178304 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.179213 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.179003 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:59:50.179213 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.179013 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 03:59:50.179617 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.179597 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 03:59:50.179957 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.179929 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h4hf7\"" Jul 24 03:59:50.180800 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.180777 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.180920 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.180850 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 03:59:50.180920 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.180892 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 03:59:50.180920 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.180911 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-95vw8\"" Jul 24 03:59:50.181724 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.181540 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 03:59:50.184801 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.184271 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 03:59:50.184801 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.184281 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 03:59:50.184801 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.184484 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 03:59:50.184801 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.184513 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 03:59:50.189106 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.188408 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.189106 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.188626 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 03:59:50.190698 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.189334 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ggnv8\"" Jul 24 03:59:50.190698 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.189692 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 03:59:50.190698 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.190401 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:50.190698 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.190468 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 03:59:50.191015 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.190843 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 03:59:50.192972 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.191097 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 03:59:50.192972 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.191828 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6l4kl\"" Jul 24 03:59:50.192972 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.192118 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 03:59:50.192972 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.192132 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 03:59:50.192972 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.192505 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 03:59:50.192972 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.192573 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 03:59:50.192972 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.192822 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:59:50.194205 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.194185 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.196831 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.196696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t8nc\" (UniqueName: \"kubernetes.io/projected/bd8ea02b-b79d-47c3-9775-95177f3e2284-kube-api-access-4t8nc\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.196831 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.196733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.196831 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.196761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8df531f2-fcc2-418d-8351-e752ca2da1dd-ovn-node-metrics-cert\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.196831 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.196786 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8df531f2-fcc2-418d-8351-e752ca2da1dd-ovnkube-script-lib\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.196831 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.196809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74107bd8-aa9c-4f18-9306-f9c41ec9f370-system-cni-dir\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.197127 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.196836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74107bd8-aa9c-4f18-9306-f9c41ec9f370-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.197127 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.196865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-hostroot\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.197127 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.196889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-sysctl-conf\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.197127 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.196929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74107bd8-aa9c-4f18-9306-f9c41ec9f370-os-release\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.197127 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.196955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd8ea02b-b79d-47c3-9775-95177f3e2284-tmp\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.197127 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197020 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-socket-dir\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.197127 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.197127 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74107bd8-aa9c-4f18-9306-f9c41ec9f370-cni-binary-copy\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.197514 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197139 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nqgm4" Jul 24 03:59:50.197514 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74107bd8-aa9c-4f18-9306-f9c41ec9f370-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.197514 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-registration-dir\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.197514 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197420 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 03:59:50.197637 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197533 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w9nkz\"" Jul 24 03:59:50.197709 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-cnibin\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.197746 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197724 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-var-lib-cni-multus\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.197779 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-sys\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.197813 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-tuned\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.197813 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-run-systemd\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.197895 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197831 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-cni-netd\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.197895 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-run-openvswitch\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.197956 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:50.197956 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-host\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.198069 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.197963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-sys-fs\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.198069 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-kubelet\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.198069 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm2w2\" (UniqueName: \"kubernetes.io/projected/c41550b2-0b17-4c09-a178-e0e2babfbb37-kube-api-access-pm2w2\") pod \"iptables-alerter-pg6r9\" (UID: \"c41550b2-0b17-4c09-a178-e0e2babfbb37\") " pod="openshift-network-operator/iptables-alerter-pg6r9" Jul 24 03:59:50.198231 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g6p8\" (UniqueName: \"kubernetes.io/projected/d6982ca3-8712-4aac-b885-aa150ce317c5-kube-api-access-7g6p8\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.198231 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-systemd\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.198231 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198122 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-run\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.198231 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-var-lib-kubelet\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.198231 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-var-lib-cni-bin\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.198473 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-etc-kubernetes\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.198473 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-etc-openvswitch\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.198473 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198279 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-run-ovn\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.198473 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-log-socket\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.198473 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.198473 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgkm7\" (UniqueName: \"kubernetes.io/projected/8df531f2-fcc2-418d-8351-e752ca2da1dd-kube-api-access-kgkm7\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.198473 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6n7j\" (UniqueName: \"kubernetes.io/projected/74107bd8-aa9c-4f18-9306-f9c41ec9f370-kube-api-access-v6n7j\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.198473 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6982ca3-8712-4aac-b885-aa150ce317c5-cni-binary-copy\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.198473 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-run-netns\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.198879 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198477 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-etc-selinux\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.198879 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-systemd-units\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.198879 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-node-log\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.198879 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198654 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8df531f2-fcc2-418d-8351-e752ca2da1dd-env-overrides\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.198879 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-multus-cni-dir\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.198879 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-multus-socket-dir-parent\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.198879 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-run-k8s-cni-cncf-io\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.198879 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-multus-conf-dir\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.198879 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-slash\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.198879 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-cni-bin\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.198879 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74107bd8-aa9c-4f18-9306-f9c41ec9f370-cnibin\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198881 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-run-multus-certs\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198915 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-sysctl-d\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-device-dir\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrccr\" (UniqueName: \"kubernetes.io/projected/719eff03-74c0-4125-a384-718303d979db-kube-api-access-vrccr\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.198989 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c41550b2-0b17-4c09-a178-e0e2babfbb37-host-slash\") pod \"iptables-alerter-pg6r9\" (UID: \"c41550b2-0b17-4c09-a178-e0e2babfbb37\") " pod="openshift-network-operator/iptables-alerter-pg6r9" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-var-lib-kubelet\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-sysconfig\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-kubernetes\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74107bd8-aa9c-4f18-9306-f9c41ec9f370-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-lib-modules\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-run-netns\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhssd\" (UniqueName: \"kubernetes.io/projected/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-kube-api-access-zhssd\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199300 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-os-release\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.199444 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199326 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8df531f2-fcc2-418d-8351-e752ca2da1dd-ovnkube-config\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.200133 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199355 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c41550b2-0b17-4c09-a178-e0e2babfbb37-iptables-alerter-script\") pod \"iptables-alerter-pg6r9\" (UID: \"c41550b2-0b17-4c09-a178-e0e2babfbb37\") " pod="openshift-network-operator/iptables-alerter-pg6r9" Jul 24 03:59:50.200133 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-var-lib-openvswitch\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.200133 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-system-cni-dir\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.200133 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6982ca3-8712-4aac-b885-aa150ce317c5-multus-daemon-config\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.200133 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-modprobe-d\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.200133 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199583 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bmtrd\"" Jul 24 03:59:50.200133 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.199802 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qt8ht" Jul 24 03:59:50.200133 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.200093 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 03:59:50.200133 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.200122 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 03:59:50.200610 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.200436 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 03:59:50.202107 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.202086 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 03:59:50.202607 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.202590 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zqfm4\"" Jul 24 03:59:50.202802 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.202786 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 03:59:50.203148 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.203125 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 03:59:50.203148 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.203139 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:50.203320 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.203204 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 03:59:50.205370 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.205354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 03:59:50.205518 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.205482 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 03:59:50.207887 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.207869 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vgwxn" Jul 24 03:59:50.210453 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.210430 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 03:59:50.210572 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.210538 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 03:59:50.210920 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.210894 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wnbbs\"" Jul 24 03:59:50.222356 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.222334 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-57ssz" Jul 24 03:59:50.230015 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.229952 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-57ssz" Jul 24 03:59:50.263560 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.263509 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" event={"ID":"2f7e8cdd0c9e683123e995ae57bab829","Type":"ContainerStarted","Data":"34a241757f8b5fc1454aed7d7394a0856aa6e67ade468ce4fb11810f6abb31e9"} Jul 24 03:59:50.265270 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.265239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" event={"ID":"a4818398c4598e46d283eeb2e2a1a7ab","Type":"ContainerStarted","Data":"88a508fe30e5727e8d172ab0258a63ee2d75be8a7d4d3dd2ad39b4ee22693527"} Jul 24 03:59:50.285114 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.285087 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 03:59:50.300172 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-var-lib-cni-multus\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.300349 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/938a2309-e416-46dc-bbda-a1a9c5f3beaf-konnectivity-ca\") pod \"konnectivity-agent-qt8ht\" (UID: \"938a2309-e416-46dc-bbda-a1a9c5f3beaf\") " pod="kube-system/konnectivity-agent-qt8ht" Jul 24 03:59:50.300349 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-sys\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.300349 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-tuned\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.300349 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-run-systemd\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.300349 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300289 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-var-lib-cni-multus\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.300349 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-cni-netd\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.300349 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300340 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68781720-31da-4036-97f5-d2bf5fcd0df0-dbus\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:50.300349 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300347 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-cni-netd\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-run-openvswitch\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300411 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-sys\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68781720-31da-4036-97f5-d2bf5fcd0df0-kubelet-config\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300459 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-run-openvswitch\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-host\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-sys-fs\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300507 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-host\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-kubelet\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300563 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-kubelet\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300600 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-run-systemd\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.300618 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300645 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-sys-fs\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300660 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 03:59:50.300758 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm2w2\" (UniqueName: \"kubernetes.io/projected/c41550b2-0b17-4c09-a178-e0e2babfbb37-kube-api-access-pm2w2\") pod \"iptables-alerter-pg6r9\" (UID: \"c41550b2-0b17-4c09-a178-e0e2babfbb37\") " pod="openshift-network-operator/iptables-alerter-pg6r9" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.300714 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs podName:cfdaa993-a5f2-486b-be35-f6d04e6eb8f2 nodeName:}" failed. No retries permitted until 2026-07-24 03:59:50.800675103 +0000 UTC m=+3.034374759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs") pod "network-metrics-daemon-fn8hw" (UID: "cfdaa993-a5f2-486b-be35-f6d04e6eb8f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g6p8\" (UniqueName: \"kubernetes.io/projected/d6982ca3-8712-4aac-b885-aa150ce317c5-kube-api-access-7g6p8\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300770 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b492c24-539e-4502-b99c-92ce1a38f866-serviceca\") pod \"node-ca-nqgm4\" (UID: \"3b492c24-539e-4502-b99c-92ce1a38f866\") " pod="openshift-image-registry/node-ca-nqgm4" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-systemd\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300816 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-run\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-var-lib-kubelet\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-var-lib-cni-bin\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-etc-kubernetes\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-etc-openvswitch\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-run-ovn\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-log-socket\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300977 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-systemd\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.300988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.301496 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgkm7\" (UniqueName: \"kubernetes.io/projected/8df531f2-fcc2-418d-8351-e752ca2da1dd-kube-api-access-kgkm7\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6n7j\" (UniqueName: \"kubernetes.io/projected/74107bd8-aa9c-4f18-9306-f9c41ec9f370-kube-api-access-v6n7j\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6982ca3-8712-4aac-b885-aa150ce317c5-cni-binary-copy\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-run-netns\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-etc-selinux\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-systemd-units\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-node-log\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8df531f2-fcc2-418d-8351-e752ca2da1dd-env-overrides\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-multus-cni-dir\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-multus-socket-dir-parent\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-run-k8s-cni-cncf-io\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-multus-conf-dir\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-slash\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-cni-bin\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74107bd8-aa9c-4f18-9306-f9c41ec9f370-cnibin\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.302241 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-run-multus-certs\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/938a2309-e416-46dc-bbda-a1a9c5f3beaf-agent-certs\") pod \"konnectivity-agent-qt8ht\" (UID: \"938a2309-e416-46dc-bbda-a1a9c5f3beaf\") " pod="kube-system/konnectivity-agent-qt8ht" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-sysctl-d\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-device-dir\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrccr\" (UniqueName: \"kubernetes.io/projected/719eff03-74c0-4125-a384-718303d979db-kube-api-access-vrccr\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c41550b2-0b17-4c09-a178-e0e2babfbb37-host-slash\") pod \"iptables-alerter-pg6r9\" (UID: \"c41550b2-0b17-4c09-a178-e0e2babfbb37\") " pod="openshift-network-operator/iptables-alerter-pg6r9" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-var-lib-kubelet\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxcrc\" (UniqueName: \"kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc\") pod \"network-check-target-mqtjx\" (UID: \"01a3813d-002f-4290-baea-b727e2272473\") " pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301644 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-run\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b492c24-539e-4502-b99c-92ce1a38f866-host\") pod \"node-ca-nqgm4\" (UID: \"3b492c24-539e-4502-b99c-92ce1a38f866\") " pod="openshift-image-registry/node-ca-nqgm4" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-sysconfig\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-kubernetes\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301708 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-var-lib-kubelet\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74107bd8-aa9c-4f18-9306-f9c41ec9f370-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.302847 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301752 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-var-lib-cni-bin\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsgmd\" (UniqueName: \"kubernetes.io/projected/3b492c24-539e-4502-b99c-92ce1a38f866-kube-api-access-qsgmd\") pod \"node-ca-nqgm4\" (UID: \"3b492c24-539e-4502-b99c-92ce1a38f866\") " pod="openshift-image-registry/node-ca-nqgm4" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-lib-modules\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301796 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-etc-kubernetes\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-run-netns\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhssd\" (UniqueName: \"kubernetes.io/projected/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-kube-api-access-zhssd\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301852 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-etc-openvswitch\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-os-release\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301905 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-run-ovn\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8df531f2-fcc2-418d-8351-e752ca2da1dd-ovnkube-config\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c41550b2-0b17-4c09-a178-e0e2babfbb37-iptables-alerter-script\") pod \"iptables-alerter-pg6r9\" (UID: \"c41550b2-0b17-4c09-a178-e0e2babfbb37\") " pod="openshift-network-operator/iptables-alerter-pg6r9" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301948 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-log-socket\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301971 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znjwz\" (UniqueName: \"kubernetes.io/projected/4c051de6-a3da-40e6-b9d6-577438554204-kube-api-access-znjwz\") pod \"node-resolver-vgwxn\" (UID: \"4c051de6-a3da-40e6-b9d6-577438554204\") " pod="openshift-dns/node-resolver-vgwxn" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301990 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.303452 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.301999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-var-lib-openvswitch\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-system-cni-dir\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6982ca3-8712-4aac-b885-aa150ce317c5-multus-daemon-config\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-modprobe-d\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t8nc\" (UniqueName: \"kubernetes.io/projected/bd8ea02b-b79d-47c3-9775-95177f3e2284-kube-api-access-4t8nc\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8df531f2-fcc2-418d-8351-e752ca2da1dd-ovn-node-metrics-cert\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8df531f2-fcc2-418d-8351-e752ca2da1dd-ovnkube-script-lib\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302255 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74107bd8-aa9c-4f18-9306-f9c41ec9f370-system-cni-dir\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302260 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-var-lib-kubelet\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74107bd8-aa9c-4f18-9306-f9c41ec9f370-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-hostroot\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-sysctl-conf\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74107bd8-aa9c-4f18-9306-f9c41ec9f370-os-release\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.303914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c051de6-a3da-40e6-b9d6-577438554204-hosts-file\") pod \"node-resolver-vgwxn\" (UID: \"4c051de6-a3da-40e6-b9d6-577438554204\") " pod="openshift-dns/node-resolver-vgwxn" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c051de6-a3da-40e6-b9d6-577438554204-tmp-dir\") pod \"node-resolver-vgwxn\" (UID: \"4c051de6-a3da-40e6-b9d6-577438554204\") " pod="openshift-dns/node-resolver-vgwxn" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd8ea02b-b79d-47c3-9775-95177f3e2284-tmp\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-socket-dir\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74107bd8-aa9c-4f18-9306-f9c41ec9f370-cni-binary-copy\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74107bd8-aa9c-4f18-9306-f9c41ec9f370-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-registration-dir\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-cnibin\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302833 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-cnibin\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302843 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6982ca3-8712-4aac-b885-aa150ce317c5-cni-binary-copy\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302920 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-sysconfig\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302925 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-run-netns\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.304588 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.302971 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-kubernetes\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303018 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-etc-selinux\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303084 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-systemd-units\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303129 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74107bd8-aa9c-4f18-9306-f9c41ec9f370-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303132 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-node-log\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303255 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-multus-cni-dir\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303256 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-lib-modules\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-run-netns\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303318 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-multus-socket-dir-parent\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303364 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-run-k8s-cni-cncf-io\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303405 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-multus-conf-dir\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303446 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-slash\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303489 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-cni-bin\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303533 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74107bd8-aa9c-4f18-9306-f9c41ec9f370-cnibin\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-os-release\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.305347 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303575 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-host-run-multus-certs\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-sysctl-d\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303735 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-device-dir\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.303970 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c41550b2-0b17-4c09-a178-e0e2babfbb37-host-slash\") pod \"iptables-alerter-pg6r9\" (UID: \"c41550b2-0b17-4c09-a178-e0e2babfbb37\") " pod="openshift-network-operator/iptables-alerter-pg6r9" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.304183 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8df531f2-fcc2-418d-8351-e752ca2da1dd-ovnkube-config\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.304353 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8df531f2-fcc2-418d-8351-e752ca2da1dd-env-overrides\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.304429 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-var-lib-openvswitch\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.304487 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-system-cni-dir\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.304687 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c41550b2-0b17-4c09-a178-e0e2babfbb37-iptables-alerter-script\") pod \"iptables-alerter-pg6r9\" (UID: \"c41550b2-0b17-4c09-a178-e0e2babfbb37\") " pod="openshift-network-operator/iptables-alerter-pg6r9" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.304746 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6982ca3-8712-4aac-b885-aa150ce317c5-hostroot\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.304878 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-sysctl-conf\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.304942 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6982ca3-8712-4aac-b885-aa150ce317c5-multus-daemon-config\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.305077 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-socket-dir\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.305077 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-modprobe-d\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.305320 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.306088 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.305473 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/719eff03-74c0-4125-a384-718303d979db-registration-dir\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.306851 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.305595 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74107bd8-aa9c-4f18-9306-f9c41ec9f370-cni-binary-copy\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.306851 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.305835 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd8ea02b-b79d-47c3-9775-95177f3e2284-etc-tuned\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.306851 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.304944 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74107bd8-aa9c-4f18-9306-f9c41ec9f370-os-release\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.306851 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.305941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74107bd8-aa9c-4f18-9306-f9c41ec9f370-system-cni-dir\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.306851 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.305988 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8df531f2-fcc2-418d-8351-e752ca2da1dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.306851 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.305985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74107bd8-aa9c-4f18-9306-f9c41ec9f370-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.306851 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.306375 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74107bd8-aa9c-4f18-9306-f9c41ec9f370-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.306851 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.306414 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8df531f2-fcc2-418d-8351-e752ca2da1dd-ovnkube-script-lib\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.308307 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.308251 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd8ea02b-b79d-47c3-9775-95177f3e2284-tmp\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.309454 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.309428 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8df531f2-fcc2-418d-8351-e752ca2da1dd-ovn-node-metrics-cert\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.310972 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.310912 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm2w2\" (UniqueName: \"kubernetes.io/projected/c41550b2-0b17-4c09-a178-e0e2babfbb37-kube-api-access-pm2w2\") pod \"iptables-alerter-pg6r9\" (UID: \"c41550b2-0b17-4c09-a178-e0e2babfbb37\") " pod="openshift-network-operator/iptables-alerter-pg6r9" Jul 24 03:59:50.312032 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.312010 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6n7j\" (UniqueName: \"kubernetes.io/projected/74107bd8-aa9c-4f18-9306-f9c41ec9f370-kube-api-access-v6n7j\") pod \"multus-additional-cni-plugins-2slfs\" (UID: \"74107bd8-aa9c-4f18-9306-f9c41ec9f370\") " pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.312526 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.312488 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g6p8\" (UniqueName: \"kubernetes.io/projected/d6982ca3-8712-4aac-b885-aa150ce317c5-kube-api-access-7g6p8\") pod \"multus-x79bw\" (UID: \"d6982ca3-8712-4aac-b885-aa150ce317c5\") " pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.314108 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.314087 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgkm7\" (UniqueName: \"kubernetes.io/projected/8df531f2-fcc2-418d-8351-e752ca2da1dd-kube-api-access-kgkm7\") pod \"ovnkube-node-pdjz5\" (UID: \"8df531f2-fcc2-418d-8351-e752ca2da1dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.314324 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.314238 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhssd\" (UniqueName: \"kubernetes.io/projected/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-kube-api-access-zhssd\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:50.316562 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.316520 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrccr\" (UniqueName: \"kubernetes.io/projected/719eff03-74c0-4125-a384-718303d979db-kube-api-access-vrccr\") pod \"aws-ebs-csi-driver-node-hr45h\" (UID: \"719eff03-74c0-4125-a384-718303d979db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.318197 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.318156 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t8nc\" (UniqueName: \"kubernetes.io/projected/bd8ea02b-b79d-47c3-9775-95177f3e2284-kube-api-access-4t8nc\") pod \"tuned-x7fgg\" (UID: \"bd8ea02b-b79d-47c3-9775-95177f3e2284\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.404110 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:50.404291 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c051de6-a3da-40e6-b9d6-577438554204-hosts-file\") pod \"node-resolver-vgwxn\" (UID: \"4c051de6-a3da-40e6-b9d6-577438554204\") " pod="openshift-dns/node-resolver-vgwxn" Jul 24 03:59:50.404291 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c051de6-a3da-40e6-b9d6-577438554204-tmp-dir\") pod \"node-resolver-vgwxn\" (UID: \"4c051de6-a3da-40e6-b9d6-577438554204\") " pod="openshift-dns/node-resolver-vgwxn" Jul 24 03:59:50.404291 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404247 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c051de6-a3da-40e6-b9d6-577438554204-hosts-file\") pod \"node-resolver-vgwxn\" (UID: \"4c051de6-a3da-40e6-b9d6-577438554204\") " pod="openshift-dns/node-resolver-vgwxn" Jul 24 03:59:50.404291 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.404283 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:59:50.404527 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/938a2309-e416-46dc-bbda-a1a9c5f3beaf-konnectivity-ca\") pod \"konnectivity-agent-qt8ht\" (UID: \"938a2309-e416-46dc-bbda-a1a9c5f3beaf\") " pod="kube-system/konnectivity-agent-qt8ht" Jul 24 03:59:50.404527 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68781720-31da-4036-97f5-d2bf5fcd0df0-dbus\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:50.404527 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.404411 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret podName:68781720-31da-4036-97f5-d2bf5fcd0df0 nodeName:}" failed. No retries permitted until 2026-07-24 03:59:50.90438774 +0000 UTC m=+3.138087407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret") pod "global-pull-secret-syncer-drhnf" (UID: "68781720-31da-4036-97f5-d2bf5fcd0df0") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:59:50.404527 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68781720-31da-4036-97f5-d2bf5fcd0df0-kubelet-config\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:50.404527 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b492c24-539e-4502-b99c-92ce1a38f866-serviceca\") pod \"node-ca-nqgm4\" (UID: \"3b492c24-539e-4502-b99c-92ce1a38f866\") " pod="openshift-image-registry/node-ca-nqgm4" Jul 24 03:59:50.404527 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c051de6-a3da-40e6-b9d6-577438554204-tmp-dir\") pod \"node-resolver-vgwxn\" (UID: \"4c051de6-a3da-40e6-b9d6-577438554204\") " pod="openshift-dns/node-resolver-vgwxn" Jul 24 03:59:50.404527 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404505 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68781720-31da-4036-97f5-d2bf5fcd0df0-dbus\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:50.404893 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404540 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/938a2309-e416-46dc-bbda-a1a9c5f3beaf-agent-certs\") pod \"konnectivity-agent-qt8ht\" (UID: \"938a2309-e416-46dc-bbda-a1a9c5f3beaf\") " pod="kube-system/konnectivity-agent-qt8ht" Jul 24 03:59:50.404893 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxcrc\" (UniqueName: \"kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc\") pod \"network-check-target-mqtjx\" (UID: \"01a3813d-002f-4290-baea-b727e2272473\") " pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 03:59:50.404893 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404590 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68781720-31da-4036-97f5-d2bf5fcd0df0-kubelet-config\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:50.404893 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404596 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b492c24-539e-4502-b99c-92ce1a38f866-host\") pod \"node-ca-nqgm4\" (UID: \"3b492c24-539e-4502-b99c-92ce1a38f866\") " pod="openshift-image-registry/node-ca-nqgm4" Jul 24 03:59:50.404893 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsgmd\" (UniqueName: \"kubernetes.io/projected/3b492c24-539e-4502-b99c-92ce1a38f866-kube-api-access-qsgmd\") pod \"node-ca-nqgm4\" (UID: \"3b492c24-539e-4502-b99c-92ce1a38f866\") " pod="openshift-image-registry/node-ca-nqgm4" Jul 24 03:59:50.404893 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znjwz\" (UniqueName: \"kubernetes.io/projected/4c051de6-a3da-40e6-b9d6-577438554204-kube-api-access-znjwz\") pod \"node-resolver-vgwxn\" (UID: \"4c051de6-a3da-40e6-b9d6-577438554204\") " pod="openshift-dns/node-resolver-vgwxn" Jul 24 03:59:50.404893 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.404801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b492c24-539e-4502-b99c-92ce1a38f866-host\") pod \"node-ca-nqgm4\" (UID: \"3b492c24-539e-4502-b99c-92ce1a38f866\") " pod="openshift-image-registry/node-ca-nqgm4" Jul 24 03:59:50.405225 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.405125 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/938a2309-e416-46dc-bbda-a1a9c5f3beaf-konnectivity-ca\") pod \"konnectivity-agent-qt8ht\" (UID: \"938a2309-e416-46dc-bbda-a1a9c5f3beaf\") " pod="kube-system/konnectivity-agent-qt8ht" Jul 24 03:59:50.405458 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.405435 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b492c24-539e-4502-b99c-92ce1a38f866-serviceca\") pod \"node-ca-nqgm4\" (UID: \"3b492c24-539e-4502-b99c-92ce1a38f866\") " pod="openshift-image-registry/node-ca-nqgm4" Jul 24 03:59:50.408026 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.407995 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/938a2309-e416-46dc-bbda-a1a9c5f3beaf-agent-certs\") pod \"konnectivity-agent-qt8ht\" (UID: \"938a2309-e416-46dc-bbda-a1a9c5f3beaf\") " pod="kube-system/konnectivity-agent-qt8ht" Jul 24 03:59:50.414694 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.414631 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:59:50.414694 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.414654 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:59:50.414694 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.414664 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fxcrc for pod openshift-network-diagnostics/network-check-target-mqtjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:59:50.414946 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.414734 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc podName:01a3813d-002f-4290-baea-b727e2272473 nodeName:}" failed. No retries permitted until 2026-07-24 03:59:50.914714236 +0000 UTC m=+3.148413888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fxcrc" (UniqueName: "kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc") pod "network-check-target-mqtjx" (UID: "01a3813d-002f-4290-baea-b727e2272473") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:59:50.420464 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.420437 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsgmd\" (UniqueName: \"kubernetes.io/projected/3b492c24-539e-4502-b99c-92ce1a38f866-kube-api-access-qsgmd\") pod \"node-ca-nqgm4\" (UID: \"3b492c24-539e-4502-b99c-92ce1a38f866\") " pod="openshift-image-registry/node-ca-nqgm4" Jul 24 03:59:50.421601 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.421426 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znjwz\" (UniqueName: \"kubernetes.io/projected/4c051de6-a3da-40e6-b9d6-577438554204-kube-api-access-znjwz\") pod \"node-resolver-vgwxn\" (UID: \"4c051de6-a3da-40e6-b9d6-577438554204\") " pod="openshift-dns/node-resolver-vgwxn" Jul 24 03:59:50.491605 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.491562 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" Jul 24 03:59:50.503651 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:50.503416 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8ea02b_b79d_47c3_9775_95177f3e2284.slice/crio-607553d67bcbfbec3217e34d8e8e4c0811f38241fa392720f3dceb7d362c0cb8 WatchSource:0}: Error finding container 607553d67bcbfbec3217e34d8e8e4c0811f38241fa392720f3dceb7d362c0cb8: Status 404 returned error can't find the container with id 607553d67bcbfbec3217e34d8e8e4c0811f38241fa392720f3dceb7d362c0cb8 Jul 24 03:59:50.503651 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.503506 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pg6r9" Jul 24 03:59:50.514732 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.514704 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" Jul 24 03:59:50.515146 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:50.515117 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc41550b2_0b17_4c09_a178_e0e2babfbb37.slice/crio-1cd5bf7ed6a5b7ef5d75b585efbae9fb3019c436b8b1721527580765d65fc7fc WatchSource:0}: Error finding container 1cd5bf7ed6a5b7ef5d75b585efbae9fb3019c436b8b1721527580765d65fc7fc: Status 404 returned error can't find the container with id 1cd5bf7ed6a5b7ef5d75b585efbae9fb3019c436b8b1721527580765d65fc7fc Jul 24 03:59:50.520593 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.520570 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 03:59:50.525203 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:50.525168 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719eff03_74c0_4125_a384_718303d979db.slice/crio-c1bf82114cbf4be6d25ca5ae06b4857e5c659b538058a88d499288a01fbd1856 WatchSource:0}: Error finding container c1bf82114cbf4be6d25ca5ae06b4857e5c659b538058a88d499288a01fbd1856: Status 404 returned error can't find the container with id c1bf82114cbf4be6d25ca5ae06b4857e5c659b538058a88d499288a01fbd1856 Jul 24 03:59:50.529510 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.529326 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2slfs" Jul 24 03:59:50.534139 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:50.534100 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df531f2_fcc2_418d_8351_e752ca2da1dd.slice/crio-561193cea5698a5a67537232f3a7aa13e88a006d641801178d466a4bb33b9db5 WatchSource:0}: Error finding container 561193cea5698a5a67537232f3a7aa13e88a006d641801178d466a4bb33b9db5: Status 404 returned error can't find the container with id 561193cea5698a5a67537232f3a7aa13e88a006d641801178d466a4bb33b9db5 Jul 24 03:59:50.538158 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.538126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x79bw" Jul 24 03:59:50.541193 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:50.541166 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74107bd8_aa9c_4f18_9306_f9c41ec9f370.slice/crio-53a06ce1d8f0b0e70061051ac2d321864ad48e16df1d75c1f7d2e54d0b15b994 WatchSource:0}: Error finding container 53a06ce1d8f0b0e70061051ac2d321864ad48e16df1d75c1f7d2e54d0b15b994: Status 404 returned error can't find the container with id 53a06ce1d8f0b0e70061051ac2d321864ad48e16df1d75c1f7d2e54d0b15b994 Jul 24 03:59:50.548508 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.548483 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nqgm4" Jul 24 03:59:50.551209 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:50.551183 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6982ca3_8712_4aac_b885_aa150ce317c5.slice/crio-2e10050c693d7c96800122234d6beff3dd1b4ec24b6c6dbf9bbaae862ba74394 WatchSource:0}: Error finding container 2e10050c693d7c96800122234d6beff3dd1b4ec24b6c6dbf9bbaae862ba74394: Status 404 returned error can't find the container with id 2e10050c693d7c96800122234d6beff3dd1b4ec24b6c6dbf9bbaae862ba74394 Jul 24 03:59:50.557543 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.557515 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qt8ht" Jul 24 03:59:50.560535 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:50.560511 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b492c24_539e_4502_b99c_92ce1a38f866.slice/crio-7c628ed8c9d896f3717008162943cbb5eceb9b36107b3bfb9539ee4283cea58b WatchSource:0}: Error finding container 7c628ed8c9d896f3717008162943cbb5eceb9b36107b3bfb9539ee4283cea58b: Status 404 returned error can't find the container with id 7c628ed8c9d896f3717008162943cbb5eceb9b36107b3bfb9539ee4283cea58b Jul 24 03:59:50.565339 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.565317 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vgwxn" Jul 24 03:59:50.568284 ip-10-0-129-87 kubenswrapper[2578]: W0724 03:59:50.568256 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod938a2309_e416_46dc_bbda_a1a9c5f3beaf.slice/crio-506ef900c21c4a9fc607c92dc420e9ae08099d790916b0b4f93c774d841d5046 WatchSource:0}: Error finding container 506ef900c21c4a9fc607c92dc420e9ae08099d790916b0b4f93c774d841d5046: Status 404 returned error can't find the container with id 506ef900c21c4a9fc607c92dc420e9ae08099d790916b0b4f93c774d841d5046 Jul 24 03:59:50.807495 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.807408 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:50.807652 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.807599 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:59:50.807708 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.807681 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs podName:cfdaa993-a5f2-486b-be35-f6d04e6eb8f2 nodeName:}" failed. No retries permitted until 2026-07-24 03:59:51.807657231 +0000 UTC m=+4.041356886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs") pod "network-metrics-daemon-fn8hw" (UID: "cfdaa993-a5f2-486b-be35-f6d04e6eb8f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:59:50.908208 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:50.908169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:50.908404 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.908355 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:59:50.908466 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:50.908443 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret podName:68781720-31da-4036-97f5-d2bf5fcd0df0 nodeName:}" failed. No retries permitted until 2026-07-24 03:59:51.908417288 +0000 UTC m=+4.142116947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret") pod "global-pull-secret-syncer-drhnf" (UID: "68781720-31da-4036-97f5-d2bf5fcd0df0") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:59:51.011830 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.009243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxcrc\" (UniqueName: \"kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc\") pod \"network-check-target-mqtjx\" (UID: \"01a3813d-002f-4290-baea-b727e2272473\") " pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 03:59:51.012034 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:51.011880 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:59:51.012034 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:51.011915 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:59:51.012034 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:51.011935 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fxcrc for pod openshift-network-diagnostics/network-check-target-mqtjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:59:51.012360 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:51.012299 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc podName:01a3813d-002f-4290-baea-b727e2272473 nodeName:}" failed. No retries permitted until 2026-07-24 03:59:52.012264839 +0000 UTC m=+4.245964501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxcrc" (UniqueName: "kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc") pod "network-check-target-mqtjx" (UID: "01a3813d-002f-4290-baea-b727e2272473") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:59:51.182091 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.181994 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:59:51.233982 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.233912 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 03:54:50 +0000 UTC" deadline="2028-01-21 18:00:16.751299613 +0000 UTC" Jul 24 03:59:51.233982 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.233986 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13118h0m25.517332792s" Jul 24 03:59:51.255342 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.255305 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 03:59:51.255530 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:51.255443 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 03:59:51.268406 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.268366 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" event={"ID":"bd8ea02b-b79d-47c3-9775-95177f3e2284","Type":"ContainerStarted","Data":"607553d67bcbfbec3217e34d8e8e4c0811f38241fa392720f3dceb7d362c0cb8"} Jul 24 03:59:51.269638 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.269610 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qt8ht" event={"ID":"938a2309-e416-46dc-bbda-a1a9c5f3beaf","Type":"ContainerStarted","Data":"506ef900c21c4a9fc607c92dc420e9ae08099d790916b0b4f93c774d841d5046"} Jul 24 03:59:51.271010 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.270967 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" event={"ID":"8df531f2-fcc2-418d-8351-e752ca2da1dd","Type":"ContainerStarted","Data":"561193cea5698a5a67537232f3a7aa13e88a006d641801178d466a4bb33b9db5"} Jul 24 03:59:51.272143 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.272122 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" event={"ID":"719eff03-74c0-4125-a384-718303d979db","Type":"ContainerStarted","Data":"c1bf82114cbf4be6d25ca5ae06b4857e5c659b538058a88d499288a01fbd1856"} Jul 24 03:59:51.273253 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.273226 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pg6r9" event={"ID":"c41550b2-0b17-4c09-a178-e0e2babfbb37","Type":"ContainerStarted","Data":"1cd5bf7ed6a5b7ef5d75b585efbae9fb3019c436b8b1721527580765d65fc7fc"} Jul 24 03:59:51.274378 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.274345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nqgm4" event={"ID":"3b492c24-539e-4502-b99c-92ce1a38f866","Type":"ContainerStarted","Data":"7c628ed8c9d896f3717008162943cbb5eceb9b36107b3bfb9539ee4283cea58b"} Jul 24 03:59:51.275356 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.275331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x79bw" event={"ID":"d6982ca3-8712-4aac-b885-aa150ce317c5","Type":"ContainerStarted","Data":"2e10050c693d7c96800122234d6beff3dd1b4ec24b6c6dbf9bbaae862ba74394"} Jul 24 03:59:51.276362 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.276332 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2slfs" event={"ID":"74107bd8-aa9c-4f18-9306-f9c41ec9f370","Type":"ContainerStarted","Data":"53a06ce1d8f0b0e70061051ac2d321864ad48e16df1d75c1f7d2e54d0b15b994"} Jul 24 03:59:51.816712 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.816669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:51.816926 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:51.816901 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:59:51.816996 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:51.816976 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs podName:cfdaa993-a5f2-486b-be35-f6d04e6eb8f2 nodeName:}" failed. No retries permitted until 2026-07-24 03:59:53.816955773 +0000 UTC m=+6.050655431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs") pod "network-metrics-daemon-fn8hw" (UID: "cfdaa993-a5f2-486b-be35-f6d04e6eb8f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:59:51.917948 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:51.917904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:51.918172 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:51.918136 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:59:51.918261 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:51.918207 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret podName:68781720-31da-4036-97f5-d2bf5fcd0df0 nodeName:}" failed. No retries permitted until 2026-07-24 03:59:53.9181862 +0000 UTC m=+6.151885857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret") pod "global-pull-secret-syncer-drhnf" (UID: "68781720-31da-4036-97f5-d2bf5fcd0df0") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:59:52.019215 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:52.019182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxcrc\" (UniqueName: \"kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc\") pod \"network-check-target-mqtjx\" (UID: \"01a3813d-002f-4290-baea-b727e2272473\") " pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 03:59:52.019488 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:52.019355 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:59:52.019488 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:52.019385 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:59:52.019488 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:52.019400 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fxcrc for pod openshift-network-diagnostics/network-check-target-mqtjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:59:52.019488 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:52.019460 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc podName:01a3813d-002f-4290-baea-b727e2272473 nodeName:}" failed. No retries permitted until 2026-07-24 03:59:54.019434487 +0000 UTC m=+6.253134153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxcrc" (UniqueName: "kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc") pod "network-check-target-mqtjx" (UID: "01a3813d-002f-4290-baea-b727e2272473") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:59:52.234626 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:52.234299 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 03:54:50 +0000 UTC" deadline="2028-04-20 21:14:02.294285734 +0000 UTC" Jul 24 03:59:52.234626 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:52.234589 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15281h14m10.059702819s" Jul 24 03:59:52.257833 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:52.257314 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:52.257833 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:52.257336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:52.257833 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:52.257465 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 03:59:52.257833 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:52.257566 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 03:59:52.286006 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:52.285929 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vgwxn" event={"ID":"4c051de6-a3da-40e6-b9d6-577438554204","Type":"ContainerStarted","Data":"ceff0458e17f57b3e0b9535173682cf657c823bcdaabf061b0d36708ae1e8756"} Jul 24 03:59:52.295844 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:52.294854 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" event={"ID":"a4818398c4598e46d283eeb2e2a1a7ab","Type":"ContainerStarted","Data":"bcad727bba0240f5cfcce9aac574b99cfeae5fe422604421832d29b1dd3a3bf4"} Jul 24 03:59:52.313810 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:52.312607 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-87.ec2.internal" podStartSLOduration=2.312584381 podStartE2EDuration="2.312584381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:59:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:59:52.312298707 +0000 UTC m=+4.545998385" watchObservedRunningTime="2026-07-24 03:59:52.312584381 +0000 UTC m=+4.546284059" Jul 24 03:59:53.255564 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:53.255218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 03:59:53.255564 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:53.255364 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 03:59:53.314712 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:53.314668 2578 generic.go:356] "Generic (PLEG): container finished" podID="2f7e8cdd0c9e683123e995ae57bab829" containerID="b8f1f6011f0f3c2e5c3f378ae1eaed7cfa3cc35fe04c45bd13dd487be171fb18" exitCode=0 Jul 24 03:59:53.314929 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:53.314898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" event={"ID":"2f7e8cdd0c9e683123e995ae57bab829","Type":"ContainerDied","Data":"b8f1f6011f0f3c2e5c3f378ae1eaed7cfa3cc35fe04c45bd13dd487be171fb18"} Jul 24 03:59:53.839914 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:53.839252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:53.839914 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:53.839457 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:59:53.839914 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:53.839526 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs podName:cfdaa993-a5f2-486b-be35-f6d04e6eb8f2 nodeName:}" failed. No retries permitted until 2026-07-24 03:59:57.839506466 +0000 UTC m=+10.073206119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs") pod "network-metrics-daemon-fn8hw" (UID: "cfdaa993-a5f2-486b-be35-f6d04e6eb8f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:59:53.940116 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:53.940072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:53.940306 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:53.940254 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:59:53.940368 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:53.940321 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret podName:68781720-31da-4036-97f5-d2bf5fcd0df0 nodeName:}" failed. No retries permitted until 2026-07-24 03:59:57.940302552 +0000 UTC m=+10.174002206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret") pod "global-pull-secret-syncer-drhnf" (UID: "68781720-31da-4036-97f5-d2bf5fcd0df0") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:59:54.041228 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:54.041186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxcrc\" (UniqueName: \"kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc\") pod \"network-check-target-mqtjx\" (UID: \"01a3813d-002f-4290-baea-b727e2272473\") " pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 03:59:54.041434 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:54.041417 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:59:54.041524 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:54.041441 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:59:54.041524 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:54.041455 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fxcrc for pod openshift-network-diagnostics/network-check-target-mqtjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:59:54.041524 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:54.041513 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc podName:01a3813d-002f-4290-baea-b727e2272473 nodeName:}" failed. No retries permitted until 2026-07-24 03:59:58.041495107 +0000 UTC m=+10.275194781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxcrc" (UniqueName: "kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc") pod "network-check-target-mqtjx" (UID: "01a3813d-002f-4290-baea-b727e2272473") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:59:54.255338 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:54.255244 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:54.255522 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:54.255399 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 03:59:54.258063 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:54.258036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:54.258473 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:54.258162 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 03:59:55.254611 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:55.254469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 03:59:55.254611 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:55.254604 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 03:59:56.255944 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:56.255547 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:56.255944 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:56.255545 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:56.255944 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:56.255666 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 03:59:56.255944 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:56.255759 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 03:59:57.255424 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:57.255376 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 03:59:57.255607 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:57.255554 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 03:59:57.873229 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:57.873184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:57.873699 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:57.873358 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:59:57.873699 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:57.873428 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs podName:cfdaa993-a5f2-486b-be35-f6d04e6eb8f2 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:05.87340785 +0000 UTC m=+18.107107503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs") pod "network-metrics-daemon-fn8hw" (UID: "cfdaa993-a5f2-486b-be35-f6d04e6eb8f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:59:57.974397 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:57.974354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:57.974585 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:57.974551 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:59:57.974648 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:57.974621 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret podName:68781720-31da-4036-97f5-d2bf5fcd0df0 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:05.974601967 +0000 UTC m=+18.208301621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret") pod "global-pull-secret-syncer-drhnf" (UID: "68781720-31da-4036-97f5-d2bf5fcd0df0") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:59:58.075381 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:58.075342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxcrc\" (UniqueName: \"kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc\") pod \"network-check-target-mqtjx\" (UID: \"01a3813d-002f-4290-baea-b727e2272473\") " pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 03:59:58.075544 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:58.075493 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:59:58.075544 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:58.075511 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:59:58.075544 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:58.075520 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fxcrc for pod openshift-network-diagnostics/network-check-target-mqtjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:59:58.075674 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:58.075578 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc podName:01a3813d-002f-4290-baea-b727e2272473 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:06.075563507 +0000 UTC m=+18.309263158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxcrc" (UniqueName: "kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc") pod "network-check-target-mqtjx" (UID: "01a3813d-002f-4290-baea-b727e2272473") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:59:58.256524 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:58.256120 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 03:59:58.256524 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:58.256187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 03:59:58.256524 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:58.256292 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 03:59:58.256524 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:58.256448 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 03:59:59.254789 ip-10-0-129-87 kubenswrapper[2578]: I0724 03:59:59.254703 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 03:59:59.255285 ip-10-0-129-87 kubenswrapper[2578]: E0724 03:59:59.254847 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:00.254820 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:00.254782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:00.255297 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:00.254782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:00.255297 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:00.254994 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:00.255297 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:00.255002 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:01.255162 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:01.255123 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:01.255629 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:01.255260 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:02.255154 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:02.255116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:02.255338 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:02.255258 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:02.255338 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:02.255316 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:02.255806 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:02.255465 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:03.254896 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:03.254861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:03.255078 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:03.254997 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:04.255437 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:04.255394 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:04.255886 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:04.255553 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:04.255886 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:04.255577 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:04.255886 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:04.255691 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:05.255441 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:05.255401 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:05.256054 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:05.255545 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:05.937700 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:05.937662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:05.937883 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:05.937785 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:05.937883 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:05.937865 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs podName:cfdaa993-a5f2-486b-be35-f6d04e6eb8f2 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:21.937846929 +0000 UTC m=+34.171546581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs") pod "network-metrics-daemon-fn8hw" (UID: "cfdaa993-a5f2-486b-be35-f6d04e6eb8f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:06.038974 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:06.038936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:06.039162 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:06.039098 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:06.039214 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:06.039172 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret podName:68781720-31da-4036-97f5-d2bf5fcd0df0 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:22.039157305 +0000 UTC m=+34.272856955 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret") pod "global-pull-secret-syncer-drhnf" (UID: "68781720-31da-4036-97f5-d2bf5fcd0df0") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:06.140384 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:06.140343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxcrc\" (UniqueName: \"kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc\") pod \"network-check-target-mqtjx\" (UID: \"01a3813d-002f-4290-baea-b727e2272473\") " pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:06.140564 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:06.140496 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:06.140564 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:06.140517 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:06.140564 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:06.140538 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fxcrc for pod openshift-network-diagnostics/network-check-target-mqtjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:06.140729 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:06.140602 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc podName:01a3813d-002f-4290-baea-b727e2272473 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:22.140580721 +0000 UTC m=+34.374280385 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxcrc" (UniqueName: "kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc") pod "network-check-target-mqtjx" (UID: "01a3813d-002f-4290-baea-b727e2272473") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:06.255245 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:06.255146 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:06.255245 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:06.255194 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:06.255463 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:06.255290 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:06.255463 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:06.255420 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:07.254882 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:07.254844 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:07.255074 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:07.254998 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:08.255790 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:08.255754 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:08.256236 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:08.255879 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:08.256236 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:08.255933 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:08.256236 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:08.256078 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:09.255131 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:09.255096 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:09.255287 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:09.255198 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:10.254930 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.254610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:10.255506 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.254646 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:10.255506 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:10.255058 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:10.255506 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:10.255164 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:10.348900 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.348873 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" event={"ID":"2f7e8cdd0c9e683123e995ae57bab829","Type":"ContainerStarted","Data":"d3c1cf54e97a4ff9f730af0c2655cd47042764297567199f265a9eec5e05cc72"} Jul 24 04:00:10.350283 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.350263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nqgm4" event={"ID":"3b492c24-539e-4502-b99c-92ce1a38f866","Type":"ContainerStarted","Data":"c60340ec947c892ee1e50015d0a23b90a7b744e6702d12ebdcead4ec4858b8a9"} Jul 24 04:00:10.351569 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.351549 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x79bw" event={"ID":"d6982ca3-8712-4aac-b885-aa150ce317c5","Type":"ContainerStarted","Data":"76903a0141eed0dbab53f3f0719b58a1b75a5fd2268078f2cd28836932310b21"} Jul 24 04:00:10.352909 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.352890 2578 generic.go:356] "Generic (PLEG): container finished" podID="74107bd8-aa9c-4f18-9306-f9c41ec9f370" containerID="345e45af8fd41c1d0b20255f22a21fda5fa230c143a5a9923245ae3a7d2b5f92" exitCode=0 Jul 24 04:00:10.352999 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.352946 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2slfs" event={"ID":"74107bd8-aa9c-4f18-9306-f9c41ec9f370","Type":"ContainerDied","Data":"345e45af8fd41c1d0b20255f22a21fda5fa230c143a5a9923245ae3a7d2b5f92"} Jul 24 04:00:10.354483 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.354444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" event={"ID":"bd8ea02b-b79d-47c3-9775-95177f3e2284","Type":"ContainerStarted","Data":"a9f83731adf8f10a19e455ce1cc94eae994649aa764e43a4f7ca4df0a807758d"} Jul 24 04:00:10.355744 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.355721 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vgwxn" event={"ID":"4c051de6-a3da-40e6-b9d6-577438554204","Type":"ContainerStarted","Data":"e9ef45a7b9a1453aa99cc01c5d9c3e27635bb139a88be6ef5e8656cab4781944"} Jul 24 04:00:10.357040 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.357018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qt8ht" event={"ID":"938a2309-e416-46dc-bbda-a1a9c5f3beaf","Type":"ContainerStarted","Data":"4febe9c6b82db46e73f25077e56ddb79469100ff03a0d3c8e336d89a0ea5e309"} Jul 24 04:00:10.359678 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.359660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" event={"ID":"8df531f2-fcc2-418d-8351-e752ca2da1dd","Type":"ContainerStarted","Data":"a022adef9de0b9729799621516a7fdbdefe6dd23c5b4a8a940edb8e89a040a5f"} Jul 24 04:00:10.359758 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.359716 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" event={"ID":"8df531f2-fcc2-418d-8351-e752ca2da1dd","Type":"ContainerStarted","Data":"c3fc2c77b5386718eabae56e905f6dec6720de868075258ef445d6c8a330c2ea"} Jul 24 04:00:10.359758 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.359748 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" event={"ID":"8df531f2-fcc2-418d-8351-e752ca2da1dd","Type":"ContainerStarted","Data":"e3570906d250e18312aa16205d67b7121a0f15b8d1dfe751b2269f7ebd6f0b50"} Jul 24 04:00:10.359845 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.359790 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" event={"ID":"8df531f2-fcc2-418d-8351-e752ca2da1dd","Type":"ContainerStarted","Data":"8f9f4a00b54eb88beeb77f1f8cd8a1ecc91bff4a91161ab6301e25ba3808bbf1"} Jul 24 04:00:10.360934 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.360916 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" event={"ID":"719eff03-74c0-4125-a384-718303d979db","Type":"ContainerStarted","Data":"4dc11d057ed316686ffdffce926c82a577df1add7815e0bd34d0d43019b43a74"} Jul 24 04:00:10.363133 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.363098 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-87.ec2.internal" podStartSLOduration=20.363087728 podStartE2EDuration="20.363087728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:59:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:10.362614939 +0000 UTC m=+22.596314798" watchObservedRunningTime="2026-07-24 04:00:10.363087728 +0000 UTC m=+22.596787398" Jul 24 04:00:10.395710 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.395661 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x79bw" podStartSLOduration=3.1599492590000002 podStartE2EDuration="22.395639453s" totalImagesPullingTime="19.235690194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:10.395306338 +0000 UTC m=+22.629006007" watchObservedRunningTime="2026-07-24 04:00:10.395639453 +0000 UTC m=+22.629339125" Jul 24 04:00:10.427621 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.427580 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nqgm4" podStartSLOduration=10.396834112 podStartE2EDuration="21.427566527s" totalImagesPullingTime="11.030732415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:10.412570326 +0000 UTC m=+22.646269997" watchObservedRunningTime="2026-07-24 04:00:10.427566527 +0000 UTC m=+22.661266215" Jul 24 04:00:10.427820 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.427802 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qt8ht" podStartSLOduration=2.26152815 podStartE2EDuration="21.427797206s" totalImagesPullingTime="19.166269056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:10.427518658 +0000 UTC m=+22.661218331" watchObservedRunningTime="2026-07-24 04:00:10.427797206 +0000 UTC m=+22.661496876" Jul 24 04:00:10.443689 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.443648 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vgwxn" podStartSLOduration=3.738448468 podStartE2EDuration="21.443635605s" totalImagesPullingTime="17.705187137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:10.443239891 +0000 UTC m=+22.676939561" watchObservedRunningTime="2026-07-24 04:00:10.443635605 +0000 UTC m=+22.677335275" Jul 24 04:00:10.462437 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:10.462402 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x7fgg" podStartSLOduration=3.177058691 podStartE2EDuration="22.462386152s" totalImagesPullingTime="19.285327461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:10.462120139 +0000 UTC m=+22.695819810" watchObservedRunningTime="2026-07-24 04:00:10.462386152 +0000 UTC m=+22.696085803" Jul 24 04:00:11.254883 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:11.254855 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:11.255092 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:11.254995 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:11.366276 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:11.366241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" event={"ID":"8df531f2-fcc2-418d-8351-e752ca2da1dd","Type":"ContainerStarted","Data":"1754fbc3984a71fb89656050468b0ae27c599becc85a80241b6cbddf412ceab3"} Jul 24 04:00:11.366441 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:11.366323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" event={"ID":"8df531f2-fcc2-418d-8351-e752ca2da1dd","Type":"ContainerStarted","Data":"89a7ac92c50421524a7c11f1277a90130c158f7382f72dc05693624eb6382b14"} Jul 24 04:00:11.367533 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:11.367495 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pg6r9" event={"ID":"c41550b2-0b17-4c09-a178-e0e2babfbb37","Type":"ContainerStarted","Data":"ba6ea3d12c06d44abaae116d83d3ef814a2e9a32e39e8f9d85d21b14168e891c"} Jul 24 04:00:11.381590 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:11.381548 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pg6r9" podStartSLOduration=4.182870818 podStartE2EDuration="23.381532961s" totalImagesPullingTime="19.198662143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:11.381138396 +0000 UTC m=+23.614838069" watchObservedRunningTime="2026-07-24 04:00:11.381532961 +0000 UTC m=+23.615232634" Jul 24 04:00:11.572651 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:11.572621 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 04:00:12.254871 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:12.254834 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:12.255293 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:12.254993 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:12.255293 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:12.255030 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:12.255293 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:12.255158 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:12.269938 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:12.269861 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T04:00:11.572646053Z","UUID":"6c89566e-00d3-4d04-a386-5ca1d361d95d","Handler":null,"Name":"","Endpoint":""} Jul 24 04:00:12.271459 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:12.271438 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 04:00:12.271555 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:12.271475 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 04:00:12.372594 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:12.372533 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" event={"ID":"719eff03-74c0-4125-a384-718303d979db","Type":"ContainerStarted","Data":"6a24547e6fe643a7ca7d89bfb35208536f7bd90bb3fa8f4d04762349fbc4dfd9"} Jul 24 04:00:12.802624 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:12.802593 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qt8ht" Jul 24 04:00:12.803268 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:12.803245 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qt8ht" Jul 24 04:00:13.255280 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:13.255110 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:13.255417 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:13.255354 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:13.377955 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:13.377917 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" event={"ID":"8df531f2-fcc2-418d-8351-e752ca2da1dd","Type":"ContainerStarted","Data":"851d134b86c98e644add5efd2bc71eef121e3c9db86a5ed95e80fb820a6a6841"} Jul 24 04:00:13.379829 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:13.379799 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" event={"ID":"719eff03-74c0-4125-a384-718303d979db","Type":"ContainerStarted","Data":"4221e323dd5153083ed4452f6dab3ce1c6fb7b10bf2dd6edd8e36ff05606b600"} Jul 24 04:00:13.380038 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:13.380014 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qt8ht" Jul 24 04:00:13.380460 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:13.380443 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qt8ht" Jul 24 04:00:13.400194 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:13.400148 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hr45h" podStartSLOduration=3.151860346 podStartE2EDuration="25.400132831s" totalImagesPullingTime="22.248272485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:59:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:13.399686336 +0000 UTC m=+25.633386009" watchObservedRunningTime="2026-07-24 04:00:13.400132831 +0000 UTC m=+25.633832572" Jul 24 04:00:14.255086 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:14.255055 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:14.255278 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:14.255058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:14.255278 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:14.255177 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:14.255278 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:14.255266 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:15.254579 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:15.254550 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:15.255354 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:15.254670 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:16.254999 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:16.254789 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:16.255477 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:16.254788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:16.255477 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:16.255099 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:16.255477 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:16.255145 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:16.388902 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:16.388865 2578 generic.go:356] "Generic (PLEG): container finished" podID="74107bd8-aa9c-4f18-9306-f9c41ec9f370" containerID="696a51f2aca0f34d307d70954ca4945b7be7998f1ce61aaeae3fc86bc26a19fe" exitCode=0 Jul 24 04:00:16.389106 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:16.388951 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2slfs" event={"ID":"74107bd8-aa9c-4f18-9306-f9c41ec9f370","Type":"ContainerDied","Data":"696a51f2aca0f34d307d70954ca4945b7be7998f1ce61aaeae3fc86bc26a19fe"} Jul 24 04:00:16.392958 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:16.392933 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" event={"ID":"8df531f2-fcc2-418d-8351-e752ca2da1dd","Type":"ContainerStarted","Data":"4631f4f023ab3737a7fcc94e19f2461a442ef2a1f104d2895e92fe132ebbeaf0"} Jul 24 04:00:16.393251 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:16.393227 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 04:00:16.393359 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:16.393296 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 04:00:16.409833 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:16.409812 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 04:00:16.432923 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:16.432881 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" podStartSLOduration=9.113337503 podStartE2EDuration="28.432866751s" totalImagesPullingTime="19.319529248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:16.432198131 +0000 UTC m=+28.665897800" watchObservedRunningTime="2026-07-24 04:00:16.432866751 +0000 UTC m=+28.666566424" Jul 24 04:00:17.255391 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:17.255362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:17.255788 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:17.255471 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:17.395346 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:17.395311 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 04:00:17.409946 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:17.409918 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 04:00:17.471988 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:17.471940 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mqtjx"] Jul 24 04:00:17.472145 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:17.472071 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:17.472205 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:17.472175 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:17.480093 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:17.480066 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fn8hw"] Jul 24 04:00:17.480783 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:17.480324 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:17.480783 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:17.480443 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:17.481131 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:17.480871 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-drhnf"] Jul 24 04:00:17.481131 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:17.480984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:17.481131 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:17.481072 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:18.398602 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:18.398566 2578 generic.go:356] "Generic (PLEG): container finished" podID="74107bd8-aa9c-4f18-9306-f9c41ec9f370" containerID="16061c9f8be6e15f071fa25056ab9faff19ef29c19c78ec9c94a5c358714142a" exitCode=0 Jul 24 04:00:18.399056 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:18.398648 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2slfs" event={"ID":"74107bd8-aa9c-4f18-9306-f9c41ec9f370","Type":"ContainerDied","Data":"16061c9f8be6e15f071fa25056ab9faff19ef29c19c78ec9c94a5c358714142a"} Jul 24 04:00:19.255137 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:19.254919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:19.255317 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:19.254960 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:19.255317 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:19.254978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:19.255317 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:19.255276 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:19.255468 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:19.255339 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:19.255468 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:19.255401 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:20.406248 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:20.406206 2578 generic.go:356] "Generic (PLEG): container finished" podID="74107bd8-aa9c-4f18-9306-f9c41ec9f370" containerID="7f05626d21bff27387e96f8f1f156297e66bfd31213b4a6b00639c86c4b568ec" exitCode=0 Jul 24 04:00:20.406883 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:20.406254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2slfs" event={"ID":"74107bd8-aa9c-4f18-9306-f9c41ec9f370","Type":"ContainerDied","Data":"7f05626d21bff27387e96f8f1f156297e66bfd31213b4a6b00639c86c4b568ec"} Jul 24 04:00:21.254656 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:21.254618 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:21.254656 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:21.254659 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:21.254912 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:21.254734 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:21.254912 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:21.254752 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:21.254912 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:21.254849 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:21.255059 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:21.254937 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:21.952909 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:21.952829 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:21.953284 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:21.952983 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:21.953284 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:21.953042 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs podName:cfdaa993-a5f2-486b-be35-f6d04e6eb8f2 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:53.953025472 +0000 UTC m=+66.186725123 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs") pod "network-metrics-daemon-fn8hw" (UID: "cfdaa993-a5f2-486b-be35-f6d04e6eb8f2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:22.054026 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:22.053995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:22.054195 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:22.054121 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:22.054195 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:22.054178 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret podName:68781720-31da-4036-97f5-d2bf5fcd0df0 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:54.054164783 +0000 UTC m=+66.287864433 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret") pod "global-pull-secret-syncer-drhnf" (UID: "68781720-31da-4036-97f5-d2bf5fcd0df0") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:22.154313 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:22.154277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxcrc\" (UniqueName: \"kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc\") pod \"network-check-target-mqtjx\" (UID: \"01a3813d-002f-4290-baea-b727e2272473\") " pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:22.154501 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:22.154435 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:22.154501 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:22.154455 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:22.154501 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:22.154467 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fxcrc for pod openshift-network-diagnostics/network-check-target-mqtjx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:22.154648 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:22.154526 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc podName:01a3813d-002f-4290-baea-b727e2272473 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:54.15450783 +0000 UTC m=+66.388207480 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxcrc" (UniqueName: "kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc") pod "network-check-target-mqtjx" (UID: "01a3813d-002f-4290-baea-b727e2272473") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:23.254673 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.254639 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:23.255161 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.254743 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:23.255161 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.254750 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtjx" podUID="01a3813d-002f-4290-baea-b727e2272473" Jul 24 04:00:23.255161 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.254780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:23.255161 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.254884 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drhnf" podUID="68781720-31da-4036-97f5-d2bf5fcd0df0" Jul 24 04:00:23.255161 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.254979 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fn8hw" podUID="cfdaa993-a5f2-486b-be35-f6d04e6eb8f2" Jul 24 04:00:23.575717 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.575638 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-87.ec2.internal" event="NodeReady" Jul 24 04:00:23.575886 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.575808 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 04:00:23.612342 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.612308 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-jk2zf"] Jul 24 04:00:23.617687 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.617526 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-s44kl"] Jul 24 04:00:23.622226 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.622195 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.625621 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.625598 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.625814 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.625795 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.626135 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.625709 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 24 04:00:23.626135 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.625714 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9697474c5-4nkzn"] Jul 24 04:00:23.626283 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.625709 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hc6jp\"" Jul 24 04:00:23.626345 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.625602 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 24 04:00:23.626730 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.626708 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.628984 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.628768 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.629619 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.629293 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 24 04:00:23.629619 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.629436 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 24 04:00:23.629787 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.629694 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f554cdb4c-tn48f"] Jul 24 04:00:23.630238 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.630215 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.630492 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.630475 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.630631 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.630611 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-t7mlw\"" Jul 24 04:00:23.634267 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.634245 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 24 04:00:23.635684 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.635432 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-lwm4l"] Jul 24 04:00:23.636377 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.636185 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 04:00:23.637335 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.636204 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 04:00:23.637335 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.636261 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 04:00:23.637335 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.636373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.638571 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.636850 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rtsnl\"" Jul 24 04:00:23.638843 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.638824 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs"] Jul 24 04:00:23.639023 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.639004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-lwm4l" Jul 24 04:00:23.642607 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.642585 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 24 04:00:23.643769 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.643747 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 24 04:00:23.643980 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.643953 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.644161 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.644145 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 24 04:00:23.644356 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.644339 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 24 04:00:23.644422 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.644356 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6lnrf\"" Jul 24 04:00:23.644606 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.644588 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 24 04:00:23.645566 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.645542 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.645839 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.645823 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kmtrm\"" Jul 24 04:00:23.646143 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.646123 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk"] Jul 24 04:00:23.646380 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.646359 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.646604 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.646588 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.646859 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.646837 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" Jul 24 04:00:23.652696 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.652673 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc"] Jul 24 04:00:23.657131 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.657108 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 24 04:00:23.658817 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.653911 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.660024 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.654022 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 24 04:00:23.660684 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.654279 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.661330 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.654512 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hjl7g\"" Jul 24 04:00:23.661611 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.652897 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:23.663517 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.663475 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 04:00:23.664804 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.664786 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-jk2zf"] Jul 24 04:00:23.664897 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.664828 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-s44kl"] Jul 24 04:00:23.664897 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.664850 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-lwm4l"] Jul 24 04:00:23.664897 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.664874 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c"] Jul 24 04:00:23.664897 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.664882 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jg6j6\"" Jul 24 04:00:23.665259 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.665235 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 24 04:00:23.665346 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.665329 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" Jul 24 04:00:23.665481 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.665464 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.666394 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.666377 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.667499 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.667482 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 24 04:00:23.667681 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.667652 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 24 04:00:23.667865 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.667850 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 24 04:00:23.668254 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.668234 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7wdmb\"" Jul 24 04:00:23.668528 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.668500 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.668690 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.668524 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.668690 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.668545 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8wlb8"] Jul 24 04:00:23.668798 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.668763 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:23.671175 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.671160 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.671266 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.671164 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 24 04:00:23.671266 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.671217 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n6z8n\"" Jul 24 04:00:23.671368 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.671179 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.672291 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.672274 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2pcmq"] Jul 24 04:00:23.672630 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.672613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8wlb8" Jul 24 04:00:23.675065 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.675051 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.675454 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.675438 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk"] Jul 24 04:00:23.675538 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.675468 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9697474c5-4nkzn"] Jul 24 04:00:23.675538 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.675492 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-knxzz"] Jul 24 04:00:23.675538 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.675498 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 04:00:23.675538 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.675514 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gzt6l\"" Jul 24 04:00:23.675733 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.675637 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:23.675733 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.675498 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.677773 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.677743 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7mgjm\"" Jul 24 04:00:23.677869 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.677746 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 04:00:23.677928 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.677876 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 04:00:23.678497 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.678480 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f554cdb4c-tn48f"] Jul 24 04:00:23.678587 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.678508 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc"] Jul 24 04:00:23.678587 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.678526 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8wlb8"] Jul 24 04:00:23.678587 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.678541 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-knxzz"] Jul 24 04:00:23.678587 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.678558 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c"] Jul 24 04:00:23.678587 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.678580 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2pcmq"] Jul 24 04:00:23.678921 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.678597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-knxzz" Jul 24 04:00:23.678921 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.678604 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs"] Jul 24 04:00:23.680661 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.680642 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 04:00:23.681116 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.681101 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 04:00:23.681189 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.681122 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-r5prw\"" Jul 24 04:00:23.766451 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57155d90-234f-4763-9688-382e925a8f4c-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.766451 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.766647 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb7ca265-f76f-400f-a799-958859d3553a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-tbphs\" (UID: \"bb7ca265-f76f-400f-a799-958859d3553a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" Jul 24 04:00:23.766647 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57155d90-234f-4763-9688-382e925a8f4c-service-ca-bundle\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.766647 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-stats-auth\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.766647 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbc42fe3-ed20-4ad7-9d57-48a641386372-trusted-ca\") pod \"console-operator-584dcb6b54-s44kl\" (UID: \"cbc42fe3-ed20-4ad7-9d57-48a641386372\") " pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.766823 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.766823 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766678 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-995dm\" (UniqueName: \"kubernetes.io/projected/afe68fdb-5c92-47ca-835a-76ca67c958f5-kube-api-access-995dm\") pod \"network-check-source-7d88cb55d8-knxzz\" (UID: \"afe68fdb-5c92-47ca-835a-76ca67c958f5\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-knxzz" Jul 24 04:00:23.766823 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cbc42fe3-ed20-4ad7-9d57-48a641386372-serving-cert\") pod \"console-operator-584dcb6b54-s44kl\" (UID: \"cbc42fe3-ed20-4ad7-9d57-48a641386372\") " pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.766823 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57155d90-234f-4763-9688-382e925a8f4c-tmp\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.766823 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766782 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt4hg\" (UniqueName: \"kubernetes.io/projected/57155d90-234f-4763-9688-382e925a8f4c-kube-api-access-lt4hg\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.766823 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc7gf\" (UniqueName: \"kubernetes.io/projected/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-kube-api-access-mc7gf\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:23.767055 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j976b\" (UniqueName: \"kubernetes.io/projected/d7e5f257-bd10-4823-bd94-d72dee0b5cf7-kube-api-access-j976b\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc\" (UID: \"d7e5f257-bd10-4823-bd94-d72dee0b5cf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" Jul 24 04:00:23.767055 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:23.767055 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31f95900-8dd8-4926-a3c1-5f74dbf8a767-image-registry-private-configuration\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.767055 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d450efc4-763a-445e-9db9-64ba3c11b3da-tmp-dir\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:23.767055 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cbc42fe3-ed20-4ad7-9d57-48a641386372-config\") pod \"console-operator-584dcb6b54-s44kl\" (UID: \"cbc42fe3-ed20-4ad7-9d57-48a641386372\") " pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.767055 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.767055 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.766991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-default-certificate\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.767055 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pccc5\" (UniqueName: \"kubernetes.io/projected/bb7ca265-f76f-400f-a799-958859d3553a-kube-api-access-pccc5\") pod \"service-ca-operator-5d6c75f84f-tbphs\" (UID: \"bb7ca265-f76f-400f-a799-958859d3553a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" Jul 24 04:00:23.767055 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp6zs\" (UniqueName: \"kubernetes.io/projected/eace775d-a1c8-402b-8a65-95d2d83fea13-kube-api-access-kp6zs\") pod \"volume-data-source-validator-549c6d54cf-lwm4l\" (UID: \"eace775d-a1c8-402b-8a65-95d2d83fea13\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-lwm4l" Jul 24 04:00:23.767055 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7e5f257-bd10-4823-bd94-d72dee0b5cf7-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc\" (UID: \"d7e5f257-bd10-4823-bd94-d72dee0b5cf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" Jul 24 04:00:23.767386 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z6wx\" (UniqueName: \"kubernetes.io/projected/d26bd751-182b-4dc4-8bf3-39cfb76a5e86-kube-api-access-6z6wx\") pod \"ingress-canary-8wlb8\" (UID: \"d26bd751-182b-4dc4-8bf3-39cfb76a5e86\") " pod="openshift-ingress-canary/ingress-canary-8wlb8" Jul 24 04:00:23.767386 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7e5f257-bd10-4823-bd94-d72dee0b5cf7-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc\" (UID: \"d7e5f257-bd10-4823-bd94-d72dee0b5cf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" Jul 24 04:00:23.767386 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/57155d90-234f-4763-9688-382e925a8f4c-serving-cert\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.767386 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzxpm\" (UniqueName: \"kubernetes.io/projected/16cb44d8-ec27-491f-9060-e6bcf27532ac-kube-api-access-kzxpm\") pod \"cluster-samples-operator-6748489656-5hk2c\" (UID: \"16cb44d8-ec27-491f-9060-e6bcf27532ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:23.767386 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d26bd751-182b-4dc4-8bf3-39cfb76a5e86-cert\") pod \"ingress-canary-8wlb8\" (UID: \"d26bd751-182b-4dc4-8bf3-39cfb76a5e86\") " pod="openshift-ingress-canary/ingress-canary-8wlb8" Jul 24 04:00:23.767386 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb7ca265-f76f-400f-a799-958859d3553a-config\") pod \"service-ca-operator-5d6c75f84f-tbphs\" (UID: \"bb7ca265-f76f-400f-a799-958859d3553a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" Jul 24 04:00:23.767386 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:23.767386 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/57155d90-234f-4763-9688-382e925a8f4c-snapshots\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.767386 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-bound-sa-token\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.767386 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767381 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5hk2c\" (UID: \"16cb44d8-ec27-491f-9060-e6bcf27532ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:23.767700 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d450efc4-763a-445e-9db9-64ba3c11b3da-config-volume\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:23.767700 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-certificates\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.767700 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31f95900-8dd8-4926-a3c1-5f74dbf8a767-installation-pull-secrets\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.767700 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31f95900-8dd8-4926-a3c1-5f74dbf8a767-ca-trust-extracted\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.767700 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7c6m\" (UniqueName: \"kubernetes.io/projected/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-kube-api-access-x7c6m\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.767700 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:23.767700 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjmcx\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-kube-api-access-qjmcx\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.767700 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqvmp\" (UniqueName: \"kubernetes.io/projected/cbc42fe3-ed20-4ad7-9d57-48a641386372-kube-api-access-nqvmp\") pod \"console-operator-584dcb6b54-s44kl\" (UID: \"cbc42fe3-ed20-4ad7-9d57-48a641386372\") " pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.767700 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31f95900-8dd8-4926-a3c1-5f74dbf8a767-trusted-ca\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.767700 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.767644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lskxf\" (UniqueName: \"kubernetes.io/projected/d450efc4-763a-445e-9db9-64ba3c11b3da-kube-api-access-lskxf\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:23.869155 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/57155d90-234f-4763-9688-382e925a8f4c-serving-cert\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.869155 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869114 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzxpm\" (UniqueName: \"kubernetes.io/projected/16cb44d8-ec27-491f-9060-e6bcf27532ac-kube-api-access-kzxpm\") pod \"cluster-samples-operator-6748489656-5hk2c\" (UID: \"16cb44d8-ec27-491f-9060-e6bcf27532ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:23.869389 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d26bd751-182b-4dc4-8bf3-39cfb76a5e86-cert\") pod \"ingress-canary-8wlb8\" (UID: \"d26bd751-182b-4dc4-8bf3-39cfb76a5e86\") " pod="openshift-ingress-canary/ingress-canary-8wlb8" Jul 24 04:00:23.869389 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb7ca265-f76f-400f-a799-958859d3553a-config\") pod \"service-ca-operator-5d6c75f84f-tbphs\" (UID: \"bb7ca265-f76f-400f-a799-958859d3553a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" Jul 24 04:00:23.869389 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:23.869389 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/57155d90-234f-4763-9688-382e925a8f4c-snapshots\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.869389 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-bound-sa-token\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.869599 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5hk2c\" (UID: \"16cb44d8-ec27-491f-9060-e6bcf27532ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:23.869599 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d450efc4-763a-445e-9db9-64ba3c11b3da-config-volume\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:23.869599 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869474 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-certificates\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.869599 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31f95900-8dd8-4926-a3c1-5f74dbf8a767-installation-pull-secrets\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.869599 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31f95900-8dd8-4926-a3c1-5f74dbf8a767-ca-trust-extracted\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.869599 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7c6m\" (UniqueName: \"kubernetes.io/projected/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-kube-api-access-x7c6m\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.869599 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.869566 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 04:00:23.869599 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:23.869949 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjmcx\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-kube-api-access-qjmcx\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.869949 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.869641 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls podName:16cb44d8-ec27-491f-9060-e6bcf27532ac nodeName:}" failed. No retries permitted until 2026-07-24 04:00:24.36962067 +0000 UTC m=+36.603320335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls") pod "cluster-samples-operator-6748489656-5hk2c" (UID: "16cb44d8-ec27-491f-9060-e6bcf27532ac") : secret "samples-operator-tls" not found Jul 24 04:00:23.869949 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvmp\" (UniqueName: \"kubernetes.io/projected/cbc42fe3-ed20-4ad7-9d57-48a641386372-kube-api-access-nqvmp\") pod \"console-operator-584dcb6b54-s44kl\" (UID: \"cbc42fe3-ed20-4ad7-9d57-48a641386372\") " pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.869949 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31f95900-8dd8-4926-a3c1-5f74dbf8a767-trusted-ca\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.869949 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lskxf\" (UniqueName: \"kubernetes.io/projected/d450efc4-763a-445e-9db9-64ba3c11b3da-kube-api-access-lskxf\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:23.869949 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57155d90-234f-4763-9688-382e925a8f4c-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.869949 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.869949 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb7ca265-f76f-400f-a799-958859d3553a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-tbphs\" (UID: \"bb7ca265-f76f-400f-a799-958859d3553a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" Jul 24 04:00:23.869949 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57155d90-234f-4763-9688-382e925a8f4c-service-ca-bundle\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.869949 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-stats-auth\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.869949 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869918 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb7ca265-f76f-400f-a799-958859d3553a-config\") pod \"service-ca-operator-5d6c75f84f-tbphs\" (UID: \"bb7ca265-f76f-400f-a799-958859d3553a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" Jul 24 04:00:23.869949 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.869945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbc42fe3-ed20-4ad7-9d57-48a641386372-trusted-ca\") pod \"console-operator-584dcb6b54-s44kl\" (UID: \"cbc42fe3-ed20-4ad7-9d57-48a641386372\") " pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.870436 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870118 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:23.870436 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.870436 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-995dm\" (UniqueName: \"kubernetes.io/projected/afe68fdb-5c92-47ca-835a-76ca67c958f5-kube-api-access-995dm\") pod \"network-check-source-7d88cb55d8-knxzz\" (UID: \"afe68fdb-5c92-47ca-835a-76ca67c958f5\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-knxzz" Jul 24 04:00:23.870436 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cbc42fe3-ed20-4ad7-9d57-48a641386372-serving-cert\") pod \"console-operator-584dcb6b54-s44kl\" (UID: \"cbc42fe3-ed20-4ad7-9d57-48a641386372\") " pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.870436 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57155d90-234f-4763-9688-382e925a8f4c-tmp\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.870436 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870354 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d450efc4-763a-445e-9db9-64ba3c11b3da-config-volume\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:23.870436 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt4hg\" (UniqueName: \"kubernetes.io/projected/57155d90-234f-4763-9688-382e925a8f4c-kube-api-access-lt4hg\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.870436 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc7gf\" (UniqueName: \"kubernetes.io/projected/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-kube-api-access-mc7gf\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:23.870436 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j976b\" (UniqueName: \"kubernetes.io/projected/d7e5f257-bd10-4823-bd94-d72dee0b5cf7-kube-api-access-j976b\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc\" (UID: \"d7e5f257-bd10-4823-bd94-d72dee0b5cf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" Jul 24 04:00:23.870436 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:23.870806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31f95900-8dd8-4926-a3c1-5f74dbf8a767-image-registry-private-configuration\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.870806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d450efc4-763a-445e-9db9-64ba3c11b3da-tmp-dir\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:23.870806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cbc42fe3-ed20-4ad7-9d57-48a641386372-config\") pod \"console-operator-584dcb6b54-s44kl\" (UID: \"cbc42fe3-ed20-4ad7-9d57-48a641386372\") " pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.870806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.870806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-default-certificate\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.870806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pccc5\" (UniqueName: \"kubernetes.io/projected/bb7ca265-f76f-400f-a799-958859d3553a-kube-api-access-pccc5\") pod \"service-ca-operator-5d6c75f84f-tbphs\" (UID: \"bb7ca265-f76f-400f-a799-958859d3553a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" Jul 24 04:00:23.870806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6zs\" (UniqueName: \"kubernetes.io/projected/eace775d-a1c8-402b-8a65-95d2d83fea13-kube-api-access-kp6zs\") pod \"volume-data-source-validator-549c6d54cf-lwm4l\" (UID: \"eace775d-a1c8-402b-8a65-95d2d83fea13\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-lwm4l" Jul 24 04:00:23.870806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7e5f257-bd10-4823-bd94-d72dee0b5cf7-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc\" (UID: \"d7e5f257-bd10-4823-bd94-d72dee0b5cf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" Jul 24 04:00:23.870806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z6wx\" (UniqueName: \"kubernetes.io/projected/d26bd751-182b-4dc4-8bf3-39cfb76a5e86-kube-api-access-6z6wx\") pod \"ingress-canary-8wlb8\" (UID: \"d26bd751-182b-4dc4-8bf3-39cfb76a5e86\") " pod="openshift-ingress-canary/ingress-canary-8wlb8" Jul 24 04:00:23.870806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7e5f257-bd10-4823-bd94-d72dee0b5cf7-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc\" (UID: \"d7e5f257-bd10-4823-bd94-d72dee0b5cf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" Jul 24 04:00:23.870806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870786 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbc42fe3-ed20-4ad7-9d57-48a641386372-trusted-ca\") pod \"console-operator-584dcb6b54-s44kl\" (UID: \"cbc42fe3-ed20-4ad7-9d57-48a641386372\") " pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.870806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870786 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/57155d90-234f-4763-9688-382e925a8f4c-snapshots\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.871269 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.870892 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 04:00:23.871269 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.870906 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9697474c5-4nkzn: secret "image-registry-tls" not found Jul 24 04:00:23.871269 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.870908 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-certificates\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.871269 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.870978 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls podName:31f95900-8dd8-4926-a3c1-5f74dbf8a767 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:24.370946385 +0000 UTC m=+36.604646048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls") pod "image-registry-9697474c5-4nkzn" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767") : secret "image-registry-tls" not found Jul 24 04:00:23.871269 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.871037 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57155d90-234f-4763-9688-382e925a8f4c-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.871269 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.871264 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57155d90-234f-4763-9688-382e925a8f4c-service-ca-bundle\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.873282 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.872031 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cbc42fe3-ed20-4ad7-9d57-48a641386372-config\") pod \"console-operator-584dcb6b54-s44kl\" (UID: \"cbc42fe3-ed20-4ad7-9d57-48a641386372\") " pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.873282 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.872212 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31f95900-8dd8-4926-a3c1-5f74dbf8a767-trusted-ca\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.873282 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.872336 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57155d90-234f-4763-9688-382e925a8f4c-tmp\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.873282 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.872506 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle podName:75c0a7c0-765e-465f-ab9e-54e18fa72aa1 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:24.372488762 +0000 UTC m=+36.606188434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle") pod "router-default-7f554cdb4c-tn48f" (UID: "75c0a7c0-765e-465f-ab9e-54e18fa72aa1") : configmap references non-existent config key: service-ca.crt Jul 24 04:00:23.873282 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.872834 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 04:00:23.873282 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.872880 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs podName:75c0a7c0-765e-465f-ab9e-54e18fa72aa1 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:24.372864206 +0000 UTC m=+36.606563860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs") pod "router-default-7f554cdb4c-tn48f" (UID: "75c0a7c0-765e-465f-ab9e-54e18fa72aa1") : secret "router-metrics-certs-default" not found Jul 24 04:00:23.873282 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.872917 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 04:00:23.873282 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.872997 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls podName:b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:24.372979516 +0000 UTC m=+36.606679183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-jm9dk" (UID: "b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7") : secret "cluster-monitoring-operator-tls" not found Jul 24 04:00:23.873871 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.873466 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d450efc4-763a-445e-9db9-64ba3c11b3da-tmp-dir\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:23.873933 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.873911 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7e5f257-bd10-4823-bd94-d72dee0b5cf7-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc\" (UID: \"d7e5f257-bd10-4823-bd94-d72dee0b5cf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" Jul 24 04:00:23.874635 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.874609 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31f95900-8dd8-4926-a3c1-5f74dbf8a767-ca-trust-extracted\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.874992 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.874896 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d26bd751-182b-4dc4-8bf3-39cfb76a5e86-cert\") pod \"ingress-canary-8wlb8\" (UID: \"d26bd751-182b-4dc4-8bf3-39cfb76a5e86\") " pod="openshift-ingress-canary/ingress-canary-8wlb8" Jul 24 04:00:23.875110 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.875091 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 04:00:23.875290 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:23.875274 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls podName:d450efc4-763a-445e-9db9-64ba3c11b3da nodeName:}" failed. No retries permitted until 2026-07-24 04:00:24.375259894 +0000 UTC m=+36.608959545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls") pod "dns-default-2pcmq" (UID: "d450efc4-763a-445e-9db9-64ba3c11b3da") : secret "dns-default-metrics-tls" not found Jul 24 04:00:23.875391 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.875227 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/57155d90-234f-4763-9688-382e925a8f4c-serving-cert\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.875453 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.875429 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7e5f257-bd10-4823-bd94-d72dee0b5cf7-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc\" (UID: \"d7e5f257-bd10-4823-bd94-d72dee0b5cf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" Jul 24 04:00:23.875609 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.875579 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31f95900-8dd8-4926-a3c1-5f74dbf8a767-installation-pull-secrets\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.875686 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.875640 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-stats-auth\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.875686 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.875677 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-default-certificate\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.876419 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.876395 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31f95900-8dd8-4926-a3c1-5f74dbf8a767-image-registry-private-configuration\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.877233 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.877182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb7ca265-f76f-400f-a799-958859d3553a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-tbphs\" (UID: \"bb7ca265-f76f-400f-a799-958859d3553a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" Jul 24 04:00:23.877693 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.877549 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cbc42fe3-ed20-4ad7-9d57-48a641386372-serving-cert\") pod \"console-operator-584dcb6b54-s44kl\" (UID: \"cbc42fe3-ed20-4ad7-9d57-48a641386372\") " pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.879944 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.879923 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-bound-sa-token\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.880032 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.879931 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqvmp\" (UniqueName: \"kubernetes.io/projected/cbc42fe3-ed20-4ad7-9d57-48a641386372-kube-api-access-nqvmp\") pod \"console-operator-584dcb6b54-s44kl\" (UID: \"cbc42fe3-ed20-4ad7-9d57-48a641386372\") " pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.880186 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.880164 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-995dm\" (UniqueName: \"kubernetes.io/projected/afe68fdb-5c92-47ca-835a-76ca67c958f5-kube-api-access-995dm\") pod \"network-check-source-7d88cb55d8-knxzz\" (UID: \"afe68fdb-5c92-47ca-835a-76ca67c958f5\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-knxzz" Jul 24 04:00:23.880224 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.880193 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjmcx\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-kube-api-access-qjmcx\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:23.881681 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.881660 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzxpm\" (UniqueName: \"kubernetes.io/projected/16cb44d8-ec27-491f-9060-e6bcf27532ac-kube-api-access-kzxpm\") pod \"cluster-samples-operator-6748489656-5hk2c\" (UID: \"16cb44d8-ec27-491f-9060-e6bcf27532ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:23.885300 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.885256 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lskxf\" (UniqueName: \"kubernetes.io/projected/d450efc4-763a-445e-9db9-64ba3c11b3da-kube-api-access-lskxf\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:23.887810 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.887263 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7c6m\" (UniqueName: \"kubernetes.io/projected/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-kube-api-access-x7c6m\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:23.887810 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.887291 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp6zs\" (UniqueName: \"kubernetes.io/projected/eace775d-a1c8-402b-8a65-95d2d83fea13-kube-api-access-kp6zs\") pod \"volume-data-source-validator-549c6d54cf-lwm4l\" (UID: \"eace775d-a1c8-402b-8a65-95d2d83fea13\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-lwm4l" Jul 24 04:00:23.887810 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.887770 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z6wx\" (UniqueName: \"kubernetes.io/projected/d26bd751-182b-4dc4-8bf3-39cfb76a5e86-kube-api-access-6z6wx\") pod \"ingress-canary-8wlb8\" (UID: \"d26bd751-182b-4dc4-8bf3-39cfb76a5e86\") " pod="openshift-ingress-canary/ingress-canary-8wlb8" Jul 24 04:00:23.888588 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.888532 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc7gf\" (UniqueName: \"kubernetes.io/projected/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-kube-api-access-mc7gf\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:23.888856 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.888833 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pccc5\" (UniqueName: \"kubernetes.io/projected/bb7ca265-f76f-400f-a799-958859d3553a-kube-api-access-pccc5\") pod \"service-ca-operator-5d6c75f84f-tbphs\" (UID: \"bb7ca265-f76f-400f-a799-958859d3553a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" Jul 24 04:00:23.889567 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.889517 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt4hg\" (UniqueName: \"kubernetes.io/projected/57155d90-234f-4763-9688-382e925a8f4c-kube-api-access-lt4hg\") pod \"insights-operator-5885fdb759-jk2zf\" (UID: \"57155d90-234f-4763-9688-382e925a8f4c\") " pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.889735 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.889711 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j976b\" (UniqueName: \"kubernetes.io/projected/d7e5f257-bd10-4823-bd94-d72dee0b5cf7-kube-api-access-j976b\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc\" (UID: \"d7e5f257-bd10-4823-bd94-d72dee0b5cf7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" Jul 24 04:00:23.939449 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.939419 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-jk2zf" Jul 24 04:00:23.953979 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.953938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:23.984394 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.984360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-lwm4l" Jul 24 04:00:23.991493 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:23.991470 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" Jul 24 04:00:24.007084 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.007060 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" Jul 24 04:00:24.023166 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.023140 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8wlb8" Jul 24 04:00:24.035120 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.035092 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-knxzz" Jul 24 04:00:24.374813 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.374767 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.374947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:24.375002 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle podName:75c0a7c0-765e-465f-ab9e-54e18fa72aa1 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:25.374955552 +0000 UTC m=+37.608655207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle") pod "router-default-7f554cdb4c-tn48f" (UID: "75c0a7c0-765e-465f-ab9e-54e18fa72aa1") : configmap references non-existent config key: service-ca.crt Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:24.375058 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:24.375074 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9697474c5-4nkzn: secret "image-registry-tls" not found Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:24.375120 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls podName:31f95900-8dd8-4926-a3c1-5f74dbf8a767 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:25.375106185 +0000 UTC m=+37.608805851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls") pod "image-registry-9697474c5-4nkzn" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767") : secret "image-registry-tls" not found Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.375064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.375164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:24.375190 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:24.375230 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls podName:b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:25.375218088 +0000 UTC m=+37.608917740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-jm9dk" (UID: "b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7") : secret "cluster-monitoring-operator-tls" not found Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.375248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5hk2c\" (UID: \"16cb44d8-ec27-491f-9060-e6bcf27532ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.375303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:24.375308 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 04:00:24.375424 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:24.375353 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 04:00:24.375875 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:24.375356 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs podName:75c0a7c0-765e-465f-ab9e-54e18fa72aa1 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:25.375343016 +0000 UTC m=+37.609042711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs") pod "router-default-7f554cdb4c-tn48f" (UID: "75c0a7c0-765e-465f-ab9e-54e18fa72aa1") : secret "router-metrics-certs-default" not found Jul 24 04:00:24.375875 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:24.375401 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls podName:16cb44d8-ec27-491f-9060-e6bcf27532ac nodeName:}" failed. No retries permitted until 2026-07-24 04:00:25.375389469 +0000 UTC m=+37.609089121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls") pod "cluster-samples-operator-6748489656-5hk2c" (UID: "16cb44d8-ec27-491f-9060-e6bcf27532ac") : secret "samples-operator-tls" not found Jul 24 04:00:24.375875 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:24.375416 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 04:00:24.375875 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:24.375451 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls podName:d450efc4-763a-445e-9db9-64ba3c11b3da nodeName:}" failed. No retries permitted until 2026-07-24 04:00:25.375440652 +0000 UTC m=+37.609140307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls") pod "dns-default-2pcmq" (UID: "d450efc4-763a-445e-9db9-64ba3c11b3da") : secret "dns-default-metrics-tls" not found Jul 24 04:00:24.480000 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.479214 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp"] Jul 24 04:00:24.482993 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.482432 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps"] Jul 24 04:00:24.482993 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.482526 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp" Jul 24 04:00:24.485491 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.485308 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 24 04:00:24.485491 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.485308 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 24 04:00:24.485491 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.485353 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 24 04:00:24.485491 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.485403 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 24 04:00:24.485491 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.485442 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6hvtg\"" Jul 24 04:00:24.486001 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.485949 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd"] Jul 24 04:00:24.486836 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.486812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:24.491193 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.488916 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 24 04:00:24.492889 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.492761 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp"] Jul 24 04:00:24.492889 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.492793 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps"] Jul 24 04:00:24.492889 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.492821 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd"] Jul 24 04:00:24.493151 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.492919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.495253 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.495227 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 24 04:00:24.495360 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.495227 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 24 04:00:24.495360 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.495353 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 24 04:00:24.495462 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.495383 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 24 04:00:24.580745 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.580711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-ca\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.580902 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.580755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nm75\" (UniqueName: \"kubernetes.io/projected/1b21f1d6-912d-4b75-9f72-4f218c0e49d1-kube-api-access-6nm75\") pod \"klusterlet-addon-workmgr-5d945845c5-r7lps\" (UID: \"1b21f1d6-912d-4b75-9f72-4f218c0e49d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:24.580902 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.580785 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bcd20cd8-e85e-4773-a30e-e2faaae651c1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64c488b48d-grmfp\" (UID: \"bcd20cd8-e85e-4773-a30e-e2faaae651c1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp" Jul 24 04:00:24.580902 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.580828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.580902 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.580854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-hub\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.580902 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.580882 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmnxx\" (UniqueName: \"kubernetes.io/projected/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-kube-api-access-qmnxx\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.581195 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.580957 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.581195 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.581048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.581195 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.581117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b21f1d6-912d-4b75-9f72-4f218c0e49d1-tmp\") pod \"klusterlet-addon-workmgr-5d945845c5-r7lps\" (UID: \"1b21f1d6-912d-4b75-9f72-4f218c0e49d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:24.581195 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.581186 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx8c6\" (UniqueName: \"kubernetes.io/projected/bcd20cd8-e85e-4773-a30e-e2faaae651c1-kube-api-access-xx8c6\") pod \"managed-serviceaccount-addon-agent-64c488b48d-grmfp\" (UID: \"bcd20cd8-e85e-4773-a30e-e2faaae651c1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp" Jul 24 04:00:24.581360 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.581219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1b21f1d6-912d-4b75-9f72-4f218c0e49d1-klusterlet-config\") pod \"klusterlet-addon-workmgr-5d945845c5-r7lps\" (UID: \"1b21f1d6-912d-4b75-9f72-4f218c0e49d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:24.682527 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.682435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-ca\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.682527 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.682497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nm75\" (UniqueName: \"kubernetes.io/projected/1b21f1d6-912d-4b75-9f72-4f218c0e49d1-kube-api-access-6nm75\") pod \"klusterlet-addon-workmgr-5d945845c5-r7lps\" (UID: \"1b21f1d6-912d-4b75-9f72-4f218c0e49d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:24.682527 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.682530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bcd20cd8-e85e-4773-a30e-e2faaae651c1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64c488b48d-grmfp\" (UID: \"bcd20cd8-e85e-4773-a30e-e2faaae651c1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp" Jul 24 04:00:24.682797 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.682567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.682797 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.682599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-hub\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.682797 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.682625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmnxx\" (UniqueName: \"kubernetes.io/projected/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-kube-api-access-qmnxx\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.682797 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.682661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.682797 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.682694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.682797 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.682751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b21f1d6-912d-4b75-9f72-4f218c0e49d1-tmp\") pod \"klusterlet-addon-workmgr-5d945845c5-r7lps\" (UID: \"1b21f1d6-912d-4b75-9f72-4f218c0e49d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:24.683114 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.682814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx8c6\" (UniqueName: \"kubernetes.io/projected/bcd20cd8-e85e-4773-a30e-e2faaae651c1-kube-api-access-xx8c6\") pod \"managed-serviceaccount-addon-agent-64c488b48d-grmfp\" (UID: \"bcd20cd8-e85e-4773-a30e-e2faaae651c1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp" Jul 24 04:00:24.683114 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.682848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1b21f1d6-912d-4b75-9f72-4f218c0e49d1-klusterlet-config\") pod \"klusterlet-addon-workmgr-5d945845c5-r7lps\" (UID: \"1b21f1d6-912d-4b75-9f72-4f218c0e49d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:24.683603 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.683316 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b21f1d6-912d-4b75-9f72-4f218c0e49d1-tmp\") pod \"klusterlet-addon-workmgr-5d945845c5-r7lps\" (UID: \"1b21f1d6-912d-4b75-9f72-4f218c0e49d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:24.683603 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.683529 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.685905 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.685878 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-hub\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.686037 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.685919 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1b21f1d6-912d-4b75-9f72-4f218c0e49d1-klusterlet-config\") pod \"klusterlet-addon-workmgr-5d945845c5-r7lps\" (UID: \"1b21f1d6-912d-4b75-9f72-4f218c0e49d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:24.686091 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.686070 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bcd20cd8-e85e-4773-a30e-e2faaae651c1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64c488b48d-grmfp\" (UID: \"bcd20cd8-e85e-4773-a30e-e2faaae651c1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp" Jul 24 04:00:24.686317 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.686292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.686500 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.686480 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.687339 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.687318 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-ca\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.691315 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.691292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nm75\" (UniqueName: \"kubernetes.io/projected/1b21f1d6-912d-4b75-9f72-4f218c0e49d1-kube-api-access-6nm75\") pod \"klusterlet-addon-workmgr-5d945845c5-r7lps\" (UID: \"1b21f1d6-912d-4b75-9f72-4f218c0e49d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:24.691415 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.691395 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx8c6\" (UniqueName: \"kubernetes.io/projected/bcd20cd8-e85e-4773-a30e-e2faaae651c1-kube-api-access-xx8c6\") pod \"managed-serviceaccount-addon-agent-64c488b48d-grmfp\" (UID: \"bcd20cd8-e85e-4773-a30e-e2faaae651c1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp" Jul 24 04:00:24.691468 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.691448 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmnxx\" (UniqueName: \"kubernetes.io/projected/1561bcc1-5514-4507-bf7d-8c6bc3bb204b-kube-api-access-qmnxx\") pod \"cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd\" (UID: \"1561bcc1-5514-4507-bf7d-8c6bc3bb204b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:24.806641 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.806601 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp" Jul 24 04:00:24.815475 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.815446 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:24.819369 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:24.819338 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:00:25.208837 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.208803 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc"] Jul 24 04:00:25.226398 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.226317 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-lwm4l"] Jul 24 04:00:25.230935 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.230839 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-knxzz"] Jul 24 04:00:25.236828 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.236710 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-s44kl"] Jul 24 04:00:25.255165 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.255123 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:25.255165 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.255148 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:25.255622 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.255553 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:25.257742 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.257702 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dtpl8\"" Jul 24 04:00:25.257926 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.257905 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 04:00:25.258269 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.258250 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j89kf\"" Jul 24 04:00:25.258650 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.258604 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 04:00:25.263363 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.263342 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd"] Jul 24 04:00:25.267099 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.267068 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs"] Jul 24 04:00:25.275858 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.275837 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps"] Jul 24 04:00:25.279386 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.279360 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp"] Jul 24 04:00:25.280492 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.280477 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-jk2zf"] Jul 24 04:00:25.287829 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.287806 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8wlb8"] Jul 24 04:00:25.291033 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:25.291007 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b21f1d6_912d_4b75_9f72_4f218c0e49d1.slice/crio-a0c0660311f8b5b2695768c2ebd619d32e349fd3709f709ad2e52c05b445b24b WatchSource:0}: Error finding container a0c0660311f8b5b2695768c2ebd619d32e349fd3709f709ad2e52c05b445b24b: Status 404 returned error can't find the container with id a0c0660311f8b5b2695768c2ebd619d32e349fd3709f709ad2e52c05b445b24b Jul 24 04:00:25.291917 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:25.291888 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe68fdb_5c92_47ca_835a_76ca67c958f5.slice/crio-6cdbc8f1fd0151343c90b6a762fbc0a7205b9b480dce90a71d84df2ca070bacf WatchSource:0}: Error finding container 6cdbc8f1fd0151343c90b6a762fbc0a7205b9b480dce90a71d84df2ca070bacf: Status 404 returned error can't find the container with id 6cdbc8f1fd0151343c90b6a762fbc0a7205b9b480dce90a71d84df2ca070bacf Jul 24 04:00:25.292876 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:25.292854 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc42fe3_ed20_4ad7_9d57_48a641386372.slice/crio-256915cef18709ac4f9c0f8cd61d4677dc09c74684143e6daa5365c596fec834 WatchSource:0}: Error finding container 256915cef18709ac4f9c0f8cd61d4677dc09c74684143e6daa5365c596fec834: Status 404 returned error can't find the container with id 256915cef18709ac4f9c0f8cd61d4677dc09c74684143e6daa5365c596fec834 Jul 24 04:00:25.294554 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:25.294047 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57155d90_234f_4763_9688_382e925a8f4c.slice/crio-1475a504783b9c68a9e4bfb766c23e4d95a8d38c348b98e04c62ba153475e1bb WatchSource:0}: Error finding container 1475a504783b9c68a9e4bfb766c23e4d95a8d38c348b98e04c62ba153475e1bb: Status 404 returned error can't find the container with id 1475a504783b9c68a9e4bfb766c23e4d95a8d38c348b98e04c62ba153475e1bb Jul 24 04:00:25.295103 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:25.295067 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeace775d_a1c8_402b_8a65_95d2d83fea13.slice/crio-18eb23161c7849ff5ee154cc27ee7752f9a455da67a794f88a0480efffe69536 WatchSource:0}: Error finding container 18eb23161c7849ff5ee154cc27ee7752f9a455da67a794f88a0480efffe69536: Status 404 returned error can't find the container with id 18eb23161c7849ff5ee154cc27ee7752f9a455da67a794f88a0480efffe69536 Jul 24 04:00:25.391286 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.391246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.391306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.391331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.391372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5hk2c\" (UID: \"16cb44d8-ec27-491f-9060-e6bcf27532ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.391402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:25.391411 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:25.391419 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:25.391443 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9697474c5-4nkzn: secret "image-registry-tls" not found Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.391442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:25.391477 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls podName:b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:27.391460783 +0000 UTC m=+39.625160432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-jm9dk" (UID: "b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7") : secret "cluster-monitoring-operator-tls" not found Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:25.391495 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:25.391509 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls podName:31f95900-8dd8-4926-a3c1-5f74dbf8a767 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:27.39149253 +0000 UTC m=+39.625192180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls") pod "image-registry-9697474c5-4nkzn" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767") : secret "image-registry-tls" not found Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:25.391521 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:25.391566 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 04:00:25.391742 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:25.391526 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle podName:75c0a7c0-765e-465f-ab9e-54e18fa72aa1 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:27.391518328 +0000 UTC m=+39.625217980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle") pod "router-default-7f554cdb4c-tn48f" (UID: "75c0a7c0-765e-465f-ab9e-54e18fa72aa1") : configmap references non-existent config key: service-ca.crt Jul 24 04:00:25.392198 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:25.391597 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs podName:75c0a7c0-765e-465f-ab9e-54e18fa72aa1 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:27.391582869 +0000 UTC m=+39.625282533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs") pod "router-default-7f554cdb4c-tn48f" (UID: "75c0a7c0-765e-465f-ab9e-54e18fa72aa1") : secret "router-metrics-certs-default" not found Jul 24 04:00:25.392198 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:25.391615 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls podName:16cb44d8-ec27-491f-9060-e6bcf27532ac nodeName:}" failed. No retries permitted until 2026-07-24 04:00:27.391605373 +0000 UTC m=+39.625305022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls") pod "cluster-samples-operator-6748489656-5hk2c" (UID: "16cb44d8-ec27-491f-9060-e6bcf27532ac") : secret "samples-operator-tls" not found Jul 24 04:00:25.392198 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:25.391654 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls podName:d450efc4-763a-445e-9db9-64ba3c11b3da nodeName:}" failed. No retries permitted until 2026-07-24 04:00:27.391649392 +0000 UTC m=+39.625349041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls") pod "dns-default-2pcmq" (UID: "d450efc4-763a-445e-9db9-64ba3c11b3da") : secret "dns-default-metrics-tls" not found Jul 24 04:00:25.419567 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.419538 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" event={"ID":"1b21f1d6-912d-4b75-9f72-4f218c0e49d1","Type":"ContainerStarted","Data":"a0c0660311f8b5b2695768c2ebd619d32e349fd3709f709ad2e52c05b445b24b"} Jul 24 04:00:25.420641 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.420615 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" event={"ID":"cbc42fe3-ed20-4ad7-9d57-48a641386372","Type":"ContainerStarted","Data":"256915cef18709ac4f9c0f8cd61d4677dc09c74684143e6daa5365c596fec834"} Jul 24 04:00:25.421699 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.421678 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-knxzz" event={"ID":"afe68fdb-5c92-47ca-835a-76ca67c958f5","Type":"ContainerStarted","Data":"6cdbc8f1fd0151343c90b6a762fbc0a7205b9b480dce90a71d84df2ca070bacf"} Jul 24 04:00:25.422640 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.422621 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8wlb8" event={"ID":"d26bd751-182b-4dc4-8bf3-39cfb76a5e86","Type":"ContainerStarted","Data":"1ddbdd517ce3bf9645b0b115c1417518e27c51aebaabba0a2825b0f0bfefd399"} Jul 24 04:00:25.423586 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.423569 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-lwm4l" event={"ID":"eace775d-a1c8-402b-8a65-95d2d83fea13","Type":"ContainerStarted","Data":"18eb23161c7849ff5ee154cc27ee7752f9a455da67a794f88a0480efffe69536"} Jul 24 04:00:25.424525 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.424498 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" event={"ID":"1561bcc1-5514-4507-bf7d-8c6bc3bb204b","Type":"ContainerStarted","Data":"c2d00d3fb4028508f31b191ad05f3ec4d64848b27b8e8d43bf8abb5a33d5b086"} Jul 24 04:00:25.427294 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.427122 2578 generic.go:356] "Generic (PLEG): container finished" podID="74107bd8-aa9c-4f18-9306-f9c41ec9f370" containerID="2f652a7646b5a0a4f5bf557b65dc188317aca4fd9e5d5c95f60ee2947d6b38be" exitCode=0 Jul 24 04:00:25.427382 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.427200 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2slfs" event={"ID":"74107bd8-aa9c-4f18-9306-f9c41ec9f370","Type":"ContainerDied","Data":"2f652a7646b5a0a4f5bf557b65dc188317aca4fd9e5d5c95f60ee2947d6b38be"} Jul 24 04:00:25.428423 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.428401 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" event={"ID":"bb7ca265-f76f-400f-a799-958859d3553a","Type":"ContainerStarted","Data":"7bbf9f91da5beb6270d97baf54d924b39cd81e28c438e655e50eff78e4e8755a"} Jul 24 04:00:25.429495 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.429470 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" event={"ID":"d7e5f257-bd10-4823-bd94-d72dee0b5cf7","Type":"ContainerStarted","Data":"01af65dfc92478e98b71a538657b5ef3eb684edac9143e94b3bbc40102f36be0"} Jul 24 04:00:25.430699 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.430673 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jk2zf" event={"ID":"57155d90-234f-4763-9688-382e925a8f4c","Type":"ContainerStarted","Data":"1475a504783b9c68a9e4bfb766c23e4d95a8d38c348b98e04c62ba153475e1bb"} Jul 24 04:00:25.431735 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:25.431719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp" event={"ID":"bcd20cd8-e85e-4773-a30e-e2faaae651c1","Type":"ContainerStarted","Data":"c5c5a3db396a80f47c2efb0cc548b60d40f57fd621f771d61de06703d0868d1b"} Jul 24 04:00:26.448598 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:26.448545 2578 generic.go:356] "Generic (PLEG): container finished" podID="74107bd8-aa9c-4f18-9306-f9c41ec9f370" containerID="db55610963d7775d2fceee801249bd1ae5716856bac8cc7b92f9a7dd34da559b" exitCode=0 Jul 24 04:00:26.448598 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:26.448651 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2slfs" event={"ID":"74107bd8-aa9c-4f18-9306-f9c41ec9f370","Type":"ContainerDied","Data":"db55610963d7775d2fceee801249bd1ae5716856bac8cc7b92f9a7dd34da559b"} Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:27.420470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:27.420587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:27.420654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:27.420699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:27.420735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:27.420800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5hk2c\" (UID: \"16cb44d8-ec27-491f-9060-e6bcf27532ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:27.420986 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:27.421056 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls podName:16cb44d8-ec27-491f-9060-e6bcf27532ac nodeName:}" failed. No retries permitted until 2026-07-24 04:00:31.421035539 +0000 UTC m=+43.654735193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls") pod "cluster-samples-operator-6748489656-5hk2c" (UID: "16cb44d8-ec27-491f-9060-e6bcf27532ac") : secret "samples-operator-tls" not found Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:27.421507 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:27.421563 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls podName:d450efc4-763a-445e-9db9-64ba3c11b3da nodeName:}" failed. No retries permitted until 2026-07-24 04:00:31.421543622 +0000 UTC m=+43.655243291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls") pod "dns-default-2pcmq" (UID: "d450efc4-763a-445e-9db9-64ba3c11b3da") : secret "dns-default-metrics-tls" not found Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:27.421634 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle podName:75c0a7c0-765e-465f-ab9e-54e18fa72aa1 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:31.421622617 +0000 UTC m=+43.655322271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle") pod "router-default-7f554cdb4c-tn48f" (UID: "75c0a7c0-765e-465f-ab9e-54e18fa72aa1") : configmap references non-existent config key: service-ca.crt Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:27.421703 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 04:00:27.422087 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:27.421715 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9697474c5-4nkzn: secret "image-registry-tls" not found Jul 24 04:00:27.422798 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:27.421745 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls podName:31f95900-8dd8-4926-a3c1-5f74dbf8a767 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:31.421734597 +0000 UTC m=+43.655434263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls") pod "image-registry-9697474c5-4nkzn" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767") : secret "image-registry-tls" not found Jul 24 04:00:27.422798 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:27.421812 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 04:00:27.422798 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:27.421843 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls podName:b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:31.421832956 +0000 UTC m=+43.655532606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-jm9dk" (UID: "b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7") : secret "cluster-monitoring-operator-tls" not found Jul 24 04:00:27.422798 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:27.421916 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 04:00:27.422798 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:27.421946 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs podName:75c0a7c0-765e-465f-ab9e-54e18fa72aa1 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:31.421935674 +0000 UTC m=+43.655635324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs") pod "router-default-7f554cdb4c-tn48f" (UID: "75c0a7c0-765e-465f-ab9e-54e18fa72aa1") : secret "router-metrics-certs-default" not found Jul 24 04:00:27.477843 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:27.477747 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:27.511021 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:27.510287 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2slfs" event={"ID":"74107bd8-aa9c-4f18-9306-f9c41ec9f370","Type":"ContainerStarted","Data":"9f0540c7250b81270bafb199c54c8630ac991a20f14ca5bff54974c36f50b9e4"} Jul 24 04:00:27.535718 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:27.535656 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2slfs" podStartSLOduration=8.310316841 podStartE2EDuration="39.535634271s" totalImagesPullingTime="31.22531743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:59:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:27.533428137 +0000 UTC m=+39.767127811" watchObservedRunningTime="2026-07-24 04:00:27.535634271 +0000 UTC m=+39.769333949" Jul 24 04:00:27.567538 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:27.567501 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:27.657938 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:27.657822 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:27.762403 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:27.762344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:31.465827 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:31.465787 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:31.465872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:31.465934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:31.465961 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:31.465995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:31.466031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:31.466055 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls podName:d450efc4-763a-445e-9db9-64ba3c11b3da nodeName:}" failed. No retries permitted until 2026-07-24 04:00:39.466031689 +0000 UTC m=+51.699731345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls") pod "dns-default-2pcmq" (UID: "d450efc4-763a-445e-9db9-64ba3c11b3da") : secret "dns-default-metrics-tls" not found Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:31.466086 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:31.466107 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9697474c5-4nkzn: secret "image-registry-tls" not found Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:31.466107 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle podName:75c0a7c0-765e-465f-ab9e-54e18fa72aa1 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:39.466077821 +0000 UTC m=+51.699777477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle") pod "router-default-7f554cdb4c-tn48f" (UID: "75c0a7c0-765e-465f-ab9e-54e18fa72aa1") : configmap references non-existent config key: service-ca.crt Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:31.466152 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:31.466179 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls podName:31f95900-8dd8-4926-a3c1-5f74dbf8a767 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:39.466163703 +0000 UTC m=+51.699863358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls") pod "image-registry-9697474c5-4nkzn" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767") : secret "image-registry-tls" not found Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:31.466193 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 04:00:31.466479 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:31.466210 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls podName:b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:39.466200508 +0000 UTC m=+51.699900157 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-jm9dk" (UID: "b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7") : secret "cluster-monitoring-operator-tls" not found Jul 24 04:00:31.466949 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:31.466282 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs podName:75c0a7c0-765e-465f-ab9e-54e18fa72aa1 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:39.466265649 +0000 UTC m=+51.699965301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs") pod "router-default-7f554cdb4c-tn48f" (UID: "75c0a7c0-765e-465f-ab9e-54e18fa72aa1") : secret "router-metrics-certs-default" not found Jul 24 04:00:31.466949 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:31.466341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5hk2c\" (UID: \"16cb44d8-ec27-491f-9060-e6bcf27532ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:31.466949 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:31.466461 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 04:00:31.466949 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:31.466494 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls podName:16cb44d8-ec27-491f-9060-e6bcf27532ac nodeName:}" failed. No retries permitted until 2026-07-24 04:00:39.466484225 +0000 UTC m=+51.700183890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls") pod "cluster-samples-operator-6748489656-5hk2c" (UID: "16cb44d8-ec27-491f-9060-e6bcf27532ac") : secret "samples-operator-tls" not found Jul 24 04:00:33.311678 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:33.311639 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:33.388806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:33.388762 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:34.540072 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:34.540038 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5"] Jul 24 04:00:34.552283 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:34.552254 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5"] Jul 24 04:00:34.552434 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:34.552346 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:00:34.555138 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:34.555112 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 24 04:00:34.555283 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:34.555151 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 24 04:00:34.555283 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:34.555174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-q2vwr\"" Jul 24 04:00:34.597988 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:34.597932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bbf36a72-fb4a-4c25-b2eb-692d5184d481-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-lsgk5\" (UID: \"bbf36a72-fb4a-4c25-b2eb-692d5184d481\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:00:34.598139 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:34.598005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lsgk5\" (UID: \"bbf36a72-fb4a-4c25-b2eb-692d5184d481\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:00:34.699999 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:34.699308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bbf36a72-fb4a-4c25-b2eb-692d5184d481-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-lsgk5\" (UID: \"bbf36a72-fb4a-4c25-b2eb-692d5184d481\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:00:34.699999 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:34.699406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lsgk5\" (UID: \"bbf36a72-fb4a-4c25-b2eb-692d5184d481\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:00:34.699999 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:34.699768 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 04:00:34.699999 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:34.699889 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert podName:bbf36a72-fb4a-4c25-b2eb-692d5184d481 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:35.199863697 +0000 UTC m=+47.433563367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lsgk5" (UID: "bbf36a72-fb4a-4c25-b2eb-692d5184d481") : secret "networking-console-plugin-cert" not found Jul 24 04:00:34.702501 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:34.700766 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bbf36a72-fb4a-4c25-b2eb-692d5184d481-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-lsgk5\" (UID: \"bbf36a72-fb4a-4c25-b2eb-692d5184d481\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:00:35.204505 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:35.204461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lsgk5\" (UID: \"bbf36a72-fb4a-4c25-b2eb-692d5184d481\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:00:35.204714 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:35.204624 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 04:00:35.204791 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:35.204717 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert podName:bbf36a72-fb4a-4c25-b2eb-692d5184d481 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:36.204694185 +0000 UTC m=+48.438393834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lsgk5" (UID: "bbf36a72-fb4a-4c25-b2eb-692d5184d481") : secret "networking-console-plugin-cert" not found Jul 24 04:00:36.213234 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:36.213191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lsgk5\" (UID: \"bbf36a72-fb4a-4c25-b2eb-692d5184d481\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:00:36.213692 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:36.213367 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 04:00:36.213692 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:36.213489 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert podName:bbf36a72-fb4a-4c25-b2eb-692d5184d481 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:38.213465434 +0000 UTC m=+50.447165088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lsgk5" (UID: "bbf36a72-fb4a-4c25-b2eb-692d5184d481") : secret "networking-console-plugin-cert" not found Jul 24 04:00:38.234884 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:38.234842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lsgk5\" (UID: \"bbf36a72-fb4a-4c25-b2eb-692d5184d481\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:00:38.235355 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:38.235040 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 04:00:38.235355 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:38.235128 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert podName:bbf36a72-fb4a-4c25-b2eb-692d5184d481 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:42.235105161 +0000 UTC m=+54.468804817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lsgk5" (UID: "bbf36a72-fb4a-4c25-b2eb-692d5184d481") : secret "networking-console-plugin-cert" not found Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.549853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.549914 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.549948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.550020 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5hk2c\" (UID: \"16cb44d8-ec27-491f-9060-e6bcf27532ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.550066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.550127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:39.550284 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle podName:75c0a7c0-765e-465f-ab9e-54e18fa72aa1 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:55.550264972 +0000 UTC m=+67.783964629 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle") pod "router-default-7f554cdb4c-tn48f" (UID: "75c0a7c0-765e-465f-ab9e-54e18fa72aa1") : configmap references non-existent config key: service-ca.crt Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:39.550682 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:39.550698 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9697474c5-4nkzn: secret "image-registry-tls" not found Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:39.550737 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls podName:31f95900-8dd8-4926-a3c1-5f74dbf8a767 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:55.550723945 +0000 UTC m=+67.784423599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls") pod "image-registry-9697474c5-4nkzn" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767") : secret "image-registry-tls" not found Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:39.550792 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:39.550824 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls podName:b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:55.550814812 +0000 UTC m=+67.784514467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-jm9dk" (UID: "b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7") : secret "cluster-monitoring-operator-tls" not found Jul 24 04:00:39.551116 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:39.550870 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 04:00:39.552281 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:39.550897 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs podName:75c0a7c0-765e-465f-ab9e-54e18fa72aa1 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:55.550888205 +0000 UTC m=+67.784587860 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs") pod "router-default-7f554cdb4c-tn48f" (UID: "75c0a7c0-765e-465f-ab9e-54e18fa72aa1") : secret "router-metrics-certs-default" not found Jul 24 04:00:39.552281 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:39.550951 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 04:00:39.552281 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:39.551009 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls podName:16cb44d8-ec27-491f-9060-e6bcf27532ac nodeName:}" failed. No retries permitted until 2026-07-24 04:00:55.551000311 +0000 UTC m=+67.784699966 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls") pod "cluster-samples-operator-6748489656-5hk2c" (UID: "16cb44d8-ec27-491f-9060-e6bcf27532ac") : secret "samples-operator-tls" not found Jul 24 04:00:39.552281 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:39.551062 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 04:00:39.552281 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:39.551086 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls podName:d450efc4-763a-445e-9db9-64ba3c11b3da nodeName:}" failed. No retries permitted until 2026-07-24 04:00:55.551077665 +0000 UTC m=+67.784777320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls") pod "dns-default-2pcmq" (UID: "d450efc4-763a-445e-9db9-64ba3c11b3da") : secret "dns-default-metrics-tls" not found Jul 24 04:00:39.570200 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.570161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp" event={"ID":"bcd20cd8-e85e-4773-a30e-e2faaae651c1","Type":"ContainerStarted","Data":"c0092274eb1cdf41064e0efca7dad49fbfb1556f919e73d407cc5872380af167"} Jul 24 04:00:39.575997 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.572999 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" event={"ID":"1b21f1d6-912d-4b75-9f72-4f218c0e49d1","Type":"ContainerStarted","Data":"b3e1425aa4b36b92d8c57d308c87280ce18a9be7b851ce00007b13d5faa11f7a"} Jul 24 04:00:39.575997 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.573828 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:39.576836 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.576400 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" Jul 24 04:00:39.579310 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.579114 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/0.log" Jul 24 04:00:39.579310 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.579151 2578 generic.go:356] "Generic (PLEG): container finished" podID="cbc42fe3-ed20-4ad7-9d57-48a641386372" containerID="e85b23b93309bb9e53e3c17935635e642f68cc307589b4c855012023991e45ab" exitCode=255 Jul 24 04:00:39.579310 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.579239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" event={"ID":"cbc42fe3-ed20-4ad7-9d57-48a641386372","Type":"ContainerDied","Data":"e85b23b93309bb9e53e3c17935635e642f68cc307589b4c855012023991e45ab"} Jul 24 04:00:39.579877 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.579839 2578 scope.go:117] "RemoveContainer" containerID="e85b23b93309bb9e53e3c17935635e642f68cc307589b4c855012023991e45ab" Jul 24 04:00:39.584839 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.584346 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-knxzz" event={"ID":"afe68fdb-5c92-47ca-835a-76ca67c958f5","Type":"ContainerStarted","Data":"34fd0b100c7da2a99f14a00ce830e20482f67e53523034617e0a51405bc53738"} Jul 24 04:00:39.589772 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.588685 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c488b48d-grmfp" podStartSLOduration=1.7659507250000002 podStartE2EDuration="15.588666435s" totalImagesPullingTime="13.82271571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:39.587603482 +0000 UTC m=+51.821303154" watchObservedRunningTime="2026-07-24 04:00:39.588666435 +0000 UTC m=+51.822366088" Jul 24 04:00:39.596987 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.596910 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8wlb8" event={"ID":"d26bd751-182b-4dc4-8bf3-39cfb76a5e86","Type":"ContainerStarted","Data":"c806e683c46b582d0413086251731b98b749b2f6f788b624259194318fae74b6"} Jul 24 04:00:39.600235 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.600082 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-lwm4l" event={"ID":"eace775d-a1c8-402b-8a65-95d2d83fea13","Type":"ContainerStarted","Data":"993e222d3cd64cee3b8338cbc1dabcc9e6f79faa16355810b09f9846322171a1"} Jul 24 04:00:39.610649 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.609054 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" event={"ID":"1561bcc1-5514-4507-bf7d-8c6bc3bb204b","Type":"ContainerStarted","Data":"778afb5c3ad14ceec7d1779b4e0fda273c6a51904572ab8b23a27e83f25ea2bf"} Jul 24 04:00:39.610892 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.610848 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" event={"ID":"1561bcc1-5514-4507-bf7d-8c6bc3bb204b","Type":"ContainerStarted","Data":"ca507fe199b20bd28a414020dcdaa69a288b665d379e463ee7cb3a531ee702e1"} Jul 24 04:00:39.620033 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.618713 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" event={"ID":"bb7ca265-f76f-400f-a799-958859d3553a","Type":"ContainerStarted","Data":"2487a73dd90722628a4c5fe245983357df1ab0347a0053110c1d9097269e4bb9"} Jul 24 04:00:39.622515 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.622031 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" event={"ID":"d7e5f257-bd10-4823-bd94-d72dee0b5cf7","Type":"ContainerStarted","Data":"d064a196d93d4d3d599a618647aa77470ad9d52423ee426afccae75e05fc66e5"} Jul 24 04:00:39.627094 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.625177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jk2zf" event={"ID":"57155d90-234f-4763-9688-382e925a8f4c","Type":"ContainerStarted","Data":"182df0249a0a79622bd9a87664f01c45a59f3a872e823db5545aa0e76cabb8a1"} Jul 24 04:00:39.632387 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.632339 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-knxzz" podStartSLOduration=12.801321116 podStartE2EDuration="26.632320309s" totalImagesPullingTime="13.830999193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:39.631515873 +0000 UTC m=+51.865215546" watchObservedRunningTime="2026-07-24 04:00:39.632320309 +0000 UTC m=+51.866019982" Jul 24 04:00:39.655473 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.655402 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d945845c5-r7lps" podStartSLOduration=1.824935931 podStartE2EDuration="15.655380358s" totalImagesPullingTime="13.830444427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:39.648597714 +0000 UTC m=+51.882297390" watchObservedRunningTime="2026-07-24 04:00:39.655380358 +0000 UTC m=+51.889080028" Jul 24 04:00:39.703030 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.702313 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" podStartSLOduration=12.871462536 podStartE2EDuration="26.702289303s" totalImagesPullingTime="13.830826767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:39.699991585 +0000 UTC m=+51.933691250" watchObservedRunningTime="2026-07-24 04:00:39.702289303 +0000 UTC m=+51.935988977" Jul 24 04:00:39.739712 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.739650 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-jk2zf" podStartSLOduration=12.959687696 podStartE2EDuration="26.739627449s" totalImagesPullingTime="13.779939753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:39.720510515 +0000 UTC m=+51.954210188" watchObservedRunningTime="2026-07-24 04:00:39.739627449 +0000 UTC m=+51.973327123" Jul 24 04:00:39.760769 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.760713 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-lwm4l" podStartSLOduration=12.982893129 podStartE2EDuration="26.760691963s" totalImagesPullingTime="13.777798834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:39.741495592 +0000 UTC m=+51.975195247" watchObservedRunningTime="2026-07-24 04:00:39.760691963 +0000 UTC m=+51.994391636" Jul 24 04:00:39.785056 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.783319 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" podStartSLOduration=12.959578217 podStartE2EDuration="26.783295656s" totalImagesPullingTime="13.823717439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:39.761508541 +0000 UTC m=+51.995208214" watchObservedRunningTime="2026-07-24 04:00:39.783295656 +0000 UTC m=+52.016995328" Jul 24 04:00:39.897358 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:39.897311 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:40.523666 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.523596 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8wlb8" podStartSLOduration=3.70881246 podStartE2EDuration="17.523569834s" totalImagesPullingTime="13.814757374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:39.793143236 +0000 UTC m=+52.026842909" watchObservedRunningTime="2026-07-24 04:00:40.523569834 +0000 UTC m=+52.757269508" Jul 24 04:00:40.525007 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.524955 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kxlkj"] Jul 24 04:00:40.546304 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.546208 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kxlkj"] Jul 24 04:00:40.546519 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.546339 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.549269 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.549056 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 04:00:40.549269 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.549127 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 04:00:40.549269 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.549159 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tzqn7\"" Jul 24 04:00:40.556880 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.556829 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:40.631269 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.631239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/1.log" Jul 24 04:00:40.631773 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.631755 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/0.log" Jul 24 04:00:40.631881 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.631800 2578 generic.go:356] "Generic (PLEG): container finished" podID="cbc42fe3-ed20-4ad7-9d57-48a641386372" containerID="fc16fb8dc748660643701f091121b3555ff02e30f6e4649445a33a3343b33ece" exitCode=255 Jul 24 04:00:40.631881 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.631860 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" event={"ID":"cbc42fe3-ed20-4ad7-9d57-48a641386372","Type":"ContainerDied","Data":"fc16fb8dc748660643701f091121b3555ff02e30f6e4649445a33a3343b33ece"} Jul 24 04:00:40.631995 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.631937 2578 scope.go:117] "RemoveContainer" containerID="e85b23b93309bb9e53e3c17935635e642f68cc307589b4c855012023991e45ab" Jul 24 04:00:40.632196 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.632181 2578 scope.go:117] "RemoveContainer" containerID="fc16fb8dc748660643701f091121b3555ff02e30f6e4649445a33a3343b33ece" Jul 24 04:00:40.632408 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:40.632387 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-s44kl_openshift-console-operator(cbc42fe3-ed20-4ad7-9d57-48a641386372)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" podUID="cbc42fe3-ed20-4ad7-9d57-48a641386372" Jul 24 04:00:40.634412 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.634387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" event={"ID":"1561bcc1-5514-4507-bf7d-8c6bc3bb204b","Type":"ContainerStarted","Data":"4b8b6631c37a1c0152e3d823a09a0e1737920d158a920e55741dfa237ded5277"} Jul 24 04:00:40.654529 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.654491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:40.663249 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.663224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/325d30ed-fb31-40cf-ac93-902eca0bf5ce-data-volume\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.663350 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.663273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.663350 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.663311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/325d30ed-fb31-40cf-ac93-902eca0bf5ce-crio-socket\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.663425 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.663397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h72jj\" (UniqueName: \"kubernetes.io/projected/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-api-access-h72jj\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.663468 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.663454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.665730 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.665675 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" podStartSLOduration=2.842578322 podStartE2EDuration="16.665653533s" totalImagesPullingTime="13.823075211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:40.66461349 +0000 UTC m=+52.898313162" watchObservedRunningTime="2026-07-24 04:00:40.665653533 +0000 UTC m=+52.899353207" Jul 24 04:00:40.710104 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.710050 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:40.764400 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.764356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.764624 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:40.764456 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 04:00:40.764755 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:40.764686 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls podName:325d30ed-fb31-40cf-ac93-902eca0bf5ce nodeName:}" failed. No retries permitted until 2026-07-24 04:00:41.264661071 +0000 UTC m=+53.498360726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kxlkj" (UID: "325d30ed-fb31-40cf-ac93-902eca0bf5ce") : secret "insights-runtime-extractor-tls" not found Jul 24 04:00:40.764834 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.764810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/325d30ed-fb31-40cf-ac93-902eca0bf5ce-crio-socket\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.764924 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.764891 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/325d30ed-fb31-40cf-ac93-902eca0bf5ce-crio-socket\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.765616 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.765263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h72jj\" (UniqueName: \"kubernetes.io/projected/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-api-access-h72jj\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.765748 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.765648 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.765902 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.765875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/325d30ed-fb31-40cf-ac93-902eca0bf5ce-data-volume\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.766174 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:40.766148 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 04:00:40.766256 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:40.766210 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm podName:325d30ed-fb31-40cf-ac93-902eca0bf5ce nodeName:}" failed. No retries permitted until 2026-07-24 04:00:41.266194606 +0000 UTC m=+53.499894258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kxlkj" (UID: "325d30ed-fb31-40cf-ac93-902eca0bf5ce") : configmap "kube-rbac-proxy" not found Jul 24 04:00:40.766256 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.766223 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/325d30ed-fb31-40cf-ac93-902eca0bf5ce-data-volume\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:40.778059 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:40.777975 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h72jj\" (UniqueName: \"kubernetes.io/projected/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-api-access-h72jj\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:41.108136 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.108045 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:41.200125 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.200088 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-hkg9q"] Jul 24 04:00:41.205127 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.205064 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:41.234381 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.234343 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-hkg9q"] Jul 24 04:00:41.234381 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.234396 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hkg9q" Jul 24 04:00:41.236720 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.236693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 24 04:00:41.237857 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.237826 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cff27\"" Jul 24 04:00:41.237857 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.237846 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 24 04:00:41.267544 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.267505 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:41.270587 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.270564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:41.270685 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.270670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:41.270685 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:41.270675 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 04:00:41.270765 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:41.270730 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm podName:325d30ed-fb31-40cf-ac93-902eca0bf5ce nodeName:}" failed. No retries permitted until 2026-07-24 04:00:42.270715232 +0000 UTC m=+54.504414882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kxlkj" (UID: "325d30ed-fb31-40cf-ac93-902eca0bf5ce") : configmap "kube-rbac-proxy" not found Jul 24 04:00:41.270816 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:41.270787 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 04:00:41.270863 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:41.270854 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls podName:325d30ed-fb31-40cf-ac93-902eca0bf5ce nodeName:}" failed. No retries permitted until 2026-07-24 04:00:42.270841405 +0000 UTC m=+54.504541056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kxlkj" (UID: "325d30ed-fb31-40cf-ac93-902eca0bf5ce") : secret "insights-runtime-extractor-tls" not found Jul 24 04:00:41.368249 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.368161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:41.371275 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.371249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qstjb\" (UniqueName: \"kubernetes.io/projected/0781f412-c116-4124-9092-c6f0a2bcd90c-kube-api-access-qstjb\") pod \"migrator-6865c9967-hkg9q\" (UID: \"0781f412-c116-4124-9092-c6f0a2bcd90c\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hkg9q" Jul 24 04:00:41.468646 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.468613 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:41.472823 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.472796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qstjb\" (UniqueName: \"kubernetes.io/projected/0781f412-c116-4124-9092-c6f0a2bcd90c-kube-api-access-qstjb\") pod \"migrator-6865c9967-hkg9q\" (UID: \"0781f412-c116-4124-9092-c6f0a2bcd90c\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hkg9q" Jul 24 04:00:41.481185 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.481156 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qstjb\" (UniqueName: \"kubernetes.io/projected/0781f412-c116-4124-9092-c6f0a2bcd90c-kube-api-access-qstjb\") pod \"migrator-6865c9967-hkg9q\" (UID: \"0781f412-c116-4124-9092-c6f0a2bcd90c\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hkg9q" Jul 24 04:00:41.544636 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.544592 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hkg9q" Jul 24 04:00:41.643346 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.643254 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/1.log" Jul 24 04:00:41.643776 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.643655 2578 scope.go:117] "RemoveContainer" containerID="fc16fb8dc748660643701f091121b3555ff02e30f6e4649445a33a3343b33ece" Jul 24 04:00:41.643847 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:41.643827 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-s44kl_openshift-console-operator(cbc42fe3-ed20-4ad7-9d57-48a641386372)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" podUID="cbc42fe3-ed20-4ad7-9d57-48a641386372" Jul 24 04:00:41.699278 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.699233 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-hkg9q"] Jul 24 04:00:41.703048 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:41.703016 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0781f412_c116_4124_9092_c6f0a2bcd90c.slice/crio-f1aabb4ac281ae030d7132b691b1c081f04b1b00ff6692ee882b56e0326ddc22 WatchSource:0}: Error finding container f1aabb4ac281ae030d7132b691b1c081f04b1b00ff6692ee882b56e0326ddc22: Status 404 returned error can't find the container with id f1aabb4ac281ae030d7132b691b1c081f04b1b00ff6692ee882b56e0326ddc22 Jul 24 04:00:41.927141 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:41.927058 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vgwxn_4c051de6-a3da-40e6-b9d6-577438554204/dns-node-resolver/0.log" Jul 24 04:00:42.281992 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.281936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:42.282234 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:42.282097 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 04:00:42.282234 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.282126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:42.282234 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:42.282168 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls podName:325d30ed-fb31-40cf-ac93-902eca0bf5ce nodeName:}" failed. No retries permitted until 2026-07-24 04:00:44.282146674 +0000 UTC m=+56.515846331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kxlkj" (UID: "325d30ed-fb31-40cf-ac93-902eca0bf5ce") : secret "insights-runtime-extractor-tls" not found Jul 24 04:00:42.282234 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:42.282202 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 04:00:42.282234 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.282208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lsgk5\" (UID: \"bbf36a72-fb4a-4c25-b2eb-692d5184d481\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:00:42.282527 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:42.282241 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm podName:325d30ed-fb31-40cf-ac93-902eca0bf5ce nodeName:}" failed. No retries permitted until 2026-07-24 04:00:44.282228667 +0000 UTC m=+56.515928320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kxlkj" (UID: "325d30ed-fb31-40cf-ac93-902eca0bf5ce") : configmap "kube-rbac-proxy" not found Jul 24 04:00:42.282527 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:42.282305 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 04:00:42.282527 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:42.282378 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert podName:bbf36a72-fb4a-4c25-b2eb-692d5184d481 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:50.282360982 +0000 UTC m=+62.516060637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lsgk5" (UID: "bbf36a72-fb4a-4c25-b2eb-692d5184d481") : secret "networking-console-plugin-cert" not found Jul 24 04:00:42.525948 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.525913 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nqgm4_3b492c24-539e-4502-b99c-92ce1a38f866/node-ca/0.log" Jul 24 04:00:42.648655 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.648565 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hkg9q" event={"ID":"0781f412-c116-4124-9092-c6f0a2bcd90c","Type":"ContainerStarted","Data":"f1aabb4ac281ae030d7132b691b1c081f04b1b00ff6692ee882b56e0326ddc22"} Jul 24 04:00:42.956179 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.956089 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-vr2dt"] Jul 24 04:00:42.960123 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.960088 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" Jul 24 04:00:42.962780 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.962752 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 24 04:00:42.963068 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.963046 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 24 04:00:42.963170 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.963057 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mwcck\"" Jul 24 04:00:42.963871 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.963847 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 24 04:00:42.964049 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.963849 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 24 04:00:42.968031 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:42.968005 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-vr2dt"] Jul 24 04:00:43.089950 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.089922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0a9572df-ade5-40a1-a42c-eefa7187f296-signing-cabundle\") pod \"service-ca-658d7b7c78-vr2dt\" (UID: \"0a9572df-ade5-40a1-a42c-eefa7187f296\") " pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" Jul 24 04:00:43.090125 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.090108 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0a9572df-ade5-40a1-a42c-eefa7187f296-signing-key\") pod \"service-ca-658d7b7c78-vr2dt\" (UID: \"0a9572df-ade5-40a1-a42c-eefa7187f296\") " pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" Jul 24 04:00:43.090181 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.090136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbw4t\" (UniqueName: \"kubernetes.io/projected/0a9572df-ade5-40a1-a42c-eefa7187f296-kube-api-access-jbw4t\") pod \"service-ca-658d7b7c78-vr2dt\" (UID: \"0a9572df-ade5-40a1-a42c-eefa7187f296\") " pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" Jul 24 04:00:43.190812 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.190773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0a9572df-ade5-40a1-a42c-eefa7187f296-signing-cabundle\") pod \"service-ca-658d7b7c78-vr2dt\" (UID: \"0a9572df-ade5-40a1-a42c-eefa7187f296\") " pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" Jul 24 04:00:43.191042 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.190879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0a9572df-ade5-40a1-a42c-eefa7187f296-signing-key\") pod \"service-ca-658d7b7c78-vr2dt\" (UID: \"0a9572df-ade5-40a1-a42c-eefa7187f296\") " pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" Jul 24 04:00:43.191042 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.190898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbw4t\" (UniqueName: \"kubernetes.io/projected/0a9572df-ade5-40a1-a42c-eefa7187f296-kube-api-access-jbw4t\") pod \"service-ca-658d7b7c78-vr2dt\" (UID: \"0a9572df-ade5-40a1-a42c-eefa7187f296\") " pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" Jul 24 04:00:43.191544 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.191517 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0a9572df-ade5-40a1-a42c-eefa7187f296-signing-cabundle\") pod \"service-ca-658d7b7c78-vr2dt\" (UID: \"0a9572df-ade5-40a1-a42c-eefa7187f296\") " pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" Jul 24 04:00:43.193506 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.193482 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0a9572df-ade5-40a1-a42c-eefa7187f296-signing-key\") pod \"service-ca-658d7b7c78-vr2dt\" (UID: \"0a9572df-ade5-40a1-a42c-eefa7187f296\") " pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" Jul 24 04:00:43.199460 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.199431 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbw4t\" (UniqueName: \"kubernetes.io/projected/0a9572df-ade5-40a1-a42c-eefa7187f296-kube-api-access-jbw4t\") pod \"service-ca-658d7b7c78-vr2dt\" (UID: \"0a9572df-ade5-40a1-a42c-eefa7187f296\") " pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" Jul 24 04:00:43.274346 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.274306 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" Jul 24 04:00:43.333476 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.333306 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8wlb8_d26bd751-182b-4dc4-8bf3-39cfb76a5e86/serve-healthcheck-canary/0.log" Jul 24 04:00:43.427710 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.427673 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-vr2dt"] Jul 24 04:00:43.431026 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:43.430959 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9572df_ade5_40a1_a42c_eefa7187f296.slice/crio-188ed8b76a62bfadb45fe5737f9d0d95f56e10ab46c84dbc623890bbdc581b9d WatchSource:0}: Error finding container 188ed8b76a62bfadb45fe5737f9d0d95f56e10ab46c84dbc623890bbdc581b9d: Status 404 returned error can't find the container with id 188ed8b76a62bfadb45fe5737f9d0d95f56e10ab46c84dbc623890bbdc581b9d Jul 24 04:00:43.654247 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.654150 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hkg9q" event={"ID":"0781f412-c116-4124-9092-c6f0a2bcd90c","Type":"ContainerStarted","Data":"1e25f476bd9dc2808475dd8084a66152e5b347671aff79f9554b033e6ba15224"} Jul 24 04:00:43.654247 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.654207 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hkg9q" event={"ID":"0781f412-c116-4124-9092-c6f0a2bcd90c","Type":"ContainerStarted","Data":"0ea076f9fbcdb6ecbde17d45b3cb27bbf5bc0605af0be588a4084fe8edbb8f33"} Jul 24 04:00:43.655736 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.655711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" event={"ID":"0a9572df-ade5-40a1-a42c-eefa7187f296","Type":"ContainerStarted","Data":"145e6f41b05d3d5d978a3838c98bfbdf96e06e50a90d9924fc6543003e1596b3"} Jul 24 04:00:43.655893 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.655746 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" event={"ID":"0a9572df-ade5-40a1-a42c-eefa7187f296","Type":"ContainerStarted","Data":"188ed8b76a62bfadb45fe5737f9d0d95f56e10ab46c84dbc623890bbdc581b9d"} Jul 24 04:00:43.672072 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.672018 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hkg9q" podStartSLOduration=1.348781504 podStartE2EDuration="2.672003361s" totalImagesPullingTime="1.323221857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:43.671251218 +0000 UTC m=+55.904950891" watchObservedRunningTime="2026-07-24 04:00:43.672003361 +0000 UTC m=+55.905703106" Jul 24 04:00:43.690100 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.690038 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-vr2dt" podStartSLOduration=1.6900150250000001 podStartE2EDuration="1.690015025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:43.689609003 +0000 UTC m=+55.923308676" watchObservedRunningTime="2026-07-24 04:00:43.690015025 +0000 UTC m=+55.923714699" Jul 24 04:00:43.954164 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.954062 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:43.954164 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.954135 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:00:43.954516 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:43.954502 2578 scope.go:117] "RemoveContainer" containerID="fc16fb8dc748660643701f091121b3555ff02e30f6e4649445a33a3343b33ece" Jul 24 04:00:43.954690 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:43.954672 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-s44kl_openshift-console-operator(cbc42fe3-ed20-4ad7-9d57-48a641386372)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" podUID="cbc42fe3-ed20-4ad7-9d57-48a641386372" Jul 24 04:00:44.302878 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:44.302831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:44.303156 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:44.303036 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 04:00:44.303156 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:44.303045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:44.303271 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:44.303156 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls podName:325d30ed-fb31-40cf-ac93-902eca0bf5ce nodeName:}" failed. No retries permitted until 2026-07-24 04:00:48.303135485 +0000 UTC m=+60.536835144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kxlkj" (UID: "325d30ed-fb31-40cf-ac93-902eca0bf5ce") : secret "insights-runtime-extractor-tls" not found Jul 24 04:00:44.303271 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:44.303182 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 04:00:44.303271 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:44.303249 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm podName:325d30ed-fb31-40cf-ac93-902eca0bf5ce nodeName:}" failed. No retries permitted until 2026-07-24 04:00:48.303235309 +0000 UTC m=+60.536934959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kxlkj" (UID: "325d30ed-fb31-40cf-ac93-902eca0bf5ce") : configmap "kube-rbac-proxy" not found Jul 24 04:00:48.348153 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:48.348110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:48.348640 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:48.348253 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 04:00:48.348640 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:48.348310 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:48.348640 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:48.348343 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm podName:325d30ed-fb31-40cf-ac93-902eca0bf5ce nodeName:}" failed. No retries permitted until 2026-07-24 04:00:56.348319095 +0000 UTC m=+68.582018774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kxlkj" (UID: "325d30ed-fb31-40cf-ac93-902eca0bf5ce") : configmap "kube-rbac-proxy" not found Jul 24 04:00:48.348640 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:48.348408 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 04:00:48.348640 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:48.348464 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls podName:325d30ed-fb31-40cf-ac93-902eca0bf5ce nodeName:}" failed. No retries permitted until 2026-07-24 04:00:56.348448652 +0000 UTC m=+68.582148310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kxlkj" (UID: "325d30ed-fb31-40cf-ac93-902eca0bf5ce") : secret "insights-runtime-extractor-tls" not found Jul 24 04:00:49.423433 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:49.423400 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pdjz5" Jul 24 04:00:50.368583 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:50.368538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lsgk5\" (UID: \"bbf36a72-fb4a-4c25-b2eb-692d5184d481\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:00:50.368771 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:50.368689 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 04:00:50.368771 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:50.368757 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert podName:bbf36a72-fb4a-4c25-b2eb-692d5184d481 nodeName:}" failed. No retries permitted until 2026-07-24 04:01:06.368741731 +0000 UTC m=+78.602441380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lsgk5" (UID: "bbf36a72-fb4a-4c25-b2eb-692d5184d481") : secret "networking-console-plugin-cert" not found Jul 24 04:00:54.005348 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.005298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:54.007827 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.007804 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 04:00:54.018250 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.018222 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfdaa993-a5f2-486b-be35-f6d04e6eb8f2-metrics-certs\") pod \"network-metrics-daemon-fn8hw\" (UID: \"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2\") " pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:54.076202 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.076168 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dtpl8\"" Jul 24 04:00:54.084337 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.084309 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fn8hw" Jul 24 04:00:54.106564 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.106534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:54.109296 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.109272 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 04:00:54.119790 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.119758 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68781720-31da-4036-97f5-d2bf5fcd0df0-original-pull-secret\") pod \"global-pull-secret-syncer-drhnf\" (UID: \"68781720-31da-4036-97f5-d2bf5fcd0df0\") " pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:54.207580 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.207543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxcrc\" (UniqueName: \"kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc\") pod \"network-check-target-mqtjx\" (UID: \"01a3813d-002f-4290-baea-b727e2272473\") " pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:54.210176 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.210152 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxcrc\" (UniqueName: \"kubernetes.io/projected/01a3813d-002f-4290-baea-b727e2272473-kube-api-access-fxcrc\") pod \"network-check-target-mqtjx\" (UID: \"01a3813d-002f-4290-baea-b727e2272473\") " pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:54.213515 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.213494 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fn8hw"] Jul 24 04:00:54.216553 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:54.216520 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfdaa993_a5f2_486b_be35_f6d04e6eb8f2.slice/crio-cf8fdbe0a292359d803b0ee856d7983b2900dfa489c45ce1d4b6bd8c7508badf WatchSource:0}: Error finding container cf8fdbe0a292359d803b0ee856d7983b2900dfa489c45ce1d4b6bd8c7508badf: Status 404 returned error can't find the container with id cf8fdbe0a292359d803b0ee856d7983b2900dfa489c45ce1d4b6bd8c7508badf Jul 24 04:00:54.384435 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.384356 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j89kf\"" Jul 24 04:00:54.389340 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.389322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drhnf" Jul 24 04:00:54.392764 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.392749 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:54.527961 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.527925 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mqtjx"] Jul 24 04:00:54.530949 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:54.530908 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a3813d_002f_4290_baea_b727e2272473.slice/crio-958d2887b34407577f03155c02427c18eb22a98d097fcb05c2ce9410f80ca0aa WatchSource:0}: Error finding container 958d2887b34407577f03155c02427c18eb22a98d097fcb05c2ce9410f80ca0aa: Status 404 returned error can't find the container with id 958d2887b34407577f03155c02427c18eb22a98d097fcb05c2ce9410f80ca0aa Jul 24 04:00:54.542947 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.542921 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-drhnf"] Jul 24 04:00:54.545213 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:54.545192 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68781720_31da_4036_97f5_d2bf5fcd0df0.slice/crio-550b89f3cfa416066f3ba8f309b7e70fec191256a4ba824283574114b71c246f WatchSource:0}: Error finding container 550b89f3cfa416066f3ba8f309b7e70fec191256a4ba824283574114b71c246f: Status 404 returned error can't find the container with id 550b89f3cfa416066f3ba8f309b7e70fec191256a4ba824283574114b71c246f Jul 24 04:00:54.697004 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.696891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fn8hw" event={"ID":"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2","Type":"ContainerStarted","Data":"cf8fdbe0a292359d803b0ee856d7983b2900dfa489c45ce1d4b6bd8c7508badf"} Jul 24 04:00:54.698175 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.698141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-drhnf" event={"ID":"68781720-31da-4036-97f5-d2bf5fcd0df0","Type":"ContainerStarted","Data":"550b89f3cfa416066f3ba8f309b7e70fec191256a4ba824283574114b71c246f"} Jul 24 04:00:54.699736 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.699711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mqtjx" event={"ID":"01a3813d-002f-4290-baea-b727e2272473","Type":"ContainerStarted","Data":"2f69b193acdff4ffbbfac15405e78a0419d8a04bb05a659f8beb00d1ad9d681b"} Jul 24 04:00:54.699882 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.699748 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mqtjx" event={"ID":"01a3813d-002f-4290-baea-b727e2272473","Type":"ContainerStarted","Data":"958d2887b34407577f03155c02427c18eb22a98d097fcb05c2ce9410f80ca0aa"} Jul 24 04:00:54.699882 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.699851 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:00:54.715183 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:54.715128 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mqtjx" podStartSLOduration=65.715111741 podStartE2EDuration="1m5.715111741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:59:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:54.714639396 +0000 UTC m=+66.948339070" watchObservedRunningTime="2026-07-24 04:00:54.715111741 +0000 UTC m=+66.948811413" Jul 24 04:00:55.255683 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.255643 2578 scope.go:117] "RemoveContainer" containerID="fc16fb8dc748660643701f091121b3555ff02e30f6e4649445a33a3343b33ece" Jul 24 04:00:55.624143 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.624106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:55.624143 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.624152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:55.624357 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.624200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5hk2c\" (UID: \"16cb44d8-ec27-491f-9060-e6bcf27532ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:55.624357 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.624246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:55.624357 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.624300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:55.624357 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.624353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:55.625144 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.625085 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-service-ca-bundle\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:55.627136 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.627102 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jm9dk\" (UID: \"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:55.627136 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.627116 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d450efc4-763a-445e-9db9-64ba3c11b3da-metrics-tls\") pod \"dns-default-2pcmq\" (UID: \"d450efc4-763a-445e-9db9-64ba3c11b3da\") " pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:55.627306 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.627177 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75c0a7c0-765e-465f-ab9e-54e18fa72aa1-metrics-certs\") pod \"router-default-7f554cdb4c-tn48f\" (UID: \"75c0a7c0-765e-465f-ab9e-54e18fa72aa1\") " pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:55.627306 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.627187 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls\") pod \"image-registry-9697474c5-4nkzn\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:55.627469 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.627449 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/16cb44d8-ec27-491f-9060-e6bcf27532ac-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5hk2c\" (UID: \"16cb44d8-ec27-491f-9060-e6bcf27532ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:55.705832 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.705732 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/2.log" Jul 24 04:00:55.706206 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.706187 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/1.log" Jul 24 04:00:55.706289 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.706225 2578 generic.go:356] "Generic (PLEG): container finished" podID="cbc42fe3-ed20-4ad7-9d57-48a641386372" containerID="d44e9bf38a58608ed437c00f6bee19e08a01a40a4385eb97d0a83eee3168cf90" exitCode=255 Jul 24 04:00:55.706349 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.706305 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" event={"ID":"cbc42fe3-ed20-4ad7-9d57-48a641386372","Type":"ContainerDied","Data":"d44e9bf38a58608ed437c00f6bee19e08a01a40a4385eb97d0a83eee3168cf90"} Jul 24 04:00:55.706399 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.706372 2578 scope.go:117] "RemoveContainer" containerID="fc16fb8dc748660643701f091121b3555ff02e30f6e4649445a33a3343b33ece" Jul 24 04:00:55.706777 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.706749 2578 scope.go:117] "RemoveContainer" containerID="d44e9bf38a58608ed437c00f6bee19e08a01a40a4385eb97d0a83eee3168cf90" Jul 24 04:00:55.707031 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:00:55.707007 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-s44kl_openshift-console-operator(cbc42fe3-ed20-4ad7-9d57-48a641386372)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" podUID="cbc42fe3-ed20-4ad7-9d57-48a641386372" Jul 24 04:00:55.708851 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.708827 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fn8hw" event={"ID":"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2","Type":"ContainerStarted","Data":"b665af528b40795cc62da726d53c5d0a98c6bebac323ccab8b6dee233291fa18"} Jul 24 04:00:55.708948 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.708883 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fn8hw" event={"ID":"cfdaa993-a5f2-486b-be35-f6d04e6eb8f2","Type":"ContainerStarted","Data":"8b4b612d30c236c13e8d1c4ae30d0b9ce471fc1a5f46d1b79f072f419bdc0647"} Jul 24 04:00:55.740552 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.740463 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fn8hw" podStartSLOduration=66.799346607 podStartE2EDuration="1m7.740440069s" totalImagesPullingTime="941.093462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:55.738010226 +0000 UTC m=+67.971709901" watchObservedRunningTime="2026-07-24 04:00:55.740440069 +0000 UTC m=+67.974139742" Jul 24 04:00:55.769882 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.769847 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rtsnl\"" Jul 24 04:00:55.778099 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.778060 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:55.779452 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.779428 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kmtrm\"" Jul 24 04:00:55.787444 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.787415 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:55.802428 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.802400 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jg6j6\"" Jul 24 04:00:55.810592 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.810562 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" Jul 24 04:00:55.817280 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.817246 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n6z8n\"" Jul 24 04:00:55.825506 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.825465 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" Jul 24 04:00:55.832349 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.832322 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7mgjm\"" Jul 24 04:00:55.840635 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:55.840612 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2pcmq" Jul 24 04:00:56.012886 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.012854 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9697474c5-4nkzn"] Jul 24 04:00:56.040185 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.040148 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f554cdb4c-tn48f"] Jul 24 04:00:56.055551 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:56.055511 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c0a7c0_765e_465f_ab9e_54e18fa72aa1.slice/crio-e6f9725c0fb10b6671a8248a91ad5601b3e7adbafd42b2f19717d9799ab23d97 WatchSource:0}: Error finding container e6f9725c0fb10b6671a8248a91ad5601b3e7adbafd42b2f19717d9799ab23d97: Status 404 returned error can't find the container with id e6f9725c0fb10b6671a8248a91ad5601b3e7adbafd42b2f19717d9799ab23d97 Jul 24 04:00:56.076490 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.076222 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c"] Jul 24 04:00:56.104003 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.103922 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk"] Jul 24 04:00:56.110228 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:56.110116 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ddaa21_69fc_4604_8f3d_d4ae7bfadad7.slice/crio-f2e00ff012ac787884c31de86eb3423244ecfd4388c13be9d9732b20938167d7 WatchSource:0}: Error finding container f2e00ff012ac787884c31de86eb3423244ecfd4388c13be9d9732b20938167d7: Status 404 returned error can't find the container with id f2e00ff012ac787884c31de86eb3423244ecfd4388c13be9d9732b20938167d7 Jul 24 04:00:56.125325 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.125246 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2pcmq"] Jul 24 04:00:56.131316 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:56.131237 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd450efc4_763a_445e_9db9_64ba3c11b3da.slice/crio-fc0d8d968ff8f0b8b7150cffb7fe2bb03c43db5a75b8529736ad3a12adba7275 WatchSource:0}: Error finding container fc0d8d968ff8f0b8b7150cffb7fe2bb03c43db5a75b8529736ad3a12adba7275: Status 404 returned error can't find the container with id fc0d8d968ff8f0b8b7150cffb7fe2bb03c43db5a75b8529736ad3a12adba7275 Jul 24 04:00:56.432589 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.432542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:56.433106 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.432662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:56.433373 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.433348 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/325d30ed-fb31-40cf-ac93-902eca0bf5ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:56.435289 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.435258 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/325d30ed-fb31-40cf-ac93-902eca0bf5ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxlkj\" (UID: \"325d30ed-fb31-40cf-ac93-902eca0bf5ce\") " pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:56.461680 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.461650 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tzqn7\"" Jul 24 04:00:56.469679 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.469649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kxlkj" Jul 24 04:00:56.647567 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.647464 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kxlkj"] Jul 24 04:00:56.650542 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:00:56.650493 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325d30ed_fb31_40cf_ac93_902eca0bf5ce.slice/crio-2e9eabb17bd6a6ccb2fb030e799a206869923bd23bab3448f9c144fd582b6ee5 WatchSource:0}: Error finding container 2e9eabb17bd6a6ccb2fb030e799a206869923bd23bab3448f9c144fd582b6ee5: Status 404 returned error can't find the container with id 2e9eabb17bd6a6ccb2fb030e799a206869923bd23bab3448f9c144fd582b6ee5 Jul 24 04:00:56.714684 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.714597 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kxlkj" event={"ID":"325d30ed-fb31-40cf-ac93-902eca0bf5ce","Type":"ContainerStarted","Data":"2e9eabb17bd6a6ccb2fb030e799a206869923bd23bab3448f9c144fd582b6ee5"} Jul 24 04:00:56.716412 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.716375 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f554cdb4c-tn48f" event={"ID":"75c0a7c0-765e-465f-ab9e-54e18fa72aa1","Type":"ContainerStarted","Data":"a50c953ed93cc1c4d2209b25df6bd492a0fd5a49b42ca4fc20f7739b2c4d068a"} Jul 24 04:00:56.716583 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.716434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f554cdb4c-tn48f" event={"ID":"75c0a7c0-765e-465f-ab9e-54e18fa72aa1","Type":"ContainerStarted","Data":"e6f9725c0fb10b6671a8248a91ad5601b3e7adbafd42b2f19717d9799ab23d97"} Jul 24 04:00:56.717769 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.717735 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2pcmq" event={"ID":"d450efc4-763a-445e-9db9-64ba3c11b3da","Type":"ContainerStarted","Data":"fc0d8d968ff8f0b8b7150cffb7fe2bb03c43db5a75b8529736ad3a12adba7275"} Jul 24 04:00:56.719462 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.719430 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" event={"ID":"31f95900-8dd8-4926-a3c1-5f74dbf8a767","Type":"ContainerStarted","Data":"0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c"} Jul 24 04:00:56.719591 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.719478 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" event={"ID":"31f95900-8dd8-4926-a3c1-5f74dbf8a767","Type":"ContainerStarted","Data":"66bf5d46ee54aaf9a883a9f7bebf1663b5f0b070c7d2e4838476125116778d6d"} Jul 24 04:00:56.719591 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.719506 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:00:56.720703 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.720674 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" event={"ID":"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7","Type":"ContainerStarted","Data":"f2e00ff012ac787884c31de86eb3423244ecfd4388c13be9d9732b20938167d7"} Jul 24 04:00:56.722002 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.721955 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" event={"ID":"16cb44d8-ec27-491f-9060-e6bcf27532ac","Type":"ContainerStarted","Data":"aacd8d7df8299e15a08a3158c244a422145ba5bc257f9b06a70a7fe8ff0d3392"} Jul 24 04:00:56.723790 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.723768 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/2.log" Jul 24 04:00:56.735027 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.734954 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7f554cdb4c-tn48f" podStartSLOduration=43.734935101 podStartE2EDuration="43.734935101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:56.734088315 +0000 UTC m=+68.967787987" watchObservedRunningTime="2026-07-24 04:00:56.734935101 +0000 UTC m=+68.968634775" Jul 24 04:00:56.754421 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.754012 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" podStartSLOduration=67.75398938 podStartE2EDuration="1m7.75398938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:59:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:56.753505336 +0000 UTC m=+68.987205018" watchObservedRunningTime="2026-07-24 04:00:56.75398938 +0000 UTC m=+68.987689053" Jul 24 04:00:56.788694 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.788645 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:56.792234 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:56.792150 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:57.732850 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:57.732818 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:00:57.734612 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:00:57.734381 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f554cdb4c-tn48f" Jul 24 04:01:03.954143 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:03.954057 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:01:03.954143 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:03.954124 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:01:03.954672 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:03.954567 2578 scope.go:117] "RemoveContainer" containerID="d44e9bf38a58608ed437c00f6bee19e08a01a40a4385eb97d0a83eee3168cf90" Jul 24 04:01:03.954777 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:01:03.954757 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-s44kl_openshift-console-operator(cbc42fe3-ed20-4ad7-9d57-48a641386372)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" podUID="cbc42fe3-ed20-4ad7-9d57-48a641386372" Jul 24 04:01:04.783706 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:04.783664 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2pcmq" event={"ID":"d450efc4-763a-445e-9db9-64ba3c11b3da","Type":"ContainerStarted","Data":"351401aed56e240313f0b90f7072c8ba2f8457db8e3cce7bcbee57706b953d89"} Jul 24 04:01:04.785564 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:04.785528 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" event={"ID":"b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7","Type":"ContainerStarted","Data":"3beee99fb7d4303152a88ba78540ca792a15017e17961333f984f7f308774898"} Jul 24 04:01:04.789557 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:04.789515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" event={"ID":"16cb44d8-ec27-491f-9060-e6bcf27532ac","Type":"ContainerStarted","Data":"ed6ba7a88dacd98fc22c504c7922dfaf0e826e234e2879664107b07b71bac3db"} Jul 24 04:01:04.793519 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:04.792984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-drhnf" event={"ID":"68781720-31da-4036-97f5-d2bf5fcd0df0","Type":"ContainerStarted","Data":"e6cc76a9d1f005fedf9e53528d52ffd5f46601a1c7d26d62bdf311795a410e98"} Jul 24 04:01:04.805457 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:04.804250 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jm9dk" podStartSLOduration=43.395804053 podStartE2EDuration="51.804229102s" totalImagesPullingTime="8.408425049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:04.802251358 +0000 UTC m=+77.035951108" watchObservedRunningTime="2026-07-24 04:01:04.804229102 +0000 UTC m=+77.037928769" Jul 24 04:01:05.799946 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:05.799907 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kxlkj" event={"ID":"325d30ed-fb31-40cf-ac93-902eca0bf5ce","Type":"ContainerStarted","Data":"3fbd0e7316c49a95d0f25bad3de70d2090bee3fc185ed1ada3580d40d0f04080"} Jul 24 04:01:05.802211 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:05.802177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2pcmq" event={"ID":"d450efc4-763a-445e-9db9-64ba3c11b3da","Type":"ContainerStarted","Data":"f100e04ccd6cf6890712e3ac783ea6ef491f3294bbf58bbc85434ba94b13c22f"} Jul 24 04:01:05.802356 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:05.802271 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2pcmq" Jul 24 04:01:05.804448 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:05.804385 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" event={"ID":"16cb44d8-ec27-491f-9060-e6bcf27532ac","Type":"ContainerStarted","Data":"7a7339b4ee6e7644696d4649f4ac620db4541d4a05d11ab0003b95005ae5b220"} Jul 24 04:01:05.818204 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:05.818146 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-drhnf" podStartSLOduration=66.844462561 podStartE2EDuration="1m16.818124906s" totalImagesPullingTime="9.973662345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:04.823054057 +0000 UTC m=+77.056753729" watchObservedRunningTime="2026-07-24 04:01:05.818124906 +0000 UTC m=+78.051824582" Jul 24 04:01:05.819994 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:05.819931 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2pcmq" podStartSLOduration=34.433239713 podStartE2EDuration="42.819918859s" totalImagesPullingTime="8.386679146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:05.818312972 +0000 UTC m=+78.052012645" watchObservedRunningTime="2026-07-24 04:01:05.819918859 +0000 UTC m=+78.053618531" Jul 24 04:01:05.834301 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:05.834242 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5hk2c" podStartSLOduration=44.490593322 podStartE2EDuration="52.834225069s" totalImagesPullingTime="8.343631747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:05.833168888 +0000 UTC m=+78.066868561" watchObservedRunningTime="2026-07-24 04:01:05.834225069 +0000 UTC m=+78.067924740" Jul 24 04:01:06.427348 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.427292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lsgk5\" (UID: \"bbf36a72-fb4a-4c25-b2eb-692d5184d481\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:01:06.430337 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.430298 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbf36a72-fb4a-4c25-b2eb-692d5184d481-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lsgk5\" (UID: \"bbf36a72-fb4a-4c25-b2eb-692d5184d481\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:01:06.553888 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.553851 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw"] Jul 24 04:01:06.572648 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.572616 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw"] Jul 24 04:01:06.572800 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.572720 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw" Jul 24 04:01:06.581551 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.581516 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kgpks\"" Jul 24 04:01:06.581672 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.581630 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 04:01:06.629218 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.629180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/089741d6-c17c-4868-9b00-f51d12c0aaa3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ld7hw\" (UID: \"089741d6-c17c-4868-9b00-f51d12c0aaa3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw" Jul 24 04:01:06.666528 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.666491 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-q2vwr\"" Jul 24 04:01:06.674707 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.674668 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" Jul 24 04:01:06.729875 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.729841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/089741d6-c17c-4868-9b00-f51d12c0aaa3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ld7hw\" (UID: \"089741d6-c17c-4868-9b00-f51d12c0aaa3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw" Jul 24 04:01:06.732725 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.732695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/089741d6-c17c-4868-9b00-f51d12c0aaa3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ld7hw\" (UID: \"089741d6-c17c-4868-9b00-f51d12c0aaa3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw" Jul 24 04:01:06.884992 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:06.884943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw" Jul 24 04:01:09.171459 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:09.171422 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5"] Jul 24 04:01:09.189328 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:09.189266 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw"] Jul 24 04:01:09.263489 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:01:09.263455 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf36a72_fb4a_4c25_b2eb_692d5184d481.slice/crio-25b40e32a9d2f48e9bd118e6c646057b9063af9b996ee8fe4b1131e1131b9a19 WatchSource:0}: Error finding container 25b40e32a9d2f48e9bd118e6c646057b9063af9b996ee8fe4b1131e1131b9a19: Status 404 returned error can't find the container with id 25b40e32a9d2f48e9bd118e6c646057b9063af9b996ee8fe4b1131e1131b9a19 Jul 24 04:01:09.263907 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:01:09.263885 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod089741d6_c17c_4868_9b00_f51d12c0aaa3.slice/crio-4055a9b40985d3dbff2a0334cd8df86c4318af1eb9a0c3b881b92b39ec89a359 WatchSource:0}: Error finding container 4055a9b40985d3dbff2a0334cd8df86c4318af1eb9a0c3b881b92b39ec89a359: Status 404 returned error can't find the container with id 4055a9b40985d3dbff2a0334cd8df86c4318af1eb9a0c3b881b92b39ec89a359 Jul 24 04:01:09.824489 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:09.824447 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" event={"ID":"bbf36a72-fb4a-4c25-b2eb-692d5184d481","Type":"ContainerStarted","Data":"25b40e32a9d2f48e9bd118e6c646057b9063af9b996ee8fe4b1131e1131b9a19"} Jul 24 04:01:09.826633 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:09.826575 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kxlkj" event={"ID":"325d30ed-fb31-40cf-ac93-902eca0bf5ce","Type":"ContainerStarted","Data":"5e2033b20ade985a470b91c7bc6530f49228ed8ac2c5230968b609ae1a2df2e1"} Jul 24 04:01:09.828040 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:09.828014 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw" event={"ID":"089741d6-c17c-4868-9b00-f51d12c0aaa3","Type":"ContainerStarted","Data":"4055a9b40985d3dbff2a0334cd8df86c4318af1eb9a0c3b881b92b39ec89a359"} Jul 24 04:01:13.847653 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:13.847613 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" event={"ID":"bbf36a72-fb4a-4c25-b2eb-692d5184d481","Type":"ContainerStarted","Data":"98933d134209e09b4c9a365bc69ee05076e959aa40229d495464c8fd191c167c"} Jul 24 04:01:13.849915 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:13.849882 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kxlkj" event={"ID":"325d30ed-fb31-40cf-ac93-902eca0bf5ce","Type":"ContainerStarted","Data":"60c8936f07ecd05b1f7129538f4164b651bda267dd4d4864ead2196a413a8a77"} Jul 24 04:01:13.851367 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:13.851342 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw" event={"ID":"089741d6-c17c-4868-9b00-f51d12c0aaa3","Type":"ContainerStarted","Data":"c9128e85f1a9da12852d69ac2778e4f933fd1176a3045a9c6850ce358785820d"} Jul 24 04:01:13.851538 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:13.851526 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw" Jul 24 04:01:13.856123 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:13.856101 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw" Jul 24 04:01:13.865772 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:13.865732 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lsgk5" podStartSLOduration=35.510883456 podStartE2EDuration="39.865717691s" totalImagesPullingTime="4.354834235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:13.865160421 +0000 UTC m=+86.098860095" watchObservedRunningTime="2026-07-24 04:01:13.865717691 +0000 UTC m=+86.099417363" Jul 24 04:01:13.879400 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:13.879356 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ld7hw" podStartSLOduration=3.496682517 podStartE2EDuration="7.879341841s" totalImagesPullingTime="4.382659324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:13.878380931 +0000 UTC m=+86.112080606" watchObservedRunningTime="2026-07-24 04:01:13.879341841 +0000 UTC m=+86.113041512" Jul 24 04:01:13.901462 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:13.901410 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kxlkj" podStartSLOduration=17.123229307 podStartE2EDuration="33.901392159s" totalImagesPullingTime="16.778162852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:13.900552392 +0000 UTC m=+86.134252064" watchObservedRunningTime="2026-07-24 04:01:13.901392159 +0000 UTC m=+86.135091831" Jul 24 04:01:14.255414 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:14.255376 2578 scope.go:117] "RemoveContainer" containerID="d44e9bf38a58608ed437c00f6bee19e08a01a40a4385eb97d0a83eee3168cf90" Jul 24 04:01:14.255637 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:01:14.255560 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-s44kl_openshift-console-operator(cbc42fe3-ed20-4ad7-9d57-48a641386372)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" podUID="cbc42fe3-ed20-4ad7-9d57-48a641386372" Jul 24 04:01:15.782180 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:15.782142 2578 patch_prober.go:28] interesting pod/image-registry-9697474c5-4nkzn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 24 04:01:15.782612 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:15.782194 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" podUID="31f95900-8dd8-4926-a3c1-5f74dbf8a767" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 04:01:15.812027 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:15.811992 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2pcmq" Jul 24 04:01:17.736979 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:17.736934 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:01:22.590610 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.590567 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jtlq6"] Jul 24 04:01:22.595840 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.595811 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.598316 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.598270 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rdgpg\"" Jul 24 04:01:22.598587 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.598572 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 04:01:22.599533 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.599387 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 04:01:22.599533 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.599394 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 04:01:22.599533 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.599411 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 04:01:22.675583 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.675549 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b677cdd-bd1f-41bf-b139-6be02d394330-sys\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.675779 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.675605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-textfile\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.675779 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.675639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-wtmp\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.675779 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.675657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b677cdd-bd1f-41bf-b139-6be02d394330-metrics-client-ca\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.675779 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.675686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-tls\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.675779 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.675756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b677cdd-bd1f-41bf-b139-6be02d394330-root\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.676061 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.675803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnjvl\" (UniqueName: \"kubernetes.io/projected/5b677cdd-bd1f-41bf-b139-6be02d394330-kube-api-access-pnjvl\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.676061 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.675844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.676061 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.675876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-accelerators-collector-config\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.776599 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.776561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.776758 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.776603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-accelerators-collector-config\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.776758 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.776642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b677cdd-bd1f-41bf-b139-6be02d394330-sys\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.776758 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.776682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-textfile\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.776901 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.776763 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b677cdd-bd1f-41bf-b139-6be02d394330-sys\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.776901 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.776792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-wtmp\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.776901 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.776825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b677cdd-bd1f-41bf-b139-6be02d394330-metrics-client-ca\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.776901 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.776868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-tls\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.777116 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.776902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b677cdd-bd1f-41bf-b139-6be02d394330-root\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.777116 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.776908 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-wtmp\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.777116 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.776988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnjvl\" (UniqueName: \"kubernetes.io/projected/5b677cdd-bd1f-41bf-b139-6be02d394330-kube-api-access-pnjvl\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.777259 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.777148 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b677cdd-bd1f-41bf-b139-6be02d394330-root\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.777259 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:01:22.777165 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 24 04:01:22.777259 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:01:22.777231 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-tls podName:5b677cdd-bd1f-41bf-b139-6be02d394330 nodeName:}" failed. No retries permitted until 2026-07-24 04:01:23.277208902 +0000 UTC m=+95.510908552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-tls") pod "node-exporter-jtlq6" (UID: "5b677cdd-bd1f-41bf-b139-6be02d394330") : secret "node-exporter-tls" not found Jul 24 04:01:22.777488 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.777444 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-accelerators-collector-config\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.777622 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.777516 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-textfile\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.777622 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.777528 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b677cdd-bd1f-41bf-b139-6be02d394330-metrics-client-ca\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.779422 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.779402 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:22.785339 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:22.785315 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnjvl\" (UniqueName: \"kubernetes.io/projected/5b677cdd-bd1f-41bf-b139-6be02d394330-kube-api-access-pnjvl\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:23.282311 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:23.282275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-tls\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:23.284774 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:23.284748 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b677cdd-bd1f-41bf-b139-6be02d394330-node-exporter-tls\") pod \"node-exporter-jtlq6\" (UID: \"5b677cdd-bd1f-41bf-b139-6be02d394330\") " pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:23.507254 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:23.507214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jtlq6" Jul 24 04:01:23.521006 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:01:23.520957 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b677cdd_bd1f_41bf_b139_6be02d394330.slice/crio-04c731fdfc3ef39b64ad3ca7979fca2e9329af905a02c2a8d1d3a57fd4962db0 WatchSource:0}: Error finding container 04c731fdfc3ef39b64ad3ca7979fca2e9329af905a02c2a8d1d3a57fd4962db0: Status 404 returned error can't find the container with id 04c731fdfc3ef39b64ad3ca7979fca2e9329af905a02c2a8d1d3a57fd4962db0 Jul 24 04:01:23.898709 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:23.898663 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jtlq6" event={"ID":"5b677cdd-bd1f-41bf-b139-6be02d394330","Type":"ContainerStarted","Data":"04c731fdfc3ef39b64ad3ca7979fca2e9329af905a02c2a8d1d3a57fd4962db0"} Jul 24 04:01:24.904917 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:24.904830 2578 generic.go:356] "Generic (PLEG): container finished" podID="5b677cdd-bd1f-41bf-b139-6be02d394330" containerID="b2ee5bcbd2646a4c3ab96552ae63e8a007f0703594659820469fc4c1df8506c2" exitCode=0 Jul 24 04:01:24.905304 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:24.904909 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jtlq6" event={"ID":"5b677cdd-bd1f-41bf-b139-6be02d394330","Type":"ContainerDied","Data":"b2ee5bcbd2646a4c3ab96552ae63e8a007f0703594659820469fc4c1df8506c2"} Jul 24 04:01:25.711624 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:25.711585 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mqtjx" Jul 24 04:01:25.911753 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:25.911717 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jtlq6" event={"ID":"5b677cdd-bd1f-41bf-b139-6be02d394330","Type":"ContainerStarted","Data":"86c37a79059ca08110068e9fccac468c5f0fe77bb1893566e69cb68f90ba1847"} Jul 24 04:01:25.912184 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:25.911780 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jtlq6" event={"ID":"5b677cdd-bd1f-41bf-b139-6be02d394330","Type":"ContainerStarted","Data":"fb34a8a94c354c0c3e0d0a6f0c3e8cb1f4e9126b21867fa39176fce528eb1d38"} Jul 24 04:01:25.931552 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:25.931489 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jtlq6" podStartSLOduration=2.819388916 podStartE2EDuration="3.931473377s" totalImagesPullingTime="1.047773242s" totalInitContainerRuntime="64.311219ms" isStatefulPod=true podCreationTimestamp="2026-07-24 04:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:25.929616167 +0000 UTC m=+98.163315839" watchObservedRunningTime="2026-07-24 04:01:25.931473377 +0000 UTC m=+98.165173083" Jul 24 04:01:28.256556 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:28.256526 2578 scope.go:117] "RemoveContainer" containerID="d44e9bf38a58608ed437c00f6bee19e08a01a40a4385eb97d0a83eee3168cf90" Jul 24 04:01:28.926216 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:28.926190 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/2.log" Jul 24 04:01:28.926388 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:28.926274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" event={"ID":"cbc42fe3-ed20-4ad7-9d57-48a641386372","Type":"ContainerStarted","Data":"57bb35f7b6068241782ada66b473a3736363649eacd2f692f32fe3e1055347fc"} Jul 24 04:01:28.926651 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:28.926627 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:01:28.931368 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:28.931347 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" Jul 24 04:01:28.951490 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:28.951444 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-s44kl" podStartSLOduration=62.121467282 podStartE2EDuration="1m15.951429924s" totalImagesPullingTime="13.829962642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:28.950736635 +0000 UTC m=+101.184436308" watchObservedRunningTime="2026-07-24 04:01:28.951429924 +0000 UTC m=+101.185129596" Jul 24 04:01:34.107487 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:34.107448 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9697474c5-4nkzn"] Jul 24 04:01:51.010933 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:51.010896 2578 generic.go:356] "Generic (PLEG): container finished" podID="bb7ca265-f76f-400f-a799-958859d3553a" containerID="2487a73dd90722628a4c5fe245983357df1ab0347a0053110c1d9097269e4bb9" exitCode=0 Jul 24 04:01:51.011390 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:51.010984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" event={"ID":"bb7ca265-f76f-400f-a799-958859d3553a","Type":"ContainerDied","Data":"2487a73dd90722628a4c5fe245983357df1ab0347a0053110c1d9097269e4bb9"} Jul 24 04:01:51.011390 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:51.011306 2578 scope.go:117] "RemoveContainer" containerID="2487a73dd90722628a4c5fe245983357df1ab0347a0053110c1d9097269e4bb9" Jul 24 04:01:52.016825 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:52.016786 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-tbphs" event={"ID":"bb7ca265-f76f-400f-a799-958859d3553a","Type":"ContainerStarted","Data":"caecf96f4859e14209dea9388bd05e49ef3dd1da8c6e221e83c530b23a659866"} Jul 24 04:01:59.127245 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.127196 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" podUID="31f95900-8dd8-4926-a3c1-5f74dbf8a767" containerName="registry" containerID="cri-o://0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c" gracePeriod=30 Jul 24 04:01:59.370237 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.370206 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:01:59.457383 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.457284 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-certificates\") pod \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " Jul 24 04:01:59.457383 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.457328 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31f95900-8dd8-4926-a3c1-5f74dbf8a767-trusted-ca\") pod \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " Jul 24 04:01:59.457383 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.457349 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31f95900-8dd8-4926-a3c1-5f74dbf8a767-image-registry-private-configuration\") pod \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " Jul 24 04:01:59.457383 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.457367 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-bound-sa-token\") pod \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " Jul 24 04:01:59.457716 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.457396 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31f95900-8dd8-4926-a3c1-5f74dbf8a767-installation-pull-secrets\") pod \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " Jul 24 04:01:59.457716 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.457500 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjmcx\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-kube-api-access-qjmcx\") pod \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " Jul 24 04:01:59.457716 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.457534 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31f95900-8dd8-4926-a3c1-5f74dbf8a767-ca-trust-extracted\") pod \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " Jul 24 04:01:59.457864 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.457794 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31f95900-8dd8-4926-a3c1-5f74dbf8a767-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "31f95900-8dd8-4926-a3c1-5f74dbf8a767" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:01:59.458201 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.458160 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "31f95900-8dd8-4926-a3c1-5f74dbf8a767" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:01:59.459913 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.459880 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31f95900-8dd8-4926-a3c1-5f74dbf8a767-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "31f95900-8dd8-4926-a3c1-5f74dbf8a767" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:01:59.459913 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.459900 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-kube-api-access-qjmcx" (OuterVolumeSpecName: "kube-api-access-qjmcx") pod "31f95900-8dd8-4926-a3c1-5f74dbf8a767" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767"). InnerVolumeSpecName "kube-api-access-qjmcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:01:59.460101 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.459990 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "31f95900-8dd8-4926-a3c1-5f74dbf8a767" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:01:59.460190 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.460173 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31f95900-8dd8-4926-a3c1-5f74dbf8a767-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "31f95900-8dd8-4926-a3c1-5f74dbf8a767" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:01:59.466511 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.466481 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31f95900-8dd8-4926-a3c1-5f74dbf8a767-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "31f95900-8dd8-4926-a3c1-5f74dbf8a767" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:01:59.558168 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.558111 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls\") pod \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\" (UID: \"31f95900-8dd8-4926-a3c1-5f74dbf8a767\") " Jul 24 04:01:59.558725 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.558379 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-certificates\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:01:59.558725 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.558400 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31f95900-8dd8-4926-a3c1-5f74dbf8a767-trusted-ca\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:01:59.558725 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.558415 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31f95900-8dd8-4926-a3c1-5f74dbf8a767-image-registry-private-configuration\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:01:59.558725 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.558429 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-bound-sa-token\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:01:59.558725 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.558442 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31f95900-8dd8-4926-a3c1-5f74dbf8a767-installation-pull-secrets\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:01:59.558725 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.558455 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjmcx\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-kube-api-access-qjmcx\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:01:59.558725 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.558467 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31f95900-8dd8-4926-a3c1-5f74dbf8a767-ca-trust-extracted\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:01:59.561147 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.561110 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "31f95900-8dd8-4926-a3c1-5f74dbf8a767" (UID: "31f95900-8dd8-4926-a3c1-5f74dbf8a767"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:01:59.659301 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:01:59.659260 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31f95900-8dd8-4926-a3c1-5f74dbf8a767-registry-tls\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:02:00.049250 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:00.049218 2578 generic.go:356] "Generic (PLEG): container finished" podID="31f95900-8dd8-4926-a3c1-5f74dbf8a767" containerID="0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c" exitCode=0 Jul 24 04:02:00.049427 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:00.049265 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" Jul 24 04:02:00.049427 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:00.049313 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" event={"ID":"31f95900-8dd8-4926-a3c1-5f74dbf8a767","Type":"ContainerDied","Data":"0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c"} Jul 24 04:02:00.049427 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:00.049389 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9697474c5-4nkzn" event={"ID":"31f95900-8dd8-4926-a3c1-5f74dbf8a767","Type":"ContainerDied","Data":"66bf5d46ee54aaf9a883a9f7bebf1663b5f0b070c7d2e4838476125116778d6d"} Jul 24 04:02:00.049427 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:00.049410 2578 scope.go:117] "RemoveContainer" containerID="0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c" Jul 24 04:02:00.058711 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:00.058692 2578 scope.go:117] "RemoveContainer" containerID="0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c" Jul 24 04:02:00.059028 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:02:00.058956 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c\": container with ID starting with 0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c not found: ID does not exist" containerID="0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c" Jul 24 04:02:00.059105 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:00.059042 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c"} err="failed to get container status \"0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c\": rpc error: code = NotFound desc = could not find container \"0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c\": container with ID starting with 0f1adf964ea1f9a2b6e404f2abfbd00fbb7ff62a9d308965b25ea31141ef1a8c not found: ID does not exist" Jul 24 04:02:00.070842 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:00.070815 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9697474c5-4nkzn"] Jul 24 04:02:00.074318 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:00.074297 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9697474c5-4nkzn"] Jul 24 04:02:00.260048 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:00.260017 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31f95900-8dd8-4926-a3c1-5f74dbf8a767" path="/var/lib/kubelet/pods/31f95900-8dd8-4926-a3c1-5f74dbf8a767/volumes" Jul 24 04:02:01.057175 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:01.054697 2578 generic.go:356] "Generic (PLEG): container finished" podID="57155d90-234f-4763-9688-382e925a8f4c" containerID="182df0249a0a79622bd9a87664f01c45a59f3a872e823db5545aa0e76cabb8a1" exitCode=0 Jul 24 04:02:01.057175 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:01.054836 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jk2zf" event={"ID":"57155d90-234f-4763-9688-382e925a8f4c","Type":"ContainerDied","Data":"182df0249a0a79622bd9a87664f01c45a59f3a872e823db5545aa0e76cabb8a1"} Jul 24 04:02:01.057175 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:01.055405 2578 scope.go:117] "RemoveContainer" containerID="182df0249a0a79622bd9a87664f01c45a59f3a872e823db5545aa0e76cabb8a1" Jul 24 04:02:02.064377 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:02.064345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jk2zf" event={"ID":"57155d90-234f-4763-9688-382e925a8f4c","Type":"ContainerStarted","Data":"054fd10438194c18afe1e5d9947db8c5a589c92c356fc2c58e5bd28da7c8b9c3"} Jul 24 04:02:04.820903 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:04.820863 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" podUID="1561bcc1-5514-4507-bf7d-8c6bc3bb204b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 24 04:02:05.077692 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:05.077613 2578 generic.go:356] "Generic (PLEG): container finished" podID="d7e5f257-bd10-4823-bd94-d72dee0b5cf7" containerID="d064a196d93d4d3d599a618647aa77470ad9d52423ee426afccae75e05fc66e5" exitCode=0 Jul 24 04:02:05.077692 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:05.077667 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" event={"ID":"d7e5f257-bd10-4823-bd94-d72dee0b5cf7","Type":"ContainerDied","Data":"d064a196d93d4d3d599a618647aa77470ad9d52423ee426afccae75e05fc66e5"} Jul 24 04:02:05.078030 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:05.078014 2578 scope.go:117] "RemoveContainer" containerID="d064a196d93d4d3d599a618647aa77470ad9d52423ee426afccae75e05fc66e5" Jul 24 04:02:06.083646 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:06.083612 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc" event={"ID":"d7e5f257-bd10-4823-bd94-d72dee0b5cf7","Type":"ContainerStarted","Data":"beaab2315d68b688726283c8b3a5c54ac27160dddcd8ebd4be51df8bba16d4d5"} Jul 24 04:02:14.822012 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:14.821916 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" podUID="1561bcc1-5514-4507-bf7d-8c6bc3bb204b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 24 04:02:24.821133 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:24.821090 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" podUID="1561bcc1-5514-4507-bf7d-8c6bc3bb204b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 24 04:02:24.821608 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:24.821162 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" Jul 24 04:02:24.821660 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:24.821642 2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4b8b6631c37a1c0152e3d823a09a0e1737920d158a920e55741dfa237ded5277"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 24 04:02:24.821696 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:24.821680 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" podUID="1561bcc1-5514-4507-bf7d-8c6bc3bb204b" containerName="service-proxy" containerID="cri-o://4b8b6631c37a1c0152e3d823a09a0e1737920d158a920e55741dfa237ded5277" gracePeriod=30 Jul 24 04:02:25.164777 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:25.164679 2578 generic.go:356] "Generic (PLEG): container finished" podID="1561bcc1-5514-4507-bf7d-8c6bc3bb204b" containerID="4b8b6631c37a1c0152e3d823a09a0e1737920d158a920e55741dfa237ded5277" exitCode=2 Jul 24 04:02:25.164777 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:25.164749 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" event={"ID":"1561bcc1-5514-4507-bf7d-8c6bc3bb204b","Type":"ContainerDied","Data":"4b8b6631c37a1c0152e3d823a09a0e1737920d158a920e55741dfa237ded5277"} Jul 24 04:02:25.164991 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:02:25.164806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6cf8bc9-4q5vd" event={"ID":"1561bcc1-5514-4507-bf7d-8c6bc3bb204b","Type":"ContainerStarted","Data":"c2522cffee02ed5d676f800538d5f6940458099ac1d9fcf81a3e49ab9bb5e7bd"} Jul 24 04:04:48.190600 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:48.190562 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/2.log" Jul 24 04:04:48.198845 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:48.198821 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/2.log" Jul 24 04:04:48.201208 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:48.201178 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 04:04:54.753191 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.753121 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m"] Jul 24 04:04:54.755799 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.753510 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31f95900-8dd8-4926-a3c1-5f74dbf8a767" containerName="registry" Jul 24 04:04:54.755799 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.753524 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31f95900-8dd8-4926-a3c1-5f74dbf8a767" containerName="registry" Jul 24 04:04:54.755799 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.753578 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31f95900-8dd8-4926-a3c1-5f74dbf8a767" containerName="registry" Jul 24 04:04:54.756536 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.756519 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:54.760269 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.760241 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fdbz4\"" Jul 24 04:04:54.760522 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.760509 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 04:04:54.760578 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.760552 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 04:04:54.760766 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.760744 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 04:04:54.761063 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.761047 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 04:04:54.806959 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.806930 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m"] Jul 24 04:04:54.906790 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.906742 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d91faba5-7221-4b1a-8588-f246be6a6ad3-tmp\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:54.907022 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.906798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d91faba5-7221-4b1a-8588-f246be6a6ad3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:54.907022 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.906825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmcdx\" (UniqueName: \"kubernetes.io/projected/d91faba5-7221-4b1a-8588-f246be6a6ad3-kube-api-access-rmcdx\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:54.907022 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.906851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d91faba5-7221-4b1a-8588-f246be6a6ad3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:54.907022 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:54.906937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d91faba5-7221-4b1a-8588-f246be6a6ad3-manifests\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:55.007437 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.007347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d91faba5-7221-4b1a-8588-f246be6a6ad3-manifests\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:55.007437 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.007404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d91faba5-7221-4b1a-8588-f246be6a6ad3-tmp\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:55.007437 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.007430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d91faba5-7221-4b1a-8588-f246be6a6ad3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:55.007701 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.007446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmcdx\" (UniqueName: \"kubernetes.io/projected/d91faba5-7221-4b1a-8588-f246be6a6ad3-kube-api-access-rmcdx\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:55.007701 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.007464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d91faba5-7221-4b1a-8588-f246be6a6ad3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:55.007791 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.007735 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d91faba5-7221-4b1a-8588-f246be6a6ad3-manifests\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:55.009741 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.009716 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d91faba5-7221-4b1a-8588-f246be6a6ad3-tmp\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:55.009957 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.009939 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d91faba5-7221-4b1a-8588-f246be6a6ad3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:55.010105 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.010086 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d91faba5-7221-4b1a-8588-f246be6a6ad3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:55.025252 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.025216 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmcdx\" (UniqueName: \"kubernetes.io/projected/d91faba5-7221-4b1a-8588-f246be6a6ad3-kube-api-access-rmcdx\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m\" (UID: \"d91faba5-7221-4b1a-8588-f246be6a6ad3\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:55.067025 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.066987 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:04:55.232093 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.232054 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m"] Jul 24 04:04:55.236726 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:04:55.236694 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91faba5_7221_4b1a_8588_f246be6a6ad3.slice/crio-3d6c715d5fc45aa9ad868855d52b867ae17fca3f6fc7c7128820e229ab5cda9c WatchSource:0}: Error finding container 3d6c715d5fc45aa9ad868855d52b867ae17fca3f6fc7c7128820e229ab5cda9c: Status 404 returned error can't find the container with id 3d6c715d5fc45aa9ad868855d52b867ae17fca3f6fc7c7128820e229ab5cda9c Jul 24 04:04:55.238498 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.238481 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 04:04:55.749759 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:55.749719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" event={"ID":"d91faba5-7221-4b1a-8588-f246be6a6ad3","Type":"ContainerStarted","Data":"3d6c715d5fc45aa9ad868855d52b867ae17fca3f6fc7c7128820e229ab5cda9c"} Jul 24 04:04:59.772240 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:04:59.772200 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" event={"ID":"d91faba5-7221-4b1a-8588-f246be6a6ad3","Type":"ContainerStarted","Data":"56f265b6cfb909e56e8b959138e5eced3083c5cb535e8b0a00e1ea9b0efabf21"} Jul 24 04:05:00.777455 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:00.777417 2578 generic.go:356] "Generic (PLEG): container finished" podID="d91faba5-7221-4b1a-8588-f246be6a6ad3" containerID="56f265b6cfb909e56e8b959138e5eced3083c5cb535e8b0a00e1ea9b0efabf21" exitCode=0 Jul 24 04:05:00.777944 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:00.777501 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" event={"ID":"d91faba5-7221-4b1a-8588-f246be6a6ad3","Type":"ContainerDied","Data":"56f265b6cfb909e56e8b959138e5eced3083c5cb535e8b0a00e1ea9b0efabf21"} Jul 24 04:05:01.784625 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:01.784582 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" event={"ID":"d91faba5-7221-4b1a-8588-f246be6a6ad3","Type":"ContainerStarted","Data":"c2c2b49552deb919642f3fd46ec1230cba9be059926bff13d9f64d3263b97720"} Jul 24 04:05:01.785131 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:01.784761 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:05:01.818564 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:01.818510 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" podStartSLOduration=2.477197612 podStartE2EDuration="7.818494752s" totalImagesPullingTime="4.300128605s" totalInitContainerRuntime="1.041168535s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:04:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:01.81582884 +0000 UTC m=+314.049528511" watchObservedRunningTime="2026-07-24 04:05:01.818494752 +0000 UTC m=+314.052194529" Jul 24 04:05:12.790293 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:12.790258 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m" Jul 24 04:05:23.364166 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.364127 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj"] Jul 24 04:05:23.372961 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.372937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.376379 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.376356 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 24 04:05:23.377219 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.377195 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj"] Jul 24 04:05:23.378985 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.378951 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q9tp5\"" Jul 24 04:05:23.380051 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.380024 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 24 04:05:23.381249 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.381229 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 24 04:05:23.381352 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.381334 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 24 04:05:23.382644 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.382627 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 24 04:05:23.425183 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.425151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jk2n\" (UniqueName: \"kubernetes.io/projected/da131404-591c-4524-afc3-c3d56aac8923-kube-api-access-7jk2n\") pod \"lws-controller-manager-65c5cbb794-ds6sj\" (UID: \"da131404-591c-4524-afc3-c3d56aac8923\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.425183 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.425186 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/da131404-591c-4524-afc3-c3d56aac8923-manager-config\") pod \"lws-controller-manager-65c5cbb794-ds6sj\" (UID: \"da131404-591c-4524-afc3-c3d56aac8923\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.425378 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.425272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da131404-591c-4524-afc3-c3d56aac8923-cert\") pod \"lws-controller-manager-65c5cbb794-ds6sj\" (UID: \"da131404-591c-4524-afc3-c3d56aac8923\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.425378 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.425365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/da131404-591c-4524-afc3-c3d56aac8923-metrics-cert\") pod \"lws-controller-manager-65c5cbb794-ds6sj\" (UID: \"da131404-591c-4524-afc3-c3d56aac8923\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.526368 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.526328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da131404-591c-4524-afc3-c3d56aac8923-cert\") pod \"lws-controller-manager-65c5cbb794-ds6sj\" (UID: \"da131404-591c-4524-afc3-c3d56aac8923\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.526563 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.526389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/da131404-591c-4524-afc3-c3d56aac8923-metrics-cert\") pod \"lws-controller-manager-65c5cbb794-ds6sj\" (UID: \"da131404-591c-4524-afc3-c3d56aac8923\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.526563 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.526407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jk2n\" (UniqueName: \"kubernetes.io/projected/da131404-591c-4524-afc3-c3d56aac8923-kube-api-access-7jk2n\") pod \"lws-controller-manager-65c5cbb794-ds6sj\" (UID: \"da131404-591c-4524-afc3-c3d56aac8923\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.526563 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.526430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/da131404-591c-4524-afc3-c3d56aac8923-manager-config\") pod \"lws-controller-manager-65c5cbb794-ds6sj\" (UID: \"da131404-591c-4524-afc3-c3d56aac8923\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.527182 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.527160 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/da131404-591c-4524-afc3-c3d56aac8923-manager-config\") pod \"lws-controller-manager-65c5cbb794-ds6sj\" (UID: \"da131404-591c-4524-afc3-c3d56aac8923\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.529011 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.528985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/da131404-591c-4524-afc3-c3d56aac8923-metrics-cert\") pod \"lws-controller-manager-65c5cbb794-ds6sj\" (UID: \"da131404-591c-4524-afc3-c3d56aac8923\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.529099 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.528985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da131404-591c-4524-afc3-c3d56aac8923-cert\") pod \"lws-controller-manager-65c5cbb794-ds6sj\" (UID: \"da131404-591c-4524-afc3-c3d56aac8923\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.547781 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.547757 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jk2n\" (UniqueName: \"kubernetes.io/projected/da131404-591c-4524-afc3-c3d56aac8923-kube-api-access-7jk2n\") pod \"lws-controller-manager-65c5cbb794-ds6sj\" (UID: \"da131404-591c-4524-afc3-c3d56aac8923\") " pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.684110 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.684021 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:23.825398 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.825369 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj"] Jul 24 04:05:23.828001 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:05:23.827949 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda131404_591c_4524_afc3_c3d56aac8923.slice/crio-4092f7c8d1231c71fcb6f4b84d42d85836fbe979ca1fb7ab55a2de34b02e78a9 WatchSource:0}: Error finding container 4092f7c8d1231c71fcb6f4b84d42d85836fbe979ca1fb7ab55a2de34b02e78a9: Status 404 returned error can't find the container with id 4092f7c8d1231c71fcb6f4b84d42d85836fbe979ca1fb7ab55a2de34b02e78a9 Jul 24 04:05:23.887781 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:23.887745 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" event={"ID":"da131404-591c-4524-afc3-c3d56aac8923","Type":"ContainerStarted","Data":"4092f7c8d1231c71fcb6f4b84d42d85836fbe979ca1fb7ab55a2de34b02e78a9"} Jul 24 04:05:26.903259 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:26.903174 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" event={"ID":"da131404-591c-4524-afc3-c3d56aac8923","Type":"ContainerStarted","Data":"5ddde189c023260739923ba9155917ca0cfb1051ef5d39d1222bc7361e989906"} Jul 24 04:05:26.903616 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:26.903309 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:05:27.857268 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.857182 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" podStartSLOduration=2.175492448 podStartE2EDuration="4.857159023s" totalImagesPullingTime="2.681666575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:26.970268067 +0000 UTC m=+339.203967738" watchObservedRunningTime="2026-07-24 04:05:27.857159023 +0000 UTC m=+340.090858696" Jul 24 04:05:27.857924 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.857889 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf"] Jul 24 04:05:27.862208 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.862187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" Jul 24 04:05:27.866274 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.866255 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 24 04:05:27.866502 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.866488 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-46mm5\"" Jul 24 04:05:27.878158 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.878132 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r"] Jul 24 04:05:27.881865 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.881845 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf"] Jul 24 04:05:27.882019 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.881946 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" Jul 24 04:05:27.888757 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.888736 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 24 04:05:27.889012 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.888996 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7bvkh\"" Jul 24 04:05:27.905897 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.905792 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r"] Jul 24 04:05:27.965562 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.965527 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qrn2r\" (UID: \"e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" Jul 24 04:05:27.965776 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.965617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a12f01de-4a5c-4297-882f-f946cdae7fc5-cert\") pod \"kserve-controller-manager-d6f4b65b8-6qtcf\" (UID: \"a12f01de-4a5c-4297-882f-f946cdae7fc5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" Jul 24 04:05:27.965776 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.965651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm2ln\" (UniqueName: \"kubernetes.io/projected/e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9-kube-api-access-hm2ln\") pod \"llmisvc-controller-manager-777c6bd7d5-qrn2r\" (UID: \"e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" Jul 24 04:05:27.965904 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:27.965836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbvww\" (UniqueName: \"kubernetes.io/projected/a12f01de-4a5c-4297-882f-f946cdae7fc5-kube-api-access-tbvww\") pod \"kserve-controller-manager-d6f4b65b8-6qtcf\" (UID: \"a12f01de-4a5c-4297-882f-f946cdae7fc5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" Jul 24 04:05:28.066571 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.066527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qrn2r\" (UID: \"e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" Jul 24 04:05:28.066761 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.066590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a12f01de-4a5c-4297-882f-f946cdae7fc5-cert\") pod \"kserve-controller-manager-d6f4b65b8-6qtcf\" (UID: \"a12f01de-4a5c-4297-882f-f946cdae7fc5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" Jul 24 04:05:28.066761 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.066614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm2ln\" (UniqueName: \"kubernetes.io/projected/e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9-kube-api-access-hm2ln\") pod \"llmisvc-controller-manager-777c6bd7d5-qrn2r\" (UID: \"e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" Jul 24 04:05:28.066761 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.066649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbvww\" (UniqueName: \"kubernetes.io/projected/a12f01de-4a5c-4297-882f-f946cdae7fc5-kube-api-access-tbvww\") pod \"kserve-controller-manager-d6f4b65b8-6qtcf\" (UID: \"a12f01de-4a5c-4297-882f-f946cdae7fc5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" Jul 24 04:05:28.066761 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:05:28.066705 2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 24 04:05:28.067007 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:05:28.066775 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9-cert podName:e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9 nodeName:}" failed. No retries permitted until 2026-07-24 04:05:28.566757232 +0000 UTC m=+340.800456881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9-cert") pod "llmisvc-controller-manager-777c6bd7d5-qrn2r" (UID: "e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9") : secret "llmisvc-webhook-server-cert" not found Jul 24 04:05:28.069406 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.069383 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a12f01de-4a5c-4297-882f-f946cdae7fc5-cert\") pod \"kserve-controller-manager-d6f4b65b8-6qtcf\" (UID: \"a12f01de-4a5c-4297-882f-f946cdae7fc5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" Jul 24 04:05:28.086877 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.086854 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbvww\" (UniqueName: \"kubernetes.io/projected/a12f01de-4a5c-4297-882f-f946cdae7fc5-kube-api-access-tbvww\") pod \"kserve-controller-manager-d6f4b65b8-6qtcf\" (UID: \"a12f01de-4a5c-4297-882f-f946cdae7fc5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" Jul 24 04:05:28.087134 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.087114 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm2ln\" (UniqueName: \"kubernetes.io/projected/e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9-kube-api-access-hm2ln\") pod \"llmisvc-controller-manager-777c6bd7d5-qrn2r\" (UID: \"e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" Jul 24 04:05:28.173712 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.173610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" Jul 24 04:05:28.339278 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.339248 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf"] Jul 24 04:05:28.340915 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:05:28.340882 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda12f01de_4a5c_4297_882f_f946cdae7fc5.slice/crio-6af2e407b6efb99e2ad430f55bca69e828934dfdd2c3d657f2f3337c7045bece WatchSource:0}: Error finding container 6af2e407b6efb99e2ad430f55bca69e828934dfdd2c3d657f2f3337c7045bece: Status 404 returned error can't find the container with id 6af2e407b6efb99e2ad430f55bca69e828934dfdd2c3d657f2f3337c7045bece Jul 24 04:05:28.572378 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.572344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qrn2r\" (UID: \"e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" Jul 24 04:05:28.574793 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.574764 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qrn2r\" (UID: \"e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" Jul 24 04:05:28.792923 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.792879 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" Jul 24 04:05:28.915690 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.915634 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" event={"ID":"a12f01de-4a5c-4297-882f-f946cdae7fc5","Type":"ContainerStarted","Data":"6af2e407b6efb99e2ad430f55bca69e828934dfdd2c3d657f2f3337c7045bece"} Jul 24 04:05:28.930092 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:28.930067 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r"] Jul 24 04:05:28.932369 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:05:28.932341 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode1b0bc91_ba71_4a7f_8266_0f0ddcc531c9.slice/crio-2f80585fedc17ef4b5cb9025fb6c5c10b253c6634a3dae87c2a9838d6f625a63 WatchSource:0}: Error finding container 2f80585fedc17ef4b5cb9025fb6c5c10b253c6634a3dae87c2a9838d6f625a63: Status 404 returned error can't find the container with id 2f80585fedc17ef4b5cb9025fb6c5c10b253c6634a3dae87c2a9838d6f625a63 Jul 24 04:05:29.935133 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:29.929366 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" event={"ID":"e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9","Type":"ContainerStarted","Data":"2f80585fedc17ef4b5cb9025fb6c5c10b253c6634a3dae87c2a9838d6f625a63"} Jul 24 04:05:30.935898 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:30.935864 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" event={"ID":"a12f01de-4a5c-4297-882f-f946cdae7fc5","Type":"ContainerStarted","Data":"da6efbd2e4ab30d5c81a5f41338c58330c3b512e6aa88c82889a69097fc00dcf"} Jul 24 04:05:30.936300 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:30.935976 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" Jul 24 04:05:30.966655 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:30.966604 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" podStartSLOduration=1.864566689 podStartE2EDuration="3.966587773s" totalImagesPullingTime="2.102021084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:30.965735158 +0000 UTC m=+343.199434829" watchObservedRunningTime="2026-07-24 04:05:30.966587773 +0000 UTC m=+343.200287443" Jul 24 04:05:32.946155 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:32.946120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" event={"ID":"e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9","Type":"ContainerStarted","Data":"6657fa785b82bbdd467eea7824b112796097a5218e196034aaf686b89ce8d6d6"} Jul 24 04:05:32.946505 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:32.946357 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" Jul 24 04:05:32.967934 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:32.967883 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" podStartSLOduration=2.066889735 podStartE2EDuration="5.967867826s" totalImagesPullingTime="3.900978091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:32.965922482 +0000 UTC m=+345.199622152" watchObservedRunningTime="2026-07-24 04:05:32.967867826 +0000 UTC m=+345.201567496" Jul 24 04:05:37.911689 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:05:37.911654 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65c5cbb794-ds6sj" Jul 24 04:06:01.946464 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:06:01.946379 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qtcf" Jul 24 04:06:03.952713 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:06:03.952681 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qrn2r" Jul 24 04:07:08.849940 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:08.849901 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk"] Jul 24 04:07:08.853334 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:08.853316 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk" Jul 24 04:07:08.856137 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:08.856111 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 04:07:08.856271 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:08.856160 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 24 04:07:08.856271 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:08.856227 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 04:07:08.857045 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:08.857027 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-r6n98\"" Jul 24 04:07:08.863170 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:08.863145 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk"] Jul 24 04:07:08.923418 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:08.923378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4nkq\" (UniqueName: \"kubernetes.io/projected/959fae1e-5601-4898-bf00-aee7c30e4299-kube-api-access-k4nkq\") pod \"dns-operator-controller-manager-864dd78c4c-xs6kk\" (UID: \"959fae1e-5601-4898-bf00-aee7c30e4299\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk" Jul 24 04:07:09.023797 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:09.023756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4nkq\" (UniqueName: \"kubernetes.io/projected/959fae1e-5601-4898-bf00-aee7c30e4299-kube-api-access-k4nkq\") pod \"dns-operator-controller-manager-864dd78c4c-xs6kk\" (UID: \"959fae1e-5601-4898-bf00-aee7c30e4299\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk" Jul 24 04:07:09.041051 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:09.041023 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4nkq\" (UniqueName: \"kubernetes.io/projected/959fae1e-5601-4898-bf00-aee7c30e4299-kube-api-access-k4nkq\") pod \"dns-operator-controller-manager-864dd78c4c-xs6kk\" (UID: \"959fae1e-5601-4898-bf00-aee7c30e4299\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk" Jul 24 04:07:09.163932 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:09.163843 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk" Jul 24 04:07:09.297726 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:09.297696 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk"] Jul 24 04:07:09.300422 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:07:09.300379 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959fae1e_5601_4898_bf00_aee7c30e4299.slice/crio-b6f5155693ef80171901562c3ba6b1b23045e35f154ec9e25a70406724ca9c41 WatchSource:0}: Error finding container b6f5155693ef80171901562c3ba6b1b23045e35f154ec9e25a70406724ca9c41: Status 404 returned error can't find the container with id b6f5155693ef80171901562c3ba6b1b23045e35f154ec9e25a70406724ca9c41 Jul 24 04:07:09.368130 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:09.368083 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk" event={"ID":"959fae1e-5601-4898-bf00-aee7c30e4299","Type":"ContainerStarted","Data":"b6f5155693ef80171901562c3ba6b1b23045e35f154ec9e25a70406724ca9c41"} Jul 24 04:07:10.852137 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:10.852050 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb"] Jul 24 04:07:10.855506 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:10.855481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:10.859033 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:10.859008 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xwjr6\"" Jul 24 04:07:10.872005 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:10.871928 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb"] Jul 24 04:07:10.937771 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:10.937730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgbzc\" (UniqueName: \"kubernetes.io/projected/b8ceb081-1e5a-4014-9502-022579169b91-kube-api-access-sgbzc\") pod \"limitador-operator-controller-manager-859d7b78bd-fvgtb\" (UID: \"b8ceb081-1e5a-4014-9502-022579169b91\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:11.039070 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:11.039029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgbzc\" (UniqueName: \"kubernetes.io/projected/b8ceb081-1e5a-4014-9502-022579169b91-kube-api-access-sgbzc\") pod \"limitador-operator-controller-manager-859d7b78bd-fvgtb\" (UID: \"b8ceb081-1e5a-4014-9502-022579169b91\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:11.048381 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:11.048346 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgbzc\" (UniqueName: \"kubernetes.io/projected/b8ceb081-1e5a-4014-9502-022579169b91-kube-api-access-sgbzc\") pod \"limitador-operator-controller-manager-859d7b78bd-fvgtb\" (UID: \"b8ceb081-1e5a-4014-9502-022579169b91\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:11.169380 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:11.169352 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:11.312629 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:11.312595 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb"] Jul 24 04:07:11.316070 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:07:11.316035 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ceb081_1e5a_4014_9502_022579169b91.slice/crio-bb78891a98ec86d2eef65722a6b104e5c4421ee457e8b8cf676eb559ad490924 WatchSource:0}: Error finding container bb78891a98ec86d2eef65722a6b104e5c4421ee457e8b8cf676eb559ad490924: Status 404 returned error can't find the container with id bb78891a98ec86d2eef65722a6b104e5c4421ee457e8b8cf676eb559ad490924 Jul 24 04:07:11.380844 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:11.380746 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk" event={"ID":"959fae1e-5601-4898-bf00-aee7c30e4299","Type":"ContainerStarted","Data":"ef9121ee915079d2749ff90f3f88ffcf0c83fed64e4656c63f1a1f27c455d07a"} Jul 24 04:07:11.380844 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:11.380815 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk" Jul 24 04:07:11.381947 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:11.381922 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" event={"ID":"b8ceb081-1e5a-4014-9502-022579169b91","Type":"ContainerStarted","Data":"bb78891a98ec86d2eef65722a6b104e5c4421ee457e8b8cf676eb559ad490924"} Jul 24 04:07:11.396867 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:11.396818 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk" podStartSLOduration=1.625799269 podStartE2EDuration="3.396801124s" totalImagesPullingTime="1.771001855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:07:11.395761311 +0000 UTC m=+443.629460984" watchObservedRunningTime="2026-07-24 04:07:11.396801124 +0000 UTC m=+443.630500795" Jul 24 04:07:13.394227 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:13.394125 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" event={"ID":"b8ceb081-1e5a-4014-9502-022579169b91","Type":"ContainerStarted","Data":"5c880cd6512dadd356667208093dd99d58cb0e067e43711e6918b49126d7ff7c"} Jul 24 04:07:13.394658 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:13.394269 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:13.416260 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:13.416210 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" podStartSLOduration=1.629405532 podStartE2EDuration="3.416195874s" totalImagesPullingTime="1.786790342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:07:13.415126468 +0000 UTC m=+445.648826151" watchObservedRunningTime="2026-07-24 04:07:13.416195874 +0000 UTC m=+445.649895546" Jul 24 04:07:22.390318 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:22.390283 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xs6kk" Jul 24 04:07:24.013656 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.013615 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb"] Jul 24 04:07:24.014105 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.013840 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" podUID="b8ceb081-1e5a-4014-9502-022579169b91" containerName="manager" containerID="cri-o://5c880cd6512dadd356667208093dd99d58cb0e067e43711e6918b49126d7ff7c" gracePeriod=2 Jul 24 04:07:24.015701 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.015676 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:24.039813 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.039776 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb"] Jul 24 04:07:24.047029 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:07:24.046954 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b8ceb081-1e5a-4014-9502-022579169b91\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-fvgtb\": pods \"limitador-operator-controller-manager-859d7b78bd-fvgtb\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:24.050171 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:07:24.050142 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fvgtb\" is forbidden: User \"system:node:ip-10-0-129-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-87.ec2.internal' and this object" podUID="b8ceb081-1e5a-4014-9502-022579169b91" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:24.062109 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.062082 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2"] Jul 24 04:07:24.062526 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.062506 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ceb081-1e5a-4014-9502-022579169b91" containerName="manager" Jul 24 04:07:24.062633 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.062528 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ceb081-1e5a-4014-9502-022579169b91" containerName="manager" Jul 24 04:07:24.062697 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.062651 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ceb081-1e5a-4014-9502-022579169b91" containerName="manager" Jul 24 04:07:24.065704 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.065685 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2" Jul 24 04:07:24.084274 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.084239 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2"] Jul 24 04:07:24.100608 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:07:24.100564 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fvgtb\" is forbidden: User \"system:node:ip-10-0-129-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-87.ec2.internal' and this object" podUID="b8ceb081-1e5a-4014-9502-022579169b91" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:24.132213 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.132070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f96qq\" (UniqueName: \"kubernetes.io/projected/198323c4-284e-4ca2-b596-fe5ee0cc89f8-kube-api-access-f96qq\") pod \"limitador-operator-controller-manager-859d7b78bd-77xl2\" (UID: \"198323c4-284e-4ca2-b596-fe5ee0cc89f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2" Jul 24 04:07:24.233185 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.233154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f96qq\" (UniqueName: \"kubernetes.io/projected/198323c4-284e-4ca2-b596-fe5ee0cc89f8-kube-api-access-f96qq\") pod \"limitador-operator-controller-manager-859d7b78bd-77xl2\" (UID: \"198323c4-284e-4ca2-b596-fe5ee0cc89f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2" Jul 24 04:07:24.241519 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.241492 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f96qq\" (UniqueName: \"kubernetes.io/projected/198323c4-284e-4ca2-b596-fe5ee0cc89f8-kube-api-access-f96qq\") pod \"limitador-operator-controller-manager-859d7b78bd-77xl2\" (UID: \"198323c4-284e-4ca2-b596-fe5ee0cc89f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2" Jul 24 04:07:24.259125 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.259098 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:24.261235 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:07:24.261206 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fvgtb\" is forbidden: User \"system:node:ip-10-0-129-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-87.ec2.internal' and this object" podUID="b8ceb081-1e5a-4014-9502-022579169b91" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:24.393232 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.393138 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2" Jul 24 04:07:24.435255 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.435217 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgbzc\" (UniqueName: \"kubernetes.io/projected/b8ceb081-1e5a-4014-9502-022579169b91-kube-api-access-sgbzc\") pod \"b8ceb081-1e5a-4014-9502-022579169b91\" (UID: \"b8ceb081-1e5a-4014-9502-022579169b91\") " Jul 24 04:07:24.437330 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.437298 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ceb081-1e5a-4014-9502-022579169b91-kube-api-access-sgbzc" (OuterVolumeSpecName: "kube-api-access-sgbzc") pod "b8ceb081-1e5a-4014-9502-022579169b91" (UID: "b8ceb081-1e5a-4014-9502-022579169b91"). InnerVolumeSpecName "kube-api-access-sgbzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:07:24.451304 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.451263 2578 generic.go:356] "Generic (PLEG): container finished" podID="b8ceb081-1e5a-4014-9502-022579169b91" containerID="5c880cd6512dadd356667208093dd99d58cb0e067e43711e6918b49126d7ff7c" exitCode=0 Jul 24 04:07:24.451460 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.451365 2578 scope.go:117] "RemoveContainer" containerID="5c880cd6512dadd356667208093dd99d58cb0e067e43711e6918b49126d7ff7c" Jul 24 04:07:24.451528 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.451470 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvgtb" Jul 24 04:07:24.464252 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.464227 2578 scope.go:117] "RemoveContainer" containerID="5c880cd6512dadd356667208093dd99d58cb0e067e43711e6918b49126d7ff7c" Jul 24 04:07:24.464577 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:07:24.464549 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c880cd6512dadd356667208093dd99d58cb0e067e43711e6918b49126d7ff7c\": container with ID starting with 5c880cd6512dadd356667208093dd99d58cb0e067e43711e6918b49126d7ff7c not found: ID does not exist" containerID="5c880cd6512dadd356667208093dd99d58cb0e067e43711e6918b49126d7ff7c" Jul 24 04:07:24.464653 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.464591 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c880cd6512dadd356667208093dd99d58cb0e067e43711e6918b49126d7ff7c"} err="failed to get container status \"5c880cd6512dadd356667208093dd99d58cb0e067e43711e6918b49126d7ff7c\": rpc error: code = NotFound desc = could not find container \"5c880cd6512dadd356667208093dd99d58cb0e067e43711e6918b49126d7ff7c\": container with ID starting with 5c880cd6512dadd356667208093dd99d58cb0e067e43711e6918b49126d7ff7c not found: ID does not exist" Jul 24 04:07:24.536424 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.536377 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgbzc\" (UniqueName: \"kubernetes.io/projected/b8ceb081-1e5a-4014-9502-022579169b91-kube-api-access-sgbzc\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:07:24.575199 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:24.575173 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2"] Jul 24 04:07:24.577769 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:07:24.577744 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198323c4_284e_4ca2_b596_fe5ee0cc89f8.slice/crio-ce63a6d02c9a36a571fb9e6105c82213149823328ba3fb00cd7946203b7cfa15 WatchSource:0}: Error finding container ce63a6d02c9a36a571fb9e6105c82213149823328ba3fb00cd7946203b7cfa15: Status 404 returned error can't find the container with id ce63a6d02c9a36a571fb9e6105c82213149823328ba3fb00cd7946203b7cfa15 Jul 24 04:07:25.457631 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:25.457529 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2" event={"ID":"198323c4-284e-4ca2-b596-fe5ee0cc89f8","Type":"ContainerStarted","Data":"109487917ce96d358d259a18202b0678d50d4a6fe3564b60f9b9d14d129fe409"} Jul 24 04:07:25.457631 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:25.457599 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2" event={"ID":"198323c4-284e-4ca2-b596-fe5ee0cc89f8","Type":"ContainerStarted","Data":"ce63a6d02c9a36a571fb9e6105c82213149823328ba3fb00cd7946203b7cfa15"} Jul 24 04:07:25.458117 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:25.457699 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2" Jul 24 04:07:25.480497 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:25.480450 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2" podStartSLOduration=1.480435125 podStartE2EDuration="1.480435125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:07:25.478997841 +0000 UTC m=+457.712697515" watchObservedRunningTime="2026-07-24 04:07:25.480435125 +0000 UTC m=+457.714134861" Jul 24 04:07:26.260398 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:26.260362 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ceb081-1e5a-4014-9502-022579169b91" path="/var/lib/kubelet/pods/b8ceb081-1e5a-4014-9502-022579169b91/volumes" Jul 24 04:07:36.465745 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:36.465715 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-77xl2" Jul 24 04:07:55.678844 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:55.678806 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-9ttvg"] Jul 24 04:07:55.686713 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:55.686663 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9ttvg" Jul 24 04:07:55.689071 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:55.689040 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9ttvg"] Jul 24 04:07:55.689745 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:55.689724 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gqhbd\"" Jul 24 04:07:55.792741 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:55.792709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhg9s\" (UniqueName: \"kubernetes.io/projected/40094751-176a-4cd9-b09d-0b4b8f0be763-kube-api-access-dhg9s\") pod \"authorino-75d556bd77-9ttvg\" (UID: \"40094751-176a-4cd9-b09d-0b4b8f0be763\") " pod="kuadrant-system/authorino-75d556bd77-9ttvg" Jul 24 04:07:55.893806 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:55.893769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhg9s\" (UniqueName: \"kubernetes.io/projected/40094751-176a-4cd9-b09d-0b4b8f0be763-kube-api-access-dhg9s\") pod \"authorino-75d556bd77-9ttvg\" (UID: \"40094751-176a-4cd9-b09d-0b4b8f0be763\") " pod="kuadrant-system/authorino-75d556bd77-9ttvg" Jul 24 04:07:55.901509 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:55.901476 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhg9s\" (UniqueName: \"kubernetes.io/projected/40094751-176a-4cd9-b09d-0b4b8f0be763-kube-api-access-dhg9s\") pod \"authorino-75d556bd77-9ttvg\" (UID: \"40094751-176a-4cd9-b09d-0b4b8f0be763\") " pod="kuadrant-system/authorino-75d556bd77-9ttvg" Jul 24 04:07:55.997677 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:55.997645 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9ttvg" Jul 24 04:07:56.136349 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:56.136313 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9ttvg"] Jul 24 04:07:56.139786 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:07:56.139753 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40094751_176a_4cd9_b09d_0b4b8f0be763.slice/crio-af7a528a6ef985c06cfc101c90da09d29e522a5f8189dddb07250a1291491661 WatchSource:0}: Error finding container af7a528a6ef985c06cfc101c90da09d29e522a5f8189dddb07250a1291491661: Status 404 returned error can't find the container with id af7a528a6ef985c06cfc101c90da09d29e522a5f8189dddb07250a1291491661 Jul 24 04:07:56.603062 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:56.603023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9ttvg" event={"ID":"40094751-176a-4cd9-b09d-0b4b8f0be763","Type":"ContainerStarted","Data":"af7a528a6ef985c06cfc101c90da09d29e522a5f8189dddb07250a1291491661"} Jul 24 04:07:59.623897 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:59.623858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9ttvg" event={"ID":"40094751-176a-4cd9-b09d-0b4b8f0be763","Type":"ContainerStarted","Data":"954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c"} Jul 24 04:07:59.638224 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:07:59.638171 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-9ttvg" podStartSLOduration=1.320198398 podStartE2EDuration="4.638152418s" totalImagesPullingTime="3.31795402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:07:59.6369241 +0000 UTC m=+491.870623772" watchObservedRunningTime="2026-07-24 04:07:59.638152418 +0000 UTC m=+491.871852090" Jul 24 04:08:24.056100 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.056058 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b9sqd"] Jul 24 04:08:24.059578 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.059550 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b9sqd" Jul 24 04:08:24.065042 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.065010 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b9sqd"] Jul 24 04:08:24.129424 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.129386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72dtf\" (UniqueName: \"kubernetes.io/projected/8fd55b70-99f5-4371-80cb-940ee0e4be49-kube-api-access-72dtf\") pod \"authorino-5d4b67c446-b9sqd\" (UID: \"8fd55b70-99f5-4371-80cb-940ee0e4be49\") " pod="kuadrant-system/authorino-5d4b67c446-b9sqd" Jul 24 04:08:24.225015 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.224981 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b9sqd"] Jul 24 04:08:24.225263 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:08:24.225242 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-72dtf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-b9sqd" podUID="8fd55b70-99f5-4371-80cb-940ee0e4be49" Jul 24 04:08:24.230567 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.230536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72dtf\" (UniqueName: \"kubernetes.io/projected/8fd55b70-99f5-4371-80cb-940ee0e4be49-kube-api-access-72dtf\") pod \"authorino-5d4b67c446-b9sqd\" (UID: \"8fd55b70-99f5-4371-80cb-940ee0e4be49\") " pod="kuadrant-system/authorino-5d4b67c446-b9sqd" Jul 24 04:08:24.238809 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.238782 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72dtf\" (UniqueName: \"kubernetes.io/projected/8fd55b70-99f5-4371-80cb-940ee0e4be49-kube-api-access-72dtf\") pod \"authorino-5d4b67c446-b9sqd\" (UID: \"8fd55b70-99f5-4371-80cb-940ee0e4be49\") " pod="kuadrant-system/authorino-5d4b67c446-b9sqd" Jul 24 04:08:24.254231 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.254198 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-bm8kf"] Jul 24 04:08:24.257688 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.257660 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-bm8kf" Jul 24 04:08:24.260175 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.260154 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 24 04:08:24.264372 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.264351 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-bm8kf"] Jul 24 04:08:24.303051 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.303018 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-bm8kf"] Jul 24 04:08:24.303285 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:08:24.303268 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ngt4w tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-ngt4w tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-bm8kf" podUID="f54710c4-cfd2-4a73-a6f8-c94c3339b07a" Jul 24 04:08:24.328703 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.328624 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7497d464cb-dvnq6"] Jul 24 04:08:24.331220 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.331194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngt4w\" (UniqueName: \"kubernetes.io/projected/f54710c4-cfd2-4a73-a6f8-c94c3339b07a-kube-api-access-ngt4w\") pod \"authorino-76877994-bm8kf\" (UID: \"f54710c4-cfd2-4a73-a6f8-c94c3339b07a\") " pod="kuadrant-system/authorino-76877994-bm8kf" Jul 24 04:08:24.331348 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.331250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f54710c4-cfd2-4a73-a6f8-c94c3339b07a-tls-cert\") pod \"authorino-76877994-bm8kf\" (UID: \"f54710c4-cfd2-4a73-a6f8-c94c3339b07a\") " pod="kuadrant-system/authorino-76877994-bm8kf" Jul 24 04:08:24.331990 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.331975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7497d464cb-dvnq6" Jul 24 04:08:24.343251 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.343227 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7497d464cb-dvnq6"] Jul 24 04:08:24.431696 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.431657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f54710c4-cfd2-4a73-a6f8-c94c3339b07a-tls-cert\") pod \"authorino-76877994-bm8kf\" (UID: \"f54710c4-cfd2-4a73-a6f8-c94c3339b07a\") " pod="kuadrant-system/authorino-76877994-bm8kf" Jul 24 04:08:24.431872 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.431714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e2c5afa-19ad-41df-a410-4e88892169b1-tls-cert\") pod \"authorino-7497d464cb-dvnq6\" (UID: \"8e2c5afa-19ad-41df-a410-4e88892169b1\") " pod="kuadrant-system/authorino-7497d464cb-dvnq6" Jul 24 04:08:24.431872 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.431738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6vpw\" (UniqueName: \"kubernetes.io/projected/8e2c5afa-19ad-41df-a410-4e88892169b1-kube-api-access-m6vpw\") pod \"authorino-7497d464cb-dvnq6\" (UID: \"8e2c5afa-19ad-41df-a410-4e88892169b1\") " pod="kuadrant-system/authorino-7497d464cb-dvnq6" Jul 24 04:08:24.431872 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.431848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngt4w\" (UniqueName: \"kubernetes.io/projected/f54710c4-cfd2-4a73-a6f8-c94c3339b07a-kube-api-access-ngt4w\") pod \"authorino-76877994-bm8kf\" (UID: \"f54710c4-cfd2-4a73-a6f8-c94c3339b07a\") " pod="kuadrant-system/authorino-76877994-bm8kf" Jul 24 04:08:24.434276 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.434253 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f54710c4-cfd2-4a73-a6f8-c94c3339b07a-tls-cert\") pod \"authorino-76877994-bm8kf\" (UID: \"f54710c4-cfd2-4a73-a6f8-c94c3339b07a\") " pod="kuadrant-system/authorino-76877994-bm8kf" Jul 24 04:08:24.440017 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.439991 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngt4w\" (UniqueName: \"kubernetes.io/projected/f54710c4-cfd2-4a73-a6f8-c94c3339b07a-kube-api-access-ngt4w\") pod \"authorino-76877994-bm8kf\" (UID: \"f54710c4-cfd2-4a73-a6f8-c94c3339b07a\") " pod="kuadrant-system/authorino-76877994-bm8kf" Jul 24 04:08:24.532931 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.532888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e2c5afa-19ad-41df-a410-4e88892169b1-tls-cert\") pod \"authorino-7497d464cb-dvnq6\" (UID: \"8e2c5afa-19ad-41df-a410-4e88892169b1\") " pod="kuadrant-system/authorino-7497d464cb-dvnq6" Jul 24 04:08:24.532931 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.532936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6vpw\" (UniqueName: \"kubernetes.io/projected/8e2c5afa-19ad-41df-a410-4e88892169b1-kube-api-access-m6vpw\") pod \"authorino-7497d464cb-dvnq6\" (UID: \"8e2c5afa-19ad-41df-a410-4e88892169b1\") " pod="kuadrant-system/authorino-7497d464cb-dvnq6" Jul 24 04:08:24.535424 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.535402 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e2c5afa-19ad-41df-a410-4e88892169b1-tls-cert\") pod \"authorino-7497d464cb-dvnq6\" (UID: \"8e2c5afa-19ad-41df-a410-4e88892169b1\") " pod="kuadrant-system/authorino-7497d464cb-dvnq6" Jul 24 04:08:24.541012 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.540990 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6vpw\" (UniqueName: \"kubernetes.io/projected/8e2c5afa-19ad-41df-a410-4e88892169b1-kube-api-access-m6vpw\") pod \"authorino-7497d464cb-dvnq6\" (UID: \"8e2c5afa-19ad-41df-a410-4e88892169b1\") " pod="kuadrant-system/authorino-7497d464cb-dvnq6" Jul 24 04:08:24.641246 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.641156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7497d464cb-dvnq6" Jul 24 04:08:24.736849 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.736791 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b9sqd" Jul 24 04:08:24.736849 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.736831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-bm8kf" Jul 24 04:08:24.746711 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.746680 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b9sqd" Jul 24 04:08:24.750351 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.750293 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-bm8kf" Jul 24 04:08:24.777556 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.777533 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7497d464cb-dvnq6"] Jul 24 04:08:24.780106 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:08:24.780079 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e2c5afa_19ad_41df_a410_4e88892169b1.slice/crio-07e98530cd06afda40ba0dbbe92c1faf2cfc211bc92f9ad6ea9e8f5dac2dc73c WatchSource:0}: Error finding container 07e98530cd06afda40ba0dbbe92c1faf2cfc211bc92f9ad6ea9e8f5dac2dc73c: Status 404 returned error can't find the container with id 07e98530cd06afda40ba0dbbe92c1faf2cfc211bc92f9ad6ea9e8f5dac2dc73c Jul 24 04:08:24.834157 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.834124 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72dtf\" (UniqueName: \"kubernetes.io/projected/8fd55b70-99f5-4371-80cb-940ee0e4be49-kube-api-access-72dtf\") pod \"8fd55b70-99f5-4371-80cb-940ee0e4be49\" (UID: \"8fd55b70-99f5-4371-80cb-940ee0e4be49\") " Jul 24 04:08:24.834319 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.834170 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngt4w\" (UniqueName: \"kubernetes.io/projected/f54710c4-cfd2-4a73-a6f8-c94c3339b07a-kube-api-access-ngt4w\") pod \"f54710c4-cfd2-4a73-a6f8-c94c3339b07a\" (UID: \"f54710c4-cfd2-4a73-a6f8-c94c3339b07a\") " Jul 24 04:08:24.834319 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.834264 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f54710c4-cfd2-4a73-a6f8-c94c3339b07a-tls-cert\") pod \"f54710c4-cfd2-4a73-a6f8-c94c3339b07a\" (UID: \"f54710c4-cfd2-4a73-a6f8-c94c3339b07a\") " Jul 24 04:08:24.836300 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.836264 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fd55b70-99f5-4371-80cb-940ee0e4be49-kube-api-access-72dtf" (OuterVolumeSpecName: "kube-api-access-72dtf") pod "8fd55b70-99f5-4371-80cb-940ee0e4be49" (UID: "8fd55b70-99f5-4371-80cb-940ee0e4be49"). InnerVolumeSpecName "kube-api-access-72dtf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:08:24.836300 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.836281 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f54710c4-cfd2-4a73-a6f8-c94c3339b07a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f54710c4-cfd2-4a73-a6f8-c94c3339b07a" (UID: "f54710c4-cfd2-4a73-a6f8-c94c3339b07a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:08:24.836300 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.836297 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f54710c4-cfd2-4a73-a6f8-c94c3339b07a-kube-api-access-ngt4w" (OuterVolumeSpecName: "kube-api-access-ngt4w") pod "f54710c4-cfd2-4a73-a6f8-c94c3339b07a" (UID: "f54710c4-cfd2-4a73-a6f8-c94c3339b07a"). InnerVolumeSpecName "kube-api-access-ngt4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:08:24.934903 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.934823 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72dtf\" (UniqueName: \"kubernetes.io/projected/8fd55b70-99f5-4371-80cb-940ee0e4be49-kube-api-access-72dtf\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:08:24.934903 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.934853 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngt4w\" (UniqueName: \"kubernetes.io/projected/f54710c4-cfd2-4a73-a6f8-c94c3339b07a-kube-api-access-ngt4w\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:08:24.934903 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:24.934863 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f54710c4-cfd2-4a73-a6f8-c94c3339b07a-tls-cert\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:08:25.742954 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:25.742913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7497d464cb-dvnq6" event={"ID":"8e2c5afa-19ad-41df-a410-4e88892169b1","Type":"ContainerStarted","Data":"2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e"} Jul 24 04:08:25.742954 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:25.742957 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-bm8kf" Jul 24 04:08:25.743519 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:25.742975 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7497d464cb-dvnq6" event={"ID":"8e2c5afa-19ad-41df-a410-4e88892169b1","Type":"ContainerStarted","Data":"07e98530cd06afda40ba0dbbe92c1faf2cfc211bc92f9ad6ea9e8f5dac2dc73c"} Jul 24 04:08:25.743519 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:25.743151 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b9sqd" Jul 24 04:08:25.763580 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:25.763536 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7497d464cb-dvnq6" podStartSLOduration=1.277553714 podStartE2EDuration="1.763522337s" totalImagesPullingTime="485.968623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:08:25.762025208 +0000 UTC m=+517.995724881" watchObservedRunningTime="2026-07-24 04:08:25.763522337 +0000 UTC m=+517.997222009" Jul 24 04:08:25.798293 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:25.798261 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9ttvg"] Jul 24 04:08:25.798488 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:25.798448 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-9ttvg" podUID="40094751-176a-4cd9-b09d-0b4b8f0be763" containerName="authorino" containerID="cri-o://954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c" gracePeriod=30 Jul 24 04:08:25.803945 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:25.803917 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b9sqd"] Jul 24 04:08:25.814134 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:25.814113 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b9sqd"] Jul 24 04:08:25.848434 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:25.848406 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-bm8kf"] Jul 24 04:08:25.864305 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:25.864276 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-bm8kf"] Jul 24 04:08:26.042280 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.042253 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9ttvg" Jul 24 04:08:26.044220 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.044203 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhg9s\" (UniqueName: \"kubernetes.io/projected/40094751-176a-4cd9-b09d-0b4b8f0be763-kube-api-access-dhg9s\") pod \"40094751-176a-4cd9-b09d-0b4b8f0be763\" (UID: \"40094751-176a-4cd9-b09d-0b4b8f0be763\") " Jul 24 04:08:26.046139 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.046110 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40094751-176a-4cd9-b09d-0b4b8f0be763-kube-api-access-dhg9s" (OuterVolumeSpecName: "kube-api-access-dhg9s") pod "40094751-176a-4cd9-b09d-0b4b8f0be763" (UID: "40094751-176a-4cd9-b09d-0b4b8f0be763"). InnerVolumeSpecName "kube-api-access-dhg9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:08:26.145556 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.145513 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhg9s\" (UniqueName: \"kubernetes.io/projected/40094751-176a-4cd9-b09d-0b4b8f0be763-kube-api-access-dhg9s\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:08:26.261188 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.261159 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fd55b70-99f5-4371-80cb-940ee0e4be49" path="/var/lib/kubelet/pods/8fd55b70-99f5-4371-80cb-940ee0e4be49/volumes" Jul 24 04:08:26.261441 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.261429 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f54710c4-cfd2-4a73-a6f8-c94c3339b07a" path="/var/lib/kubelet/pods/f54710c4-cfd2-4a73-a6f8-c94c3339b07a/volumes" Jul 24 04:08:26.749260 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.749223 2578 generic.go:356] "Generic (PLEG): container finished" podID="40094751-176a-4cd9-b09d-0b4b8f0be763" containerID="954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c" exitCode=0 Jul 24 04:08:26.749260 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.749265 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9ttvg" Jul 24 04:08:26.749720 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.749307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9ttvg" event={"ID":"40094751-176a-4cd9-b09d-0b4b8f0be763","Type":"ContainerDied","Data":"954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c"} Jul 24 04:08:26.749720 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.749347 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9ttvg" event={"ID":"40094751-176a-4cd9-b09d-0b4b8f0be763","Type":"ContainerDied","Data":"af7a528a6ef985c06cfc101c90da09d29e522a5f8189dddb07250a1291491661"} Jul 24 04:08:26.749720 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.749366 2578 scope.go:117] "RemoveContainer" containerID="954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c" Jul 24 04:08:26.760038 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.760013 2578 scope.go:117] "RemoveContainer" containerID="954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c" Jul 24 04:08:26.760508 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:08:26.760489 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c\": container with ID starting with 954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c not found: ID does not exist" containerID="954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c" Jul 24 04:08:26.760597 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.760516 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c"} err="failed to get container status \"954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c\": rpc error: code = NotFound desc = could not find container \"954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c\": container with ID starting with 954a3c1813c1eb62093e036f291255eaae76b34dfedb99cd4d2af86645fd0d9c not found: ID does not exist" Jul 24 04:08:26.765947 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.765922 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9ttvg"] Jul 24 04:08:26.771911 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:26.771891 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9ttvg"] Jul 24 04:08:28.260573 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:08:28.260540 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40094751-176a-4cd9-b09d-0b4b8f0be763" path="/var/lib/kubelet/pods/40094751-176a-4cd9-b09d-0b4b8f0be763/volumes" Jul 24 04:09:30.586776 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.586740 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f"] Jul 24 04:09:30.587392 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.587371 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40094751-176a-4cd9-b09d-0b4b8f0be763" containerName="authorino" Jul 24 04:09:30.587479 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.587397 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="40094751-176a-4cd9-b09d-0b4b8f0be763" containerName="authorino" Jul 24 04:09:30.587537 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.587519 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="40094751-176a-4cd9-b09d-0b4b8f0be763" containerName="authorino" Jul 24 04:09:30.590671 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.590644 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.593200 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.593172 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 04:09:30.593333 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.593175 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 04:09:30.593333 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.593266 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 24 04:09:30.593437 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.593274 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wfpq8\"" Jul 24 04:09:30.599135 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.598617 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f"] Jul 24 04:09:30.651430 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.651390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.651617 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.651444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.651617 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.651478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.651617 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.651494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.651617 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.651524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.651617 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.651592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkkmd\" (UniqueName: \"kubernetes.io/projected/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-kube-api-access-fkkmd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.752132 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.752099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.752132 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.752142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.752397 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.752161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.752397 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.752177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.752397 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.752208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.752397 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.752242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkkmd\" (UniqueName: \"kubernetes.io/projected/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-kube-api-access-fkkmd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.752616 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.752521 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.752616 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.752585 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.752616 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.752582 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.754522 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.754495 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.754685 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.754669 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.759887 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.759865 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkkmd\" (UniqueName: \"kubernetes.io/projected/edcc41c8-69ed-4ced-b94f-ce61e63d7a01-kube-api-access-fkkmd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f\" (UID: \"edcc41c8-69ed-4ced-b94f-ce61e63d7a01\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:30.904278 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:30.904187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:31.041884 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:31.041855 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f"] Jul 24 04:09:31.044785 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:09:31.044756 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedcc41c8_69ed_4ced_b94f_ce61e63d7a01.slice/crio-2df6b99d6dbc0fa92f437b533fd30c5c3b2f58838315a659de4136b6a8eda61d WatchSource:0}: Error finding container 2df6b99d6dbc0fa92f437b533fd30c5c3b2f58838315a659de4136b6a8eda61d: Status 404 returned error can't find the container with id 2df6b99d6dbc0fa92f437b533fd30c5c3b2f58838315a659de4136b6a8eda61d Jul 24 04:09:32.054263 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:32.054226 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" event={"ID":"edcc41c8-69ed-4ced-b94f-ce61e63d7a01","Type":"ContainerStarted","Data":"2df6b99d6dbc0fa92f437b533fd30c5c3b2f58838315a659de4136b6a8eda61d"} Jul 24 04:09:33.060797 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:33.060756 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" event={"ID":"edcc41c8-69ed-4ced-b94f-ce61e63d7a01","Type":"ContainerStarted","Data":"364f6ebdecf8894b9302402ca40b5de01efaa4a33dd1c4d020ac92d4005a0f44"} Jul 24 04:09:33.081318 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:33.081263 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" podStartSLOduration=1.8614842390000002 podStartE2EDuration="3.081246973s" totalImagesPullingTime="1.219762734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:09:33.080076266 +0000 UTC m=+585.313775938" watchObservedRunningTime="2026-07-24 04:09:33.081246973 +0000 UTC m=+585.314946641" Jul 24 04:09:40.905276 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:40.905231 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:40.905716 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:40.905304 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:40.919465 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:40.919437 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:41.107618 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:41.107588 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f" Jul 24 04:09:48.221438 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:48.221414 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/2.log" Jul 24 04:09:48.233076 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:09:48.233054 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/2.log" Jul 24 04:10:09.670619 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.670583 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v"] Jul 24 04:10:09.676829 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.676807 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.679647 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.679621 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 24 04:10:09.684681 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.684656 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v"] Jul 24 04:10:09.789141 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.789107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4w7c\" (UniqueName: \"kubernetes.io/projected/b424ea3e-be35-4b97-85ae-727aa5eb48b1-kube-api-access-m4w7c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.789338 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.789149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b424ea3e-be35-4b97-85ae-727aa5eb48b1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.789338 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.789173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b424ea3e-be35-4b97-85ae-727aa5eb48b1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.789338 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.789239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b424ea3e-be35-4b97-85ae-727aa5eb48b1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.789338 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.789271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b424ea3e-be35-4b97-85ae-727aa5eb48b1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.789338 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.789309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b424ea3e-be35-4b97-85ae-727aa5eb48b1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.890315 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.890275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b424ea3e-be35-4b97-85ae-727aa5eb48b1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.890485 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.890326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4w7c\" (UniqueName: \"kubernetes.io/projected/b424ea3e-be35-4b97-85ae-727aa5eb48b1-kube-api-access-m4w7c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.890485 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.890355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b424ea3e-be35-4b97-85ae-727aa5eb48b1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.890485 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.890375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b424ea3e-be35-4b97-85ae-727aa5eb48b1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.890485 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.890394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b424ea3e-be35-4b97-85ae-727aa5eb48b1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.890485 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.890416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b424ea3e-be35-4b97-85ae-727aa5eb48b1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.890886 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.890862 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b424ea3e-be35-4b97-85ae-727aa5eb48b1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.890995 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.890863 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b424ea3e-be35-4b97-85ae-727aa5eb48b1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.890995 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.890899 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b424ea3e-be35-4b97-85ae-727aa5eb48b1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.892748 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.892723 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b424ea3e-be35-4b97-85ae-727aa5eb48b1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.892923 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.892906 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b424ea3e-be35-4b97-85ae-727aa5eb48b1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.898004 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.897980 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4w7c\" (UniqueName: \"kubernetes.io/projected/b424ea3e-be35-4b97-85ae-727aa5eb48b1-kube-api-access-m4w7c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7sz5v\" (UID: \"b424ea3e-be35-4b97-85ae-727aa5eb48b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:09.988930 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:09.988900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:10.127849 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:10.127825 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v"] Jul 24 04:10:10.130512 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:10:10.130468 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb424ea3e_be35_4b97_85ae_727aa5eb48b1.slice/crio-1c258a3fbc1a1eabdfd6a24f196d57a11b8f07ea2c48b6185216d6cf5416b2f6 WatchSource:0}: Error finding container 1c258a3fbc1a1eabdfd6a24f196d57a11b8f07ea2c48b6185216d6cf5416b2f6: Status 404 returned error can't find the container with id 1c258a3fbc1a1eabdfd6a24f196d57a11b8f07ea2c48b6185216d6cf5416b2f6 Jul 24 04:10:10.131884 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:10.131866 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 04:10:10.238098 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:10.238062 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" event={"ID":"b424ea3e-be35-4b97-85ae-727aa5eb48b1","Type":"ContainerStarted","Data":"1c258a3fbc1a1eabdfd6a24f196d57a11b8f07ea2c48b6185216d6cf5416b2f6"} Jul 24 04:10:11.245038 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:11.244997 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" event={"ID":"b424ea3e-be35-4b97-85ae-727aa5eb48b1","Type":"ContainerStarted","Data":"ece03b70742d4363a5b85df13726d26b49dc965578b0304f0eb9cab414e24f33"} Jul 24 04:10:11.263184 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:11.263133 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" podStartSLOduration=1.850747123 podStartE2EDuration="2.263116032s" totalImagesPullingTime="412.368909ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:10:11.260701731 +0000 UTC m=+623.494401404" watchObservedRunningTime="2026-07-24 04:10:11.263116032 +0000 UTC m=+623.496815703" Jul 24 04:10:19.989297 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:19.989259 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:19.989779 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:19.989327 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:20.001953 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:20.001924 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:10:20.298173 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:10:20.298084 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7sz5v" Jul 24 04:12:05.477101 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:05.477023 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-769795b965-2xgpv"] Jul 24 04:12:05.480502 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:05.480478 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-769795b965-2xgpv" Jul 24 04:12:05.486274 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:05.486251 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-769795b965-2xgpv"] Jul 24 04:12:05.611146 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:05.610736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvllz\" (UniqueName: \"kubernetes.io/projected/15f0c9f7-a205-43a1-9d26-1df84e23a766-kube-api-access-wvllz\") pod \"authorino-769795b965-2xgpv\" (UID: \"15f0c9f7-a205-43a1-9d26-1df84e23a766\") " pod="kuadrant-system/authorino-769795b965-2xgpv" Jul 24 04:12:05.611344 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:05.611234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15f0c9f7-a205-43a1-9d26-1df84e23a766-tls-cert\") pod \"authorino-769795b965-2xgpv\" (UID: \"15f0c9f7-a205-43a1-9d26-1df84e23a766\") " pod="kuadrant-system/authorino-769795b965-2xgpv" Jul 24 04:12:05.711772 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:05.711736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvllz\" (UniqueName: \"kubernetes.io/projected/15f0c9f7-a205-43a1-9d26-1df84e23a766-kube-api-access-wvllz\") pod \"authorino-769795b965-2xgpv\" (UID: \"15f0c9f7-a205-43a1-9d26-1df84e23a766\") " pod="kuadrant-system/authorino-769795b965-2xgpv" Jul 24 04:12:05.711960 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:05.711808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15f0c9f7-a205-43a1-9d26-1df84e23a766-tls-cert\") pod \"authorino-769795b965-2xgpv\" (UID: \"15f0c9f7-a205-43a1-9d26-1df84e23a766\") " pod="kuadrant-system/authorino-769795b965-2xgpv" Jul 24 04:12:05.714245 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:05.714220 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15f0c9f7-a205-43a1-9d26-1df84e23a766-tls-cert\") pod \"authorino-769795b965-2xgpv\" (UID: \"15f0c9f7-a205-43a1-9d26-1df84e23a766\") " pod="kuadrant-system/authorino-769795b965-2xgpv" Jul 24 04:12:05.720583 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:05.720558 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvllz\" (UniqueName: \"kubernetes.io/projected/15f0c9f7-a205-43a1-9d26-1df84e23a766-kube-api-access-wvllz\") pod \"authorino-769795b965-2xgpv\" (UID: \"15f0c9f7-a205-43a1-9d26-1df84e23a766\") " pod="kuadrant-system/authorino-769795b965-2xgpv" Jul 24 04:12:05.790632 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:05.790600 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-769795b965-2xgpv" Jul 24 04:12:05.927684 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:05.927655 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-769795b965-2xgpv"] Jul 24 04:12:05.929958 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:12:05.929931 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15f0c9f7_a205_43a1_9d26_1df84e23a766.slice/crio-a79126d3816c813148c89c42e32c9093e1ea5cca31659eeb1447dfc95f48ae4a WatchSource:0}: Error finding container a79126d3816c813148c89c42e32c9093e1ea5cca31659eeb1447dfc95f48ae4a: Status 404 returned error can't find the container with id a79126d3816c813148c89c42e32c9093e1ea5cca31659eeb1447dfc95f48ae4a Jul 24 04:12:06.783327 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:06.783285 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-769795b965-2xgpv" event={"ID":"15f0c9f7-a205-43a1-9d26-1df84e23a766","Type":"ContainerStarted","Data":"7a80c9e9b72b54a3dde90ae8b7954c5cb55ebb3926864655ec00a6d373bc1733"} Jul 24 04:12:06.783927 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:06.783342 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-769795b965-2xgpv" event={"ID":"15f0c9f7-a205-43a1-9d26-1df84e23a766","Type":"ContainerStarted","Data":"a79126d3816c813148c89c42e32c9093e1ea5cca31659eeb1447dfc95f48ae4a"} Jul 24 04:12:06.801851 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:06.801777 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-769795b965-2xgpv" podStartSLOduration=1.446705358 podStartE2EDuration="1.801757107s" totalImagesPullingTime="355.051749ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:12:06.799813119 +0000 UTC m=+739.033512792" watchObservedRunningTime="2026-07-24 04:12:06.801757107 +0000 UTC m=+739.035456777" Jul 24 04:12:06.828405 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:06.828370 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7497d464cb-dvnq6"] Jul 24 04:12:06.828630 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:06.828580 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7497d464cb-dvnq6" podUID="8e2c5afa-19ad-41df-a410-4e88892169b1" containerName="authorino" containerID="cri-o://2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e" gracePeriod=30 Jul 24 04:12:07.091373 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.091345 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7497d464cb-dvnq6" Jul 24 04:12:07.227284 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.227249 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e2c5afa-19ad-41df-a410-4e88892169b1-tls-cert\") pod \"8e2c5afa-19ad-41df-a410-4e88892169b1\" (UID: \"8e2c5afa-19ad-41df-a410-4e88892169b1\") " Jul 24 04:12:07.227467 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.227317 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6vpw\" (UniqueName: \"kubernetes.io/projected/8e2c5afa-19ad-41df-a410-4e88892169b1-kube-api-access-m6vpw\") pod \"8e2c5afa-19ad-41df-a410-4e88892169b1\" (UID: \"8e2c5afa-19ad-41df-a410-4e88892169b1\") " Jul 24 04:12:07.229426 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.229394 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2c5afa-19ad-41df-a410-4e88892169b1-kube-api-access-m6vpw" (OuterVolumeSpecName: "kube-api-access-m6vpw") pod "8e2c5afa-19ad-41df-a410-4e88892169b1" (UID: "8e2c5afa-19ad-41df-a410-4e88892169b1"). InnerVolumeSpecName "kube-api-access-m6vpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:12:07.238273 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.238243 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e2c5afa-19ad-41df-a410-4e88892169b1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8e2c5afa-19ad-41df-a410-4e88892169b1" (UID: "8e2c5afa-19ad-41df-a410-4e88892169b1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:12:07.328870 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.328761 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6vpw\" (UniqueName: \"kubernetes.io/projected/8e2c5afa-19ad-41df-a410-4e88892169b1-kube-api-access-m6vpw\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:12:07.328870 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.328800 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e2c5afa-19ad-41df-a410-4e88892169b1-tls-cert\") on node \"ip-10-0-129-87.ec2.internal\" DevicePath \"\"" Jul 24 04:12:07.789417 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.789371 2578 generic.go:356] "Generic (PLEG): container finished" podID="8e2c5afa-19ad-41df-a410-4e88892169b1" containerID="2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e" exitCode=0 Jul 24 04:12:07.789417 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.789420 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7497d464cb-dvnq6" Jul 24 04:12:07.789922 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.789420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7497d464cb-dvnq6" event={"ID":"8e2c5afa-19ad-41df-a410-4e88892169b1","Type":"ContainerDied","Data":"2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e"} Jul 24 04:12:07.789922 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.789475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7497d464cb-dvnq6" event={"ID":"8e2c5afa-19ad-41df-a410-4e88892169b1","Type":"ContainerDied","Data":"07e98530cd06afda40ba0dbbe92c1faf2cfc211bc92f9ad6ea9e8f5dac2dc73c"} Jul 24 04:12:07.789922 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.789499 2578 scope.go:117] "RemoveContainer" containerID="2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e" Jul 24 04:12:07.798749 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.798730 2578 scope.go:117] "RemoveContainer" containerID="2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e" Jul 24 04:12:07.799031 ip-10-0-129-87 kubenswrapper[2578]: E0724 04:12:07.799012 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e\": container with ID starting with 2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e not found: ID does not exist" containerID="2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e" Jul 24 04:12:07.799103 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.799039 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e"} err="failed to get container status \"2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e\": rpc error: code = NotFound desc = could not find container \"2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e\": container with ID starting with 2005c4b4241585738124119deb68c2c99f46cf52960adc075e5093bc6fa6f11e not found: ID does not exist" Jul 24 04:12:07.819500 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.819473 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7497d464cb-dvnq6"] Jul 24 04:12:07.824929 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:07.824903 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7497d464cb-dvnq6"] Jul 24 04:12:08.260599 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:08.260566 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e2c5afa-19ad-41df-a410-4e88892169b1" path="/var/lib/kubelet/pods/8e2c5afa-19ad-41df-a410-4e88892169b1/volumes" Jul 24 04:12:45.151015 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:45.150974 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-769795b965-2xgpv_15f0c9f7-a205-43a1-9d26-1df84e23a766/authorino/0.log" Jul 24 04:12:50.589515 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:50.589486 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6qtcf_a12f01de-4a5c-4297-882f-f946cdae7fc5/manager/0.log" Jul 24 04:12:50.712735 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:50.712696 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qrn2r_e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9/manager/0.log" Jul 24 04:12:51.338778 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:51.338746 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m_d91faba5-7221-4b1a-8588-f246be6a6ad3/copy-manifests/0.log" Jul 24 04:12:51.344554 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:51.344527 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m_d91faba5-7221-4b1a-8588-f246be6a6ad3/manager/0.log" Jul 24 04:12:53.225258 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:53.225227 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-769795b965-2xgpv_15f0c9f7-a205-43a1-9d26-1df84e23a766/authorino/0.log" Jul 24 04:12:53.470068 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:53.470034 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xs6kk_959fae1e-5601-4898-bf00-aee7c30e4299/manager/0.log" Jul 24 04:12:54.084652 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:54.084616 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-77xl2_198323c4-284e-4ca2-b596-fe5ee0cc89f8/manager/0.log" Jul 24 04:12:55.268413 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:55.268360 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f554cdb4c-tn48f_75c0a7c0-765e-465f-ab9e-54e18fa72aa1/router/0.log" Jul 24 04:12:55.626823 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:55.626718 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-sq87f_edcc41c8-69ed-4ced-b94f-ce61e63d7a01/main/0.log" Jul 24 04:12:55.866286 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:12:55.866254 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7sz5v_b424ea3e-be35-4b97-85ae-727aa5eb48b1/main/0.log" Jul 24 04:13:04.612707 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:04.612674 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-drhnf_68781720-31da-4036-97f5-d2bf5fcd0df0/global-pull-secret-syncer/0.log" Jul 24 04:13:04.750019 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:04.749986 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qt8ht_938a2309-e416-46dc-bbda-a1a9c5f3beaf/konnectivity-agent/0.log" Jul 24 04:13:04.769724 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:04.769685 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-87.ec2.internal_a4818398c4598e46d283eeb2e2a1a7ab/haproxy/0.log" Jul 24 04:13:09.275820 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:09.275759 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-769795b965-2xgpv_15f0c9f7-a205-43a1-9d26-1df84e23a766/authorino/0.log" Jul 24 04:13:09.341459 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:09.341428 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xs6kk_959fae1e-5601-4898-bf00-aee7c30e4299/manager/0.log" Jul 24 04:13:09.512352 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:09.512278 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-77xl2_198323c4-284e-4ca2-b596-fe5ee0cc89f8/manager/0.log" Jul 24 04:13:11.418799 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:11.418767 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-jm9dk_b3ddaa21-69fc-4604-8f3d-d4ae7bfadad7/cluster-monitoring-operator/0.log" Jul 24 04:13:11.842399 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:11.842341 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jtlq6_5b677cdd-bd1f-41bf-b139-6be02d394330/node-exporter/0.log" Jul 24 04:13:11.870881 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:11.870845 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jtlq6_5b677cdd-bd1f-41bf-b139-6be02d394330/kube-rbac-proxy/0.log" Jul 24 04:13:11.897829 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:11.897800 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jtlq6_5b677cdd-bd1f-41bf-b139-6be02d394330/init-textfile/0.log" Jul 24 04:13:12.409510 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:12.409477 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-ld7hw_089741d6-c17c-4868-9b00-f51d12c0aaa3/prometheus-operator-admission-webhook/0.log" Jul 24 04:13:13.847480 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:13.847446 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-lsgk5_bbf36a72-fb4a-4c25-b2eb-692d5184d481/networking-console-plugin/0.log" Jul 24 04:13:14.423379 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.423352 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/2.log" Jul 24 04:13:14.427018 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.426998 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s44kl_cbc42fe3-ed20-4ad7-9d57-48a641386372/console-operator/3.log" Jul 24 04:13:14.666654 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.666620 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh"] Jul 24 04:13:14.667015 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.667001 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2c5afa-19ad-41df-a410-4e88892169b1" containerName="authorino" Jul 24 04:13:14.667077 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.667016 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2c5afa-19ad-41df-a410-4e88892169b1" containerName="authorino" Jul 24 04:13:14.667114 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.667094 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2c5afa-19ad-41df-a410-4e88892169b1" containerName="authorino" Jul 24 04:13:14.669995 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.669954 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.672564 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.672543 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-plmrp\"/\"openshift-service-ca.crt\"" Jul 24 04:13:14.672689 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.672544 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-plmrp\"/\"default-dockercfg-qlnt6\"" Jul 24 04:13:14.672689 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.672594 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-plmrp\"/\"kube-root-ca.crt\"" Jul 24 04:13:14.676081 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.676023 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh"] Jul 24 04:13:14.820668 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.820638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-podres\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.820837 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.820682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-proc\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.820837 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.820742 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-sys\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.820837 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.820817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-lib-modules\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.820941 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.820863 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhd7p\" (UniqueName: \"kubernetes.io/projected/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-kube-api-access-hhd7p\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.921799 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.921758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-lib-modules\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.921799 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.921806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhd7p\" (UniqueName: \"kubernetes.io/projected/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-kube-api-access-hhd7p\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.922270 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.921837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-podres\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.922270 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.921863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-proc\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.922270 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.921888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-sys\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.922270 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.921957 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-lib-modules\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.922270 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.922007 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-sys\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.922270 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.922008 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-podres\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.922270 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.922023 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-proc\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.930389 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.930332 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhd7p\" (UniqueName: \"kubernetes.io/projected/f4c767e4-8e08-4105-9c8a-8e3a1eee66f6-kube-api-access-hhd7p\") pod \"perf-node-gather-daemonset-mgngh\" (UID: \"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:14.981357 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:14.981322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:15.126147 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:15.126122 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh"] Jul 24 04:13:15.128763 ip-10-0-129-87 kubenswrapper[2578]: W0724 04:13:15.128736 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf4c767e4_8e08_4105_9c8a_8e3a1eee66f6.slice/crio-0893c627912024cac4f21c0a332cfa874ec13e65accfac052b5f522fda1749fa WatchSource:0}: Error finding container 0893c627912024cac4f21c0a332cfa874ec13e65accfac052b5f522fda1749fa: Status 404 returned error can't find the container with id 0893c627912024cac4f21c0a332cfa874ec13e65accfac052b5f522fda1749fa Jul 24 04:13:15.595431 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:15.595398 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-lwm4l_eace775d-a1c8-402b-8a65-95d2d83fea13/volume-data-source-validator/0.log" Jul 24 04:13:16.121473 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:16.121435 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" event={"ID":"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6","Type":"ContainerStarted","Data":"d6ef2db464c8cff2a1b2f2d85d4f3b991be26214fbe6952079c1be6cb45e5d9a"} Jul 24 04:13:16.121866 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:16.121495 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" event={"ID":"f4c767e4-8e08-4105-9c8a-8e3a1eee66f6","Type":"ContainerStarted","Data":"0893c627912024cac4f21c0a332cfa874ec13e65accfac052b5f522fda1749fa"} Jul 24 04:13:16.121866 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:16.121532 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:16.138538 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:16.138484 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" podStartSLOduration=2.13846876 podStartE2EDuration="2.13846876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:13:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:13:16.136689917 +0000 UTC m=+808.370389591" watchObservedRunningTime="2026-07-24 04:13:16.13846876 +0000 UTC m=+808.372168480" Jul 24 04:13:16.623198 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:16.623171 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2pcmq_d450efc4-763a-445e-9db9-64ba3c11b3da/dns/0.log" Jul 24 04:13:16.646617 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:16.646589 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2pcmq_d450efc4-763a-445e-9db9-64ba3c11b3da/kube-rbac-proxy/0.log" Jul 24 04:13:16.821321 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:16.821292 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vgwxn_4c051de6-a3da-40e6-b9d6-577438554204/dns-node-resolver/0.log" Jul 24 04:13:17.425440 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:17.425403 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nqgm4_3b492c24-539e-4502-b99c-92ce1a38f866/node-ca/0.log" Jul 24 04:13:18.755154 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:18.755116 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f554cdb4c-tn48f_75c0a7c0-765e-465f-ab9e-54e18fa72aa1/router/0.log" Jul 24 04:13:19.374771 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:19.374738 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8wlb8_d26bd751-182b-4dc4-8bf3-39cfb76a5e86/serve-healthcheck-canary/0.log" Jul 24 04:13:19.902787 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:19.902750 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-jk2zf_57155d90-234f-4763-9688-382e925a8f4c/insights-operator/0.log" Jul 24 04:13:19.903197 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:19.903021 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-jk2zf_57155d90-234f-4763-9688-382e925a8f4c/insights-operator/1.log" Jul 24 04:13:19.925772 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:19.925744 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kxlkj_325d30ed-fb31-40cf-ac93-902eca0bf5ce/kube-rbac-proxy/0.log" Jul 24 04:13:19.948339 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:19.948314 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kxlkj_325d30ed-fb31-40cf-ac93-902eca0bf5ce/exporter/0.log" Jul 24 04:13:19.972136 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:19.972104 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kxlkj_325d30ed-fb31-40cf-ac93-902eca0bf5ce/extractor/0.log" Jul 24 04:13:22.137347 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:22.137318 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-mgngh" Jul 24 04:13:22.241097 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:22.241066 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6qtcf_a12f01de-4a5c-4297-882f-f946cdae7fc5/manager/0.log" Jul 24 04:13:22.273721 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:22.273692 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qrn2r_e1b0bc91-ba71-4a7f-8266-0f0ddcc531c9/manager/0.log" Jul 24 04:13:22.451450 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:22.451367 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m_d91faba5-7221-4b1a-8588-f246be6a6ad3/manager/0.log" Jul 24 04:13:22.472802 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:22.472773 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dfdd98ccb-s4x8m_d91faba5-7221-4b1a-8588-f246be6a6ad3/copy-manifests/0.log" Jul 24 04:13:23.612065 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:23.612037 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65c5cbb794-ds6sj_da131404-591c-4524-afc3-c3d56aac8923/manager/0.log" Jul 24 04:13:24.522889 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:24.522856 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f554cdb4c-tn48f_75c0a7c0-765e-465f-ab9e-54e18fa72aa1/router/0.log" Jul 24 04:13:25.905079 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:25.905045 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f554cdb4c-tn48f_75c0a7c0-765e-465f-ab9e-54e18fa72aa1/router/0.log" Jul 24 04:13:28.784998 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:28.784954 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-hkg9q_0781f412-c116-4124-9092-c6f0a2bcd90c/migrator/0.log" Jul 24 04:13:28.805654 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:28.805625 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-hkg9q_0781f412-c116-4124-9092-c6f0a2bcd90c/graceful-termination/0.log" Jul 24 04:13:29.166381 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:29.166303 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc_d7e5f257-bd10-4823-bd94-d72dee0b5cf7/kube-storage-version-migrator-operator/1.log" Jul 24 04:13:29.167150 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:29.167131 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-hr2wc_d7e5f257-bd10-4823-bd94-d72dee0b5cf7/kube-storage-version-migrator-operator/0.log" Jul 24 04:13:30.276000 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:30.275951 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2slfs_74107bd8-aa9c-4f18-9306-f9c41ec9f370/kube-multus-additional-cni-plugins/0.log" Jul 24 04:13:30.297676 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:30.297646 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2slfs_74107bd8-aa9c-4f18-9306-f9c41ec9f370/egress-router-binary-copy/0.log" Jul 24 04:13:30.320160 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:30.320130 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2slfs_74107bd8-aa9c-4f18-9306-f9c41ec9f370/cni-plugins/0.log" Jul 24 04:13:30.340804 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:30.340774 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2slfs_74107bd8-aa9c-4f18-9306-f9c41ec9f370/bond-cni-plugin/0.log" Jul 24 04:13:30.365869 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:30.365840 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2slfs_74107bd8-aa9c-4f18-9306-f9c41ec9f370/routeoverride-cni/0.log" Jul 24 04:13:30.388439 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:30.388411 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2slfs_74107bd8-aa9c-4f18-9306-f9c41ec9f370/whereabouts-cni-bincopy/0.log" Jul 24 04:13:30.425691 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:30.425657 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2slfs_74107bd8-aa9c-4f18-9306-f9c41ec9f370/whereabouts-cni/0.log" Jul 24 04:13:30.806656 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:30.806623 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-x79bw_d6982ca3-8712-4aac-b885-aa150ce317c5/kube-multus/0.log" Jul 24 04:13:30.897105 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:30.897074 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fn8hw_cfdaa993-a5f2-486b-be35-f6d04e6eb8f2/network-metrics-daemon/0.log" Jul 24 04:13:30.930164 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:30.930138 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fn8hw_cfdaa993-a5f2-486b-be35-f6d04e6eb8f2/kube-rbac-proxy/0.log" Jul 24 04:13:32.048192 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:32.048161 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdjz5_8df531f2-fcc2-418d-8351-e752ca2da1dd/ovn-controller/0.log" Jul 24 04:13:32.085794 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:32.085762 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdjz5_8df531f2-fcc2-418d-8351-e752ca2da1dd/ovn-acl-logging/0.log" Jul 24 04:13:32.121130 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:32.121103 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdjz5_8df531f2-fcc2-418d-8351-e752ca2da1dd/kube-rbac-proxy-node/0.log" Jul 24 04:13:32.158194 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:32.158168 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdjz5_8df531f2-fcc2-418d-8351-e752ca2da1dd/kube-rbac-proxy-ovn-metrics/0.log" Jul 24 04:13:32.178730 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:32.178704 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdjz5_8df531f2-fcc2-418d-8351-e752ca2da1dd/northd/0.log" Jul 24 04:13:32.208113 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:32.208085 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdjz5_8df531f2-fcc2-418d-8351-e752ca2da1dd/nbdb/0.log" Jul 24 04:13:32.239755 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:32.239727 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdjz5_8df531f2-fcc2-418d-8351-e752ca2da1dd/sbdb/0.log" Jul 24 04:13:32.301402 ip-10-0-129-87 kubenswrapper[2578]: I0724 04:13:32.301323 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pdjz5_8df531f2-fcc2-418d-8351-e752ca2da1dd/ovnkube-controller/0.log"